Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Spark to 3.2.0, Parquet to 1.12.1, Avro to 1.10.2 #2289

Merged
merged 1 commit into from
Oct 14, 2021

Conversation

heuermh
Copy link
Member

@heuermh heuermh commented Jan 6, 2021

Fixes #2336, fixes #2331

@heuermh
Copy link
Member Author

heuermh commented Jan 6, 2021

Depends on apache/spark#30517

@AmplabJenkins
Copy link

Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/ADAM-prb/3142/

Build result: FAILURE

[...truncated 902 B...]Wiping out workspace first.Cloning the remote Git repositoryCloning repository https://github.com/bigdatagenomics/adam.git > git init /home/jenkins/workspace/ADAM-prb # timeout=10Using reference repository: /home/jenkins/gitcaches/adam.referenceFetching upstream changes from https://github.com/bigdatagenomics/adam.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/bigdatagenomics/adam.git +refs/heads/:refs/remotes/origin/ # timeout=15 > git config remote.origin.url https://github.com/bigdatagenomics/adam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/:refs/remotes/origin/ # timeout=10 > git config remote.origin.url https://github.com/bigdatagenomics/adam.git # timeout=10Fetching upstream changes from https://github.com/bigdatagenomics/adam.git > git fetch --tags --force --progress -- https://github.com/bigdatagenomics/adam.git +refs/pull/:refs/remotes/origin/pr/ # timeout=15 > git rev-parse 4e5e3da^{commit} # timeout=10Checking out Revision 4e5e3da (detached) > git config core.sparsecheckout # timeout=10 > git checkout -f 4e5e3da # timeout=10Commit message: "Update avro dependency version to 1.10.1, parquet to 1.11.1, spark to 3.2.0-SNAPSHOT" > git rev-list --no-walk deb8948 # timeout=10Triggering ADAM-prb » 3.2.1,2.12,3.0.1,ubuntuADAM-prb » 3.2.1,2.12,3.0.1,ubuntu completed with result FAILURENotifying endpoint with url 'https://webhooks.gitter.im/e/ac8bb6e9f53357bc8aa8'Setting status of 4e5e3da to FAILURE with url https://amplab.cs.berkeley.edu/jenkins/job/ADAM-prb/3142/ and message: 'Build finished. '

@heuermh heuermh force-pushed the parquet-avro-hive branch from 4e5e3da to f9830cf Compare August 22, 2021 18:14
@heuermh heuermh changed the title Update avro dependency version to 1.10.1, parquet to 1.11.1, spark to… Update avro dependency version to 1.10.2, parquet to 1.12.0, spark to 3.2.0 RC1 Aug 22, 2021
@heuermh heuermh added this to the 0.37.0 milestone Aug 22, 2021
@heuermh heuermh changed the title Update avro dependency version to 1.10.2, parquet to 1.12.0, spark to 3.2.0 RC1 Update avro dependency version to 1.10.2, parquet to 1.12.0, spark to 3.2.0 RC2 Sep 3, 2021
@heuermh heuermh changed the title Update avro dependency version to 1.10.2, parquet to 1.12.0, spark to 3.2.0 RC2 Update avro dependency version to 1.10.2, parquet to 1.12.0, spark to 3.2.0 RC3 Sep 20, 2021
@heuermh heuermh changed the title Update avro dependency version to 1.10.2, parquet to 1.12.0, spark to 3.2.0 RC3 Update avro dependency version to 1.10.2, parquet to 1.12.0, spark to 3.2.0 RC6 Sep 28, 2021
@heuermh heuermh changed the title Update avro dependency version to 1.10.2, parquet to 1.12.0, spark to 3.2.0 RC6 Update avro dependency version to 1.10.2, parquet to 1.12.0, spark to 3.2.0 RC7 Oct 6, 2021
@heuermh heuermh changed the title Update avro dependency version to 1.10.2, parquet to 1.12.0, spark to 3.2.0 RC7 Update Spark to 3.2.0, Parquet to 1.12.1, Avro to 1.10.2 Oct 12, 2021
@heuermh heuermh merged commit 1cb9111 into bigdatagenomics:master Oct 14, 2021
@heuermh heuermh deleted the parquet-avro-hive branch October 14, 2021 14:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Update Parquet to 1.12.x, Avro to 1.10.x, remove build workarounds Update Spark dependency version to 3.2.0
2 participants