Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ERROR [26/26] RUN cd /root/HiBench && mvn clean package -Dspark=1.6 -Dscala=2.10 #741

Open
MatthewLeeWilcox opened this issue Mar 14, 2024 · 0 comments

Comments

@MatthewLeeWilcox
Copy link

I am currently trying to build hibench in docker and Im running into this issue

=> ERROR [26/26] RUN cd /root/HiBench && mvn clean package -Dspark=1.6 -Dscala=2.10 3.7s

[26/26] RUN cd /root/HiBench && mvn clean package -Dspark=1.6 -Dscala=2.10:
1.908 [INFO] Scanning for projects...
2.294 [WARNING]
2.294 [WARNING] Some problems were encountered while building the effective model for com.intel.hibench.stormbench:stormbench-streaming:jar:6.0
2.294 [WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-shade-plugin is missing. @ line 97, column 15
2.294 [WARNING]
2.295 [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
2.295 [WARNING]
2.295 [WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
2.295 [WARNING]
2.305 [INFO] ------------------------------------------------------------------------
2.305 [INFO] Reactor Build Order:
2.305 [INFO]
2.306 [INFO] hibench
2.306 [INFO] hibench-common
2.306 [INFO] HiBench data generation tools
2.306 [INFO] sparkbench
2.306 [INFO] sparkbench-common
2.307 [INFO] sparkbench micro benchmark
2.307 [INFO] sparkbench machine learning benchmark
2.307 [INFO] sparkbench-websearch
2.307 [INFO] sparkbench-graph
2.307 [INFO] sparkbench-sql
2.308 [INFO] sparkbench-streaming
2.308 [INFO] sparkbench project assembly
2.309 [INFO] flinkbench
2.309 [INFO] flinkbench-streaming
2.310 [INFO] gearpumpbench
2.310 [INFO] gearpumpbench-streaming
2.310 [INFO] hadoopbench
2.311 [INFO] hadoopbench-sql
2.311 [INFO] mahout
2.311 [INFO] PEGASUS: A Peta-Scale Graph Mining System
2.312 [INFO] nutchindexing
2.312 [INFO] stormbench
2.313 [INFO] stormbench-streaming
2.319 [INFO]
2.319 [INFO] ------------------------------------------------------------------------
2.319 [INFO] Building hibench 6.0
2.319 [INFO] ------------------------------------------------------------------------
2.630 Downloading: https://oss.sonatype.org/content/groups/scala-tools/org/apache/maven/plugins/maven-clean-plugin/2.4.1/maven-clean-plugin-2.4.1.pom
Downloading: http://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/2.4.1/maven-clean-plugin-2.4.1.pom
[INFO] ------------------------------------------------------------------------
3.538 [INFO] Reactor Summary:
3.538 [INFO]
3.539 [INFO] hibench ........................................... FAILURE [1.219s]
3.539 [INFO] hibench-common .................................... SKIPPED
3.540 [INFO] HiBench data generation tools ..................... SKIPPED
3.540 [INFO] sparkbench ........................................ SKIPPED
3.540 [INFO] sparkbench-common ................................. SKIPPED
3.540 [INFO] sparkbench micro benchmark ........................ SKIPPED
3.541 [INFO] sparkbench machine learning benchmark ............. SKIPPED
3.541 [INFO] sparkbench-websearch .............................. SKIPPED
3.541 [INFO] sparkbench-graph .................................. SKIPPED
3.542 [INFO] sparkbench-sql .................................... SKIPPED
3.542 [INFO] sparkbench-streaming .............................. SKIPPED
3.542 [INFO] sparkbench project assembly ....................... SKIPPED
3.542 [INFO] flinkbench ........................................ SKIPPED
3.542 [INFO] flinkbench-streaming .............................. SKIPPED
3.543 [INFO] gearpumpbench ..................................... SKIPPED
3.543 [INFO] gearpumpbench-streaming ........................... SKIPPED
3.544 [INFO] hadoopbench ....................................... SKIPPED
3.544 [INFO] hadoopbench-sql ................................... SKIPPED
3.544 [INFO] mahout ............................................ SKIPPED
3.544 [INFO] PEGASUS: A Peta-Scale Graph Mining System ......... SKIPPED
3.544 [INFO] nutchindexing ..................................... SKIPPED
3.545 [INFO] stormbench ........................................ SKIPPED
3.545 [INFO] stormbench-streaming .............................. SKIPPED
3.545 [INFO] ------------------------------------------------------------------------
3.545 [INFO] BUILD FAILURE
3.545 [INFO] ------------------------------------------------------------------------
3.546 [INFO] Total time: 1.668s
3.546 [INFO] Finished at: Thu Mar 14 19:26:42 UTC 2024
3.619 [INFO] Final Memory: 6M/119M
3.619 [INFO] ------------------------------------------------------------------------
3.623 [ERROR] Plugin org.apache.maven.plugins:maven-clean-plugin:2.4.1 or one of its dependencies could not be resolved: Failed to read artifact descriptor for org.apache.maven.plugins:maven-clean-plugin:jar:2.4.1: Could not transfer artifact org.apache.maven.plugins:maven-clean-plugin:pom:2.4.1 from/to scala-tools.org (https://oss.sonatype.org/content/groups/scala-tools/): Access denied to: https://oss.sonatype.org/content/groups/scala-tools/org/apache/maven/plugins/maven-clean-plugin/2.4.1/maven-clean-plugin-2.4.1.pom , ReasonPhrase:Forbidden. -> [Help 1]
3.623 [ERROR]
3.623 [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
3.623 [ERROR] Re-run Maven using the -X switch to enable full debug logging.
3.624 [ERROR]
3.624 [ERROR] For more information about the errors and possible solutions, please read the following articles:
3.624 [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException
Dockerfile:146


145 | RUN apt-get update && apt-get install -y thrift-compiler
146 | >>> RUN cd ${HIBENCH_HOME} &&
147 | >>> mvn clean package -Dspark=1.6 -Dscala=2.10
148 |

ERROR: failed to solve: process "/bin/sh -c cd ${HIBENCH_HOME} && mvn clean package -Dspark=1.6 -Dscala=2.10" did not complete successfully: exit code: 1

Start building hibench-docker image...

[+] Building 0.5s (2/2) FINISHED docker:default
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 2.71kB 0.0s
=> ERROR [internal] load metadata for docker.io/library/hibench-base:latest 0.4s

[internal] load metadata for docker.io/library/hibench-base:latest:


Dockerfile:19

17 | # build opensource environment on hibench-base
18 |
19 | >>> FROM hibench-base
20 |
21 | USER root

ERROR: failed to solve: hibench-base: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed
Usage run_container.sh {cdh|open-source}

Where I am thinking it may be with downloading from http://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/2.4.1/maven-clean-plugin-2.4.1.pom where i believer it should be a https:// although I am not sure. I also don't know where to go to find this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant