Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HDP 3.1 NoSuchMethodError with HDFS Jar Storage #1345

Open
shawnweeks opened this issue Mar 29, 2019 · 6 comments
Open

HDP 3.1 NoSuchMethodError with HDFS Jar Storage #1345

shawnweeks opened this issue Mar 29, 2019 · 6 comments

Comments

@shawnweeks
Copy link

shawnweeks commented Mar 29, 2019

Startup on an HDP 3.1.0 and HDF 3.4.0 Cluster fails with following error. Looks to be a dependency issues.

Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.io.retry.RetryUtils.getDefaultRetryPolicy(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/String;ZLjava/lang/String;Ljava/lang/String;Ljava/lang/Class;)Lorg/apache/hadoop/io/retry/RetryPolicy; at org.apache.hadoop.hdfs.NameNodeProxies.createNNProxyWithClientProtocol(NameNodeProxies.java:318) at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:235) at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:139) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:510) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:453) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:136) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3303) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3352) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3320) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:479) at com.hortonworks.registries.common.util.HdfsFileStorage.init(HdfsFileStorage.java:63) at com.hortonworks.streamline.webservice.StreamlineApplication.getJarStorage(StreamlineApplication.java:222) at com.hortonworks.streamline.webservice.StreamlineApplication.registerResources(StreamlineApplication.java:245) at com.hortonworks.streamline.webservice.StreamlineApplication.run(StreamlineApplication.java:102) at com.hortonworks.streamline.webservice.StreamlineApplication.run(StreamlineApplication.java:76) at io.dropwizard.cli.EnvironmentCommand.run(EnvironmentCommand.java:43) at io.dropwizard.cli.ConfiguredCommand.run(ConfiguredCommand.java:85) at io.dropwizard.cli.Cli.run(Cli.java:75) at io.dropwizard.Application.run(Application.java:79) at com.hortonworks.streamline.webservice.StreamlineApplication.main(StreamlineApplication.java:80)

@shawnweeks shawnweeks changed the title HDP 3.1 NoSuchMethodError HDP 3.1 NoSuchMethodError with HDFS Jar Storage Mar 29, 2019
@aditya777hp
Copy link

which database are you using for ambari ?

@shawnweeks
Copy link
Author

shawnweeks commented Apr 3, 2019 via email

@aditya777hp
Copy link

Something similar happened with me as well, try changing the driver.Maybe using an older version of the driver might help !!!

@shawnweeks
Copy link
Author

I'm confused at what Postgres has to do with this. It's saying that the method org.apache.hadoop.io.retry.RetryUtils.getDefaultRetryPolicy(Lorg/apache/hadoop/conf/Configuration;Ljava/lang/String;ZLjava/lang/String;Ljava/lang/String;Ljava/lang/Class;) doesn't exist. I'm assuming It's because sam and HDP were built different versions of the Hadoop Libraries but I don't know. Seems like an odd problem to have.

@aditya777hp
Copy link

Ok, It might be so...

@shorley
Copy link

shorley commented Jan 28, 2020

Hi, I am also having same problem when I try running any spark script on Zeppeeln 0.8.0. My HDP is 3.1.4.
Were you able to resolve this please? Kindly share how to resolve.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants