We are trying to deploy Dr.Elephant but unable to built JAR in Hadoop 3.1.1/ Spark 2.3.2 / Scala 2.11.12

[MohammedLayeeq]

hadoop 3.1.1 Version
spark 2.3.2 Version
scala 2.11.12 Version
sbt 1.2.8 Version

[error] (update) sbt.librarymanagement.ResolveException: unresolved dependency: com.typesafe.play#sbt-plugin;2.2.2: not found
[error] unresolved dependency: de.johoop#jacoco4sbt;2.1.6: not found
[error] unresolved dependency: de.johoop#findbugs4sbt;1.4.0: not found
[error] unresolved dependency: de.johoop#cpd4sbt;1.2.0: not found
Project loading failed: (r)etry, (q)uit, (l)ast, or (i)gnore?

Can some guide or comment on this.
and also Dr.Elephant is compatible or not with above environments details .

[samuelan]

I am interested in Hadoop 3 and Spark 2.4 at least, but this hasn't been active for a while it seems. TypeSafe.play has evolved and this has not been evolving, I am guessing you are on your own at this point.

[ShubhamGupta29]

Hi @MohammedLayeeq ,
For Spark 2.3 try using this branch: https://github.com/ShubhamGupta29/dr-elephant/tree/feature_spark2.3
Kindly don't update any config and Dr.Elephant should be able to work with your Hadoop 3 (as Dr.E mostly uses YARN's API to fetch applications and that is same in Hadoop 3). Let me know if you face any further issue.