java.lang.NoClassDefFoundError

[kali786516]

Hi Author,

below is the error what I am getting when I am trying on Cloudera with spark version.

Welcome to
____ __
/ / ___ / /
\ / _ / _ `/ __/ '/
// .__/_,// //_\ version 2.4.0.cloudera2
//

Using Scala version 2.11.12 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_181)

Error:-
scala> val sfDF = spark.read.
| format("com.springml.spark.salesforce").
| option("username", "[email protected]").
| option("password", "datalake_1236602425434964914088").
| option("login","https://test.salesforce.com/services/Soap/u/40.0").
| option("soql", soql).
| option("version", "35.0").
| load()
java.lang.NoClassDefFoundError: com/springml/salesforce/wave/api/APIFactory
at com.springml.spark.salesforce.DefaultSource.createRelation(DefaultSource.scala:90)
at com.springml.spark.salesforce.DefaultSource.createRelation(DefaultSource.scala:54)
at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:318)
at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:223)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:211)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:167)
... 56 elided
Caused by: java.lang.ClassNotFoundException: com.springml.salesforce.wave.api.APIFactory
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 62 more

spark2-shell --jars ./spark-salesforce_2.11-1.1.0.jar --master "local"

val soql = "select * from CampaignMember"

val sfDF = spark.read.
format("com.springml.spark.salesforce").
option("username", "[email protected]").
option("password", "datalake_1236602425434964914088").
option("login","https://test.salesforce.com/services/Soap/u/40.0").
option("soql", soql).
option("version", "35.0").
load()

Thanks
Sri