Great Expectations running on Hadoop (HDFS) #4821
rdodev
started this conversation in
Community Use Cases
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
While Great Expectations can be made to work with HDFS as a file system data source, the GE execution engine does not support running in distributed environments. The purpose of this discussion thread is to hear from the community how they are using is GE on Hadoop, what work-arounds, if any, and what the tool chain looks like (Spark, Oozie, etc.).
Beta Was this translation helpful? Give feedback.
All reactions