Skip to content

This repository contains a pyspark script to unload from spark to gcs

License

Notifications You must be signed in to change notification settings

mixpanel/pyspark-unload-to-gcs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 

Repository files navigation

Unload to GCS using Pyspark

Pyspark script to unload from spark to GCS.

Use this script as a job in databricks with the task type SparkPython. Pass a SQL query to unload, gcs paths, and credentials in as arguments.

About

This repository contains a pyspark script to unload from spark to gcs

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages