Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support multiple file dependencies with --setup_file option #92

Open
cisaacstern opened this issue Aug 23, 2023 · 1 comment
Open

Support multiple file dependencies with --setup_file option #92

cisaacstern opened this issue Aug 23, 2023 · 1 comment

Comments

@cisaacstern
Copy link
Member

Users may want to put some code in modules outside their recipe module. To access such code, a setup file is needed, per beam docs:

https://beam.apache.org/documentation/sdks/python-pipeline-dependencies/#multiple-file-dependencies

@jbusecke recently ran into this issue here.

Haven't quite wrapped my head around how much this path will diverge from what we're currently doing (maybe not too much, maybe a bit).

@yuvipanda
Copy link
Collaborator

@cisaacstern I actually got most of this done many months ago. Needs rebasing and completion though. https://github.com/pangeo-forge/pangeo-forge-runner/compare/setup_py?expand=1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants