Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cloud Pickle/Serialization Errors #34

Open
Jonah1234567 opened this issue Jun 9, 2022 · 0 comments
Open

Cloud Pickle/Serialization Errors #34

Jonah1234567 opened this issue Jun 9, 2022 · 0 comments
Labels
bug Something isn't working dcp Relates to DCP or the Compute API python Relates to Python code

Comments

@Jonah1234567
Copy link

Jonah1234567 commented Jun 9, 2022

When working with images (especially large PNG's that are heavily compressed), the images can have issues going over the wire both in PIL form and in NumPy array form. The error mainly seems to occur when sending multiple images, although it may be a product of PNG decompression and cloud pickle trying to pickle libraries with images. This was run on Colab with Node 16.15.0 and Python 3.7.13.

Error:
No error recorded but the console will stop at the uploading stage of deployment.

proceeding with currently installed version of dcp-client
State : exec
State : init
State : preauth
State : deploying
State : listeners
State : compute-groups
State : uploading

Images tested with:
While the Mario image is quite large, the job succeeds when it is sent alone, suggesting there could be issues regarding pickling multiple images at once.
mario (1)
download (2)
fire

@ccmcintyre-kingsds ccmcintyre-kingsds added bug Something isn't working dcp Relates to DCP or the Compute API python Relates to Python code labels Jun 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working dcp Relates to DCP or the Compute API python Relates to Python code
Projects
None yet
Development

No branches or pull requests

2 participants