You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
I'm getting FileNotFound exception when trying to create a scene from himawari data located at S3 using fsspec.
The same data works if I first load the data to local disk and I can also read GOES data (from AWS) as in the documentation. fsspec is also able to open the files which makes them appear in the cache (but with different name what is indicated in the stack trace).
The short answer is that the Himawari readers do not support fsspec at the moment, as you can see here https://satpy.readthedocs.io/en/stable/#id1 (last column gives fsspec compatibility).
This function relies on the getting access to the underlying C file pointer or fileno, which is obviously not available with fsspec file objects, as they are python filesobjects in a more abstract sense. Such functions include np.fromfile and np.memmap.
To make the readers compatible, these function calls need thus to be replaced with calls that work on pure python file objects.
For example, np.fromfile(file_object, ...) calls can be replaced with np.frombuffer(file_object.read(...), ...)
Describe the bug
I'm getting
FileNotFound
exception when trying to create a scene from himawari data located at S3 using fsspec.The same data works if I first load the data to local disk and I can also read GOES data (from AWS) as in the documentation.
fsspec
is also able to open the files which makes them appear in the cache (but with different name what is indicated in the stack trace).To Reproduce
Expected behavior
Being able to read himawari data from S3 bucket using fsspec.
Actual results
Getting following stack trace:
Environment Info:
Additional context
If this appears to be a real bug and someone is looking for that, I can provide keys to get data for the investigation.
The text was updated successfully, but these errors were encountered: