Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Faster endofnight web app asset loading #6

Open
dkirkby opened this issue Dec 19, 2024 · 1 comment
Open

Faster endofnight web app asset loading #6

dkirkby opened this issue Dec 19, 2024 · 1 comment

Comments

@dkirkby
Copy link
Member

dkirkby commented Dec 19, 2024

Typical asset load times reported by the web app are:

Looking for 20241204 assets in [ https://data.desi.lbl.gov/desi/engineering/focalplane/endofnight/20241204 ]
20241204 has 45 positioning exposures
Loaded moves in 10623ms
Loaded summary in 1311ms
Loaded front image in 2595ms
Loaded back image in 3264ms

The corresponding file sizes are (the calib and hwtables files are not being read yet):

image

I suspect that the >10s needed to load the moves is mostly due to gzip decompression, rather than the network transfer, but this needs to be confirmed. The relatively new DecompressionStream API looks promising to speed this up.

Another thing to check is whether these files are being loaded in parallel (as intended) or serially.

@dkirkby
Copy link
Member Author

dkirkby commented Dec 20, 2024

Looking at this 2020 SO post from the author of the fflate pkg (which we use now), the native DecompressionStream may not be any faster, or perhaps things have changed in 4 years?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant