Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sharding config with "Partition Range Start" #641

Open
samanvp opened this issue Jul 9, 2020 · 0 comments
Open

Sharding config with "Partition Range Start" #641

samanvp opened this issue Jul 9, 2020 · 0 comments

Comments

@samanvp
Copy link
Member

samanvp commented Jul 9, 2020

Currently our sharding config file only contains "Partition Range End". This means we always partition BigQuery tables by using 0 for start point.
This is not an issue of our current default sharding config where variants of each chromosome is assigned to a separate table. However, if config file includes multiple shard per chromosome (such as this one) we can improved the performance of partitioning by including the start position.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant