Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sql-queries: tpch workload is failing due to "disk budget exceeded" #134415

Open
nameisbhaskar opened this issue Nov 6, 2024 · 1 comment
Open
Labels
branch-release-24.3 Used to mark GA and release blockers, technical advisories, and bugs for 24.3 C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-24.3-scale-testing Issue found during scale testing of 24.3. O-testcluster Issues found or occurred on a test cluster, i.e. a long-running internal cluster T-sql-queries SQL Queries Team

Comments

@nameisbhaskar
Copy link
Contributor

nameisbhaskar commented Nov 6, 2024

We are trying to run the tpch workload on drt-scale cluster with a scale factor of 1000. We are seeing the following error while running the queries by tpch workload:

Nov 06 11:09:02 workload-scale-0001 bash[17452]: E241106 11:09:02.935389 1 workload/cli/run.go:599  [-] 20  [q2]: pq: temp disk storage: disk budget exceeded: 1048576 bytes requested, 3435>
Nov 06 11:09:02 workload-scale-0001 bash[17452]: Error: [q2]: pq: temp disk storage: disk budget exceeded: 1048576 bytes requested, 34359738368 currently allocated, 34359738368 bytes in bu>
Nov 06 11:09:02 workload-scale-0001 systemd[1]: tpch_run_scale_factor_1000.service: Main process exited, code=exited, status=1/FAILURE
Nov 06 11:09:02 workload-scale-0001 systemd[1]: tpch_run_scale_factor_1000.service: Failed with result 'exit-code'.
Nov 06 11:09:02 workload-scale-0001 systemd[1]: tpch_run_scale_factor_1000.service: Consumed 1.336s CPU time.

The disk capacity for the cluster is at 30% and still we are seeing this error. More details in the slack thread: https://cockroachlabs.slack.com/archives/C07HPMBLVJ7/p1730892175726699?thread_ts=1730789573.794549&cid=C07HPMBLVJ7

Jira issue: CRDB-44072

@nameisbhaskar nameisbhaskar added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. T-sql-queries SQL Queries Team O-testcluster Issues found or occurred on a test cluster, i.e. a long-running internal cluster P-1 Issues/test failures with a fix SLA of 1 month O-24.3-scale-testing Issue found during scale testing of 24.3. labels Nov 6, 2024
Copy link

blathers-crl bot commented Nov 6, 2024

Hi @nameisbhaskar, please add branch-* labels to identify which branch(es) this C-bug affects.

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

@nameisbhaskar nameisbhaskar added the branch-release-24.3 Used to mark GA and release blockers, technical advisories, and bugs for 24.3 label Nov 6, 2024
@exalate-issue-sync exalate-issue-sync bot added P-0 Issues/test failures with a fix SLA of 2 weeks and removed P-1 Issues/test failures with a fix SLA of 1 month labels Nov 6, 2024
@yuzefovich yuzefovich removed the P-0 Issues/test failures with a fix SLA of 2 weeks label Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
branch-release-24.3 Used to mark GA and release blockers, technical advisories, and bugs for 24.3 C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. O-24.3-scale-testing Issue found during scale testing of 24.3. O-testcluster Issues found or occurred on a test cluster, i.e. a long-running internal cluster T-sql-queries SQL Queries Team
Projects
Status: Triage
Development

No branches or pull requests

2 participants