Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Requests wont give any error but it will be hung. #7424

Open
shankarmn94 opened this issue Jan 17, 2024 · 3 comments
Open

Requests wont give any error but it will be hung. #7424

shankarmn94 opened this issue Jan 17, 2024 · 3 comments

Comments

@shankarmn94
Copy link

shankarmn94 commented Jan 17, 2024

We have a scenario where most of our queires are going to be in ques and hangs and will get no response for specific tables.
while we are unable to get the data from tables and modify specific tables.
these queries will be running for more time and wont even timeout or any.. No response from tables on queries.

citus_version: Citus 12.1.1 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit.

Fyi.
select count() from assets;
select count(
) from agents;

ccnsapp=# ANALYZE VERBOSE agents;

INFO: analyzing "public.agents"
INFO: "agents": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows

FATAL: terminating connection due to administrator command
server closed the connection unexpectedly
This probably means the server terminated abnormally
before or while processing the request.
The connection to the server was lost. Attempting reset: Succeeded.

ccnsapp=# SELECT undistribute_table($$public.agents$$, cascade_via_foreign_keys=>true);

no response.^.

queries on others table works fine.

for the other tables the qeuries runs fine.
select count(*) from ad_groups_ad_computers_map;
count

45343
(1 row)

select count(*) from asset_firewall_rules;
count

20632583
(1 row)

@shankarmn94
Copy link
Author

shankarmn94 commented Jan 17, 2024

am unable to run queries on specifi table in database. or how can we know whats happening.

@shankarmn94
Copy link
Author

Since this was causing the issue, we had 8 nodes cluster of citus,

we drained the 5 nodes one by one, added back. when we reach to the 6th node it started move the shard, the single shard was moving.

if i remove the node will that cause any issue.. any one please suggest us.

@julor
Copy link

julor commented Dec 7, 2024

#7772 Perhaps we have encountered the same problem

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants