Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dynamic scheduledRefreshContexts behavior #8726

Open
vkruoso opened this issue Sep 18, 2024 · 0 comments
Open

dynamic scheduledRefreshContexts behavior #8726

vkruoso opened this issue Sep 18, 2024 · 0 comments

Comments

@vkruoso
Copy link

vkruoso commented Sep 18, 2024

Describe the bug
When using the scheduledRefreshContexts function to provide a list of tenants to cube, the pre-aggregations partition data refresh stops working in some cases.

Our list of tenants is read from a Redis database. When the driverFactory function is called for a tenant, we add that tenant to the Redis cache for a specific time (1hr TTL for instance). The refresh worker will pick it up for pre-aggregation builds during the refresh interval. When the TTL expires and the key is no longer part of the security contexts, naturally the refresh worker will stop refreshing. The issue is that if that customer comes back it is necessary to kick-off again the partition refresh procedure and it seems it never does, even tough the driverFactory function is called again and the key is added to Redis again.

To Reproduce
Steps to reproduce the behavior:

  1. Create custom driverFactory function that returns a driver for each tenant and saves the tenant in Redis with TTL
  2. Run queries to check that partitions are build and that the refresh works
  3. Wait until the TTL expires
  4. Run more queries and check that the tenant was added to redis, but partitions are not refreshed

Expected behavior
That when tenants are added or removed from scheduledRefreshContexts results, the system would still behave as it should regarding partitions refreshes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant