Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Maintain column table stats in BucketRegion and use that for stats service #509

Open
wants to merge 8 commits into
base: snappy/master
Choose a base branch
from

Conversation

sumwale
Copy link

@sumwale sumwale commented Aug 1, 2019

Changes proposed in this pull request

  • in addition to off-heap size tracking in SNAP-3111 change critical-heap-percentage to leave out max 200MB (upper limit of 99%) #507, track number of rows in column batches
  • moved ColumnBatchKey interface to gemfire layer for above and pass the RegionEntry to
    updateMemoryStats to get key and invoke ColumnBatchKey.getColumnBatchRowCount
  • add field for number of columns in a table to ExternalTableMetadata and use that for the new
    PartitionedRegion.getNumColumns() method; removed ColumnBatchKey.getNumColumnsInTable
  • common static method in ClientSharedUtils to determine if a table/region name is for column table

Patch testing

precheckin -Pstore

Is precheckin with -Pstore clean?

yes

ReleaseNotes changes

NA

Other PRs

TIBCOSoftware/snappydata#1404

sumwale added 5 commits July 31, 2019 15:46
Tests checking for native timer being loaded occasionally fail due to some previous tests
initializing system in a different way. Now re-initialize the native timer for such a case.
- Track off-heap size in BucketRegion and add to getSizeInMemory() and getTotalBytes(). This fixes
  the callers of getTotalBytes() including rebalancing and determination of smallest bucket in SD layer.
- Update SnappyRegionStatsCollectorFunction to avoid separate collection of off-heap size.
@ashetkar ashetkar force-pushed the optimize-columnTable-stats branch from 7185b67 to 16db6c5 Compare September 24, 2020 09:38
@sumwale sumwale force-pushed the snappy/master branch 2 times, most recently from 337768c to ec453a6 Compare April 8, 2022 19:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant