Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add DatasourceCompactibleSegmentIterator #150

Closed
wants to merge 16 commits into from

Conversation

kfaraz
Copy link
Owner

@kfaraz kfaraz commented Jul 15, 2024

No description provided.

kfaraz and others added 6 commits July 15, 2024 10:13
…more readable and concise (apache#16732)

Changes:
- No functional change
- Add class `TuningConfigBuilder` to build `IndexTuningConfig`, `CompactionTuningConfig`
- Remove old class `ParallelIndexTestingFactory.TuningConfigBuilder`
- Remove some unused fields and methods
…ache#16667)

Do not kill segments with referenced load specs from deep storage
…e types when reading from spilled files and cached results (apache#16620)

Like apache#16511, but for keys that have been spilled or cached during the grouping process
Add ability to query entirely cold datasources.
* When an ArrayList RAC creates a child RAC, the start and end offsets need to have the offset of parent's start offset
* Defaults the 2nd window bound to CURRENT ROW when only a single bound is specified
* Removes the windowingStrictValidation warning and throws a hard exception when Order By alongside RANGE clause is not provided with UNBOUNDED or CURRENT ROW as both bounds
if (compactionConfig == null) {
return from(null, null, null);
} else {
return from(compactionConfig.getTuningConfig(), compactionConfig.getMaxRowsPerSegment(), null);

Check notice

Code scanning / CodeQL

Deprecated method or constructor invocation Note

Invoking
DataSourceCompactionConfig.getMaxRowsPerSegment
should be avoided because it has been deprecated.
@kfaraz kfaraz force-pushed the refactor_segment_iterator branch from 37dedf8 to f812c26 Compare July 16, 2024 04:47
@kfaraz kfaraz closed this Jul 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants