Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#2015] improvement(netty): Support Netty for MR integration test. #2016

Merged
merged 2 commits into from
Oct 21, 2024

Conversation

qijiale76
Copy link
Contributor

What changes were proposed in this pull request?

Support Netty for MR integration test.

Why are the changes needed?

Fix: #2015

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Integration tests themselves.

@codecov-commenter
Copy link

codecov-commenter commented Aug 6, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 52.87%. Comparing base (9f8951f) to head (1a64acf).
Report is 2 commits behind head on master.

Additional details and impacted files
@@             Coverage Diff              @@
##             master    #2016      +/-   ##
============================================
+ Coverage     52.35%   52.87%   +0.52%     
- Complexity     2815     3424     +609     
============================================
  Files           452      518      +66     
  Lines         21217    28352    +7135     
  Branches       1950     2650     +700     
============================================
+ Hits          11108    14992    +3884     
- Misses         9401    12394    +2993     
- Partials        708      966     +258     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link

github-actions bot commented Aug 6, 2024

Test Results

 2 926 files  +31   2 926 suites  +31   6h 15m 20s ⏱️ + 28m 15s
 1 049 tests + 6   1 047 ✅ + 7   2 💤 ±0  0 ❌  - 1 
13 045 runs  +72  13 015 ✅ +73  30 💤 ±0  0 ❌  - 1 

Results for commit 1a64acf. ± Comparison against base commit f9b4c0e.

This pull request removes 6 and adds 12 tests. Note that renamed tests count towards both.
org.apache.uniffle.test.DynamicConfTest ‑ dynamicConfTest
org.apache.uniffle.test.HadoopConfTest ‑ hadoopConfTest
org.apache.uniffle.test.LargeSorterTest ‑ largeSorterTest
org.apache.uniffle.test.RMWordCountTest ‑ wordCountTest
org.apache.uniffle.test.SecondarySortTest ‑ secondarySortTest
org.apache.uniffle.test.WordCountTest ‑ wordCountTest
org.apache.uniffle.test.DynamicConfTest ‑ dynamicConfTest{ClientType}[1]
org.apache.uniffle.test.DynamicConfTest ‑ dynamicConfTest{ClientType}[2]
org.apache.uniffle.test.HadoopConfTest ‑ hadoopConfTest{ClientType}[1]
org.apache.uniffle.test.HadoopConfTest ‑ hadoopConfTest{ClientType}[2]
org.apache.uniffle.test.LargeSorterTest ‑ largeSorterTest{ClientType}[1]
org.apache.uniffle.test.LargeSorterTest ‑ largeSorterTest{ClientType}[2]
org.apache.uniffle.test.RMWordCountTest ‑ wordCountTest{ClientType}[1]
org.apache.uniffle.test.RMWordCountTest ‑ wordCountTest{ClientType}[2]
org.apache.uniffle.test.SecondarySortTest ‑ secondarySortTest{ClientType}[1]
org.apache.uniffle.test.SecondarySortTest ‑ secondarySortTest{ClientType}[2]
…

♻️ This comment has been updated with latest results.

@rickyma rickyma changed the title [#2015] Improvement(netty): Support Netty for MR integration test. [#2015] improvement(netty): Support Netty for MR integration test. Aug 6, 2024
jerqi pushed a commit that referenced this pull request Sep 25, 2024
…using ShuffleBufferWithSkipList. (#2141)

### What changes were proposed in this pull request?

Release duplicate block.  #2016 solve this problem in client side. I think sendShuffeData may be retried, duplicated block still be reproduce.

### Why are the changes needed?

Fix: #2105

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

test in cluster.
@zhengchenyu
Copy link
Collaborator

LGTM! wait for ci!

@zhengchenyu zhengchenyu merged commit 43323bb into apache:master Oct 21, 2024
43 checks passed
maobaolong pushed a commit to maobaolong/incubator-uniffle that referenced this pull request Nov 4, 2024
… when using ShuffleBufferWithSkipList. (apache#2141)

### What changes were proposed in this pull request?

Release duplicate block.  apache#2016 solve this problem in client side. I think sendShuffeData may be retried, duplicated block still be reproduce.

### Why are the changes needed?

Fix: apache#2105

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

test in cluster.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Improvement] Support Netty for MR integration test
3 participants