[BuildRules] Enable alpaka ROCm backend [13.0.x] #8347

fwyzard · 2023-03-02T11:13:25Z

Backport of #8346.

fwyzard · 2023-03-02T11:13:33Z

backport #8346

fwyzard · 2023-03-02T11:13:41Z

please test

cmsbuild · 2023-03-02T11:13:47Z

A new Pull Request was created by @fwyzard (Andrea Bocci) for branch IB/CMSSW_13_0_X/master.

@smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.
cms-bot commands are listed here

Backported from [BuildRules] Enable alpaka ROCm backend #8346

fwyzard · 2023-03-02T11:13:53Z

please test for el8_ppc64le_gcc11

fwyzard · 2023-03-02T11:26:29Z

urgent

needed for 13.0.0

fwyzard · 2023-03-02T11:26:53Z

please abort

fwyzard · 2023-03-02T11:27:41Z

please test with cms-sw/cmssw#40725

fwyzard · 2023-03-02T11:28:11Z

please test with cms-sw/cmssw#40725 for el8_ppc64le_gcc11

cmsbuild · 2023-03-02T14:12:29Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/30995/summary.html
COMMIT: cea7f5f
CMSSW: CMSSW_13_0_X_2023-02-28-1500/el8_ppc64le_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8347/30995/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@civanch [13_0_X] Fix generator interface to Geant4 cmssw#40908
@mmusich [13.0.X] Disentangle TrackerTrackHitFilter from phase-0 Strip conditions and activate common alignment track refitter sequence for phase-2 cmssw#40896
@cmsbuild Initialise local variables to null pointers [13.0.x] cmssw#40894
@davidwalter2 DQMOffline/Lumi zcounting backport of PR #40815 [CMSSW_13_0_X] cmssw#40874
@arossi83 Fix Tracks related Pixel quantities at HLT DQM (backport) cmssw#40875
@AdrianoDee [13_0_X] Fix cudaMemcpyAsync for localCoordToHostAsync cmssw#40870

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/30995/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/30995/git-merge-result

cmsbuild · 2023-03-02T17:15:00Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/30994/summary.html
COMMIT: cea7f5f
CMSSW: CMSSW_13_0_X_2023-03-02-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8347/30994/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@civanch [13_0_X] Fix generator interface to Geant4 cmssw#40908

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/30994/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/30994/git-merge-result

Comparison Summary

Summary:

You potentially removed 22 lines from the logs
Reco comparison results: 2 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3557934
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3557912
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 213 log files, 164 edm output root files, 49 DQM output files
TriggerResults: no differences found

cmsbuild · 2023-03-02T23:07:08Z

Pull request #8347 was updated.

fwyzard · 2023-03-03T00:21:05Z

test parameters:

addpkg = DataFormats/Portable,DataFormats/PortableTestObjects,HeterogeneousCore/AlpakaCore,HeterogeneousCore/AlpakaInterface,HeterogeneousCore/AlpakaServices,HeterogeneousCore/AlpakaTest

fwyzard · 2023-03-03T00:21:20Z

please test

fwyzard · 2023-03-03T00:22:12Z

please test for el8_ppc64le_gcc11

cmsbuild · 2023-03-03T08:49:45Z

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/31018/summary.html
COMMIT: 9b2fdf6
CMSSW: CMSSW_13_0_X_2023-02-28-1500/el8_ppc64le_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8347/31018/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/31018/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/31018/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test testONNXRuntime had ERRORS
---> test testFWCoreUtilities had ERRORS

cmsbuild · 2023-03-03T11:12:25Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/31017/summary.html
COMMIT: 9b2fdf6
CMSSW: CMSSW_13_0_X_2023-03-02-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8347/31017/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/31017/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-488b35/31017/git-merge-result

Comparison Summary

Summary:

You potentially removed 33 lines from the logs
Reco comparison results: 10 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3557934
DQMHistoTests: Total failures: 6
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3557906
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 213 log files, 164 edm output root files, 49 DQM output files
TriggerResults: no differences found

smuzaffar · 2023-03-03T11:22:59Z

+externals
this can go in 13.0.X now

cmsbuild · 2023-03-03T11:23:20Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_13_0_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

perrotta · 2023-03-03T11:32:39Z

+1

perrotta · 2023-03-03T12:39:31Z

merge

cmsbuild added externals-pending pending-signatures tests-started orp-pending backport labels Mar 2, 2023

cmsbuild added the urgent label Mar 2, 2023

cmsbuild added tests-pending and removed tests-started labels Mar 2, 2023

cmsbuild added tests-started requires-external and removed tests-pending labels Mar 2, 2023

cmsbuild added tests-approved and removed tests-started labels Mar 2, 2023

[BuildRules] Enable alpaka ROCm backend

9b2fdf6

fwyzard force-pushed the IB/CMSSW_13_0_X/master_enable_ROCm_backend branch from cea7f5f to 9b2fdf6 Compare March 2, 2023 23:06

cmsbuild added tests-pending and removed tests-approved requires-external labels Mar 2, 2023

cmsbuild added tests-started and removed tests-pending labels Mar 3, 2023

cmsbuild added backport-ok and removed backport labels Mar 3, 2023

cmsbuild added tests-approved and removed tests-started labels Mar 3, 2023

cmsbuild added externals-approved fully-signed and removed externals-pending pending-signatures labels Mar 3, 2023

cmsbuild added orp-approved and removed orp-pending labels Mar 3, 2023

cmsbuild merged commit 770e0f9 into cms-sw:IB/CMSSW_13_0_X/master Mar 3, 2023

This was referenced Mar 3, 2023

[13.0.X] Update UTM to version 0.11.0 #8353

Closed

[Backport to 13_0] Update UTM to version 0.11.0 #8354

Closed

fwyzard deleted the IB/CMSSW_13_0_X/master_enable_ROCm_backend branch March 4, 2023 18:22

cmsbuild mentioned this pull request Mar 4, 2023

[TBB] Fix concurrent_[bounded_]queue correctness on weak memory models [13.0.x] #8358

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[BuildRules] Enable alpaka ROCm backend [13.0.x] #8347

[BuildRules] Enable alpaka ROCm backend [13.0.x] #8347

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

cmsbuild commented Mar 2, 2023 •

edited

Loading

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

cmsbuild commented Mar 2, 2023

cmsbuild commented Mar 2, 2023

cmsbuild commented Mar 2, 2023

fwyzard commented Mar 3, 2023

fwyzard commented Mar 3, 2023

fwyzard commented Mar 3, 2023

cmsbuild commented Mar 3, 2023

cmsbuild commented Mar 3, 2023

smuzaffar commented Mar 3, 2023

cmsbuild commented Mar 3, 2023

perrotta commented Mar 3, 2023

perrotta commented Mar 3, 2023

[BuildRules] Enable alpaka ROCm backend [13.0.x] #8347

[BuildRules] Enable alpaka ROCm backend [13.0.x] #8347

Conversation

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

cmsbuild commented Mar 2, 2023 • edited Loading

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

fwyzard commented Mar 2, 2023

cmsbuild commented Mar 2, 2023

cmsbuild commented Mar 2, 2023

Comparison Summary

cmsbuild commented Mar 2, 2023

fwyzard commented Mar 3, 2023

fwyzard commented Mar 3, 2023

fwyzard commented Mar 3, 2023

cmsbuild commented Mar 3, 2023

Unit Tests

cmsbuild commented Mar 3, 2023

Comparison Summary

smuzaffar commented Mar 3, 2023

cmsbuild commented Mar 3, 2023

perrotta commented Mar 3, 2023

perrotta commented Mar 3, 2023

cmsbuild commented Mar 2, 2023 •

edited

Loading