[14_0_X] Update to relval_gpu.pyfor Alpaka and Pixel Triplets Alpaka Workflows

[AdrianoDee]

Backport of #45694 (with the exception of a comment that will anyway disappear soon) and #45963 (a fix) to 14_0_X.

This is useful because it allows to run 2024 Alpaka wfs in the PR testing, meaning we test also the Alpaka HLT.

Note: for Phase2, differently from master and 14_1_X we use D98 wfs here (since it was the baseline for 14_0_X).

[cmsbuild]

A new Pull Request was created by @AdrianoDee for CMSSW_14_0_X.

It involves the following packages:

• Configuration/PyReleaseValidation (upgrade, pdmv)
• DQM/SiPixelHeterogeneous (dqm)
• RecoTracker/Configuration (reconstruction)

@AdrianoDee, @antoniovagnerini, @cmsbuild, @jfernan2, @kskovpen, @mandrenguyen, @miquork, @nothingface0, @rvenditti, @srimanob, @subirsarkar, @sunilUIET, @syuvivida, @tjavaid can you please review it and eventually sign? Thanks.
@GiacomoSguazzoni, @JanFSchulte, @Martin-Grunewald, @VinInn, @VourMa, @dgulhan, @fabiocos, @felicepantaleo, @fioriNTU, @gpetruc, @idebruyn, @jandrea, @makortel, @missirol, @mmusich, @mtosi, @rovere, @slomeo, @threus this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

• Backported from Update to relval_gpu.pyfor Alpaka and Pixel Triplets Alpaka Workflows #45694

[cmsbuild]

cms-bot internal usage

[AdrianoDee]

test parameters:

• workflows = 12834.406, 12834.402, 29834.402, 29634.406
• workflows_gpu = 12834.406, 12834.402, 12834.403, 29834.402, 29634.406, 29834.403, 29634.496, 12834.496
• relvals_opt = --what upgrade
• relvals_opt_gpu = --what upgrade

[AdrianoDee]

enable gpu

[AdrianoDee]

please test

[cmsbuild]

-1

Failed Tests: RelVals RelVals-GPU
Size: This PR adds an extra 36KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-4a1d3c/41408/summary.html
COMMIT: b485a98
CMSSW: CMSSW_14_0_X_2024-09-09-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/45959/41408/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

• 29834.402

----- Begin Fatal Exception 09-Sep-2024 14:23:18 CEST-----------------------
An exception of category 'NoSecondaryFiles' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=MixingModule label='mix'
Exception Message:
RootEmbeddedFileSequence no input files specified for secondary input source.
----- End Fatal Exception -------------------------------------------------

• 29634.406A fatal system signal has occurred: abort signal

RelVals-GPU

• 29834.40229834.402_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka/step2_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka.log
• 29834.40329834.403_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka_Validation/step2_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka_Validation.log
• 29634.40629634.406_TTbar_14TeV+2026D110_Patatrack_PixelOnlyTripletsAlpaka/step3_TTbar_14TeV+2026D110_Patatrack_PixelOnlyTripletsAlpaka.log

Expand to see more relval errors ...

• 29634.496

[cmsbuild]

Pull request #45959 was updated. @AdrianoDee, @antoniovagnerini, @cmsbuild, @jfernan2, @kskovpen, @mandrenguyen, @miquork, @nothingface0, @rvenditti, @srimanob, @subirsarkar, @sunilUIET, @syuvivida, @tjavaid can you please check and sign again.

[AdrianoDee]

please test

…

Il giorno 9 set 2024, alle ore 15:49, cmsbuild ***@***.***> ha scritto: Pull request #45959 <#45959> was updated. @AdrianoDee <https://github.com/AdrianoDee>, @antoniovagnerini <https://github.com/antoniovagnerini>, @cmsbuild <https://github.com/cmsbuild>, @jfernan2 <https://github.com/jfernan2>, @kskovpen <https://github.com/kskovpen>, @mandrenguyen <https://github.com/mandrenguyen>, @miquork <https://github.com/miquork>, @nothingface0 <https://github.com/nothingface0>, @rvenditti <https://github.com/rvenditti>, @srimanob <https://github.com/srimanob>, @subirsarkar <https://github.com/subirsarkar>, @sunilUIET <https://github.com/sunilUIET>, @syuvivida <https://github.com/syuvivida>, @tjavaid <https://github.com/tjavaid> can you please check and sign again. — Reply to this email directly, view it on GitHub <#45959 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEA6IGV2PHLQCF4MDOCHCEDZVWRM7AVCNFSM6AAAAABN4IU5PGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMZYGE3TSNBTGE>. You are receiving this because you were mentioned.

[cmsbuild]

-1

Failed Tests: RelVals RelVals-GPU
Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-4a1d3c/41413/summary.html
COMMIT: f647555
CMSSW: CMSSW_14_0_X_2024-09-09-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/45959/41413/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

• 29834.402

----- Begin Fatal Exception 09-Sep-2024 17:40:51 CEST-----------------------
An exception of category 'NoSecondaryFiles' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=MixingModule label='mix'
Exception Message:
RootEmbeddedFileSequence no input files specified for secondary input source.
----- End Fatal Exception -------------------------------------------------

• 29634.406A fatal system signal has occurred: abort signal

RelVals-GPU

• 29834.40229834.402_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka/step2_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka.log
• 29834.40329834.403_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka_Validation/step2_TTbar_14TeV+2026D110PU_Patatrack_PixelOnlyAlpaka_Validation.log
• 29634.40629634.406_TTbar_14TeV+2026D110_Patatrack_PixelOnlyTripletsAlpaka/step3_TTbar_14TeV+2026D110_Patatrack_PixelOnlyTripletsAlpaka.log

Expand to see more relval errors ...

• 29634.496

[AdrianoDee]

+pdmv

[jfernan2]

+1

[antoniovagnerini]

backport of #45694

[vicha-w]

Hi @AdrianoDee,

This PR has been successfully tested on central DQM playback machines with CMSSW 14_0_15_patch1 and run 384377. For more details please have a look at DQM^2 mirror here: https://cmsweb.cern.ch/dqm/dqm-square/?run=518487&db=playback

Best regards,
Vichayanun

[antoniovagnerini]

+1

[AdrianoDee]

@cms-sw/upgrade-l2 gentle ping

[mmusich]

@cms-sw/upgrade-l2 @srimanob can you please sign this?
I suspect without it if we test the gpu matrix in 14.0.X the bot is expecting to run some workflows that don't exist, see e.g. here

[mmusich]

urgent

[cmsbuild]

REMINDER @rappoccio, @antoniovilela, @sextonkennedy, @mandrenguyen: This PR was tested with #46050, please check if they should be merged together

[srimanob]

+Upgrade

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_14_0_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_14_2_X is complete. This pull request will now be reviewed by the release team before it's merged. @antoniovilela, @rappoccio, @mandrenguyen, @sextonkennedy (and backports should be raised in the release meeting by the corresponding L2)

[mandrenguyen]

+1