Skip to content

ico1036/ServiceWork

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

RECO monitoring and integration

  • Python modules that measure the details of CPU and Memory usages of new released CMS software

Capture


1. Generate events

  • Gen_tool/Gen.sh can setup working-directory: CMSSW_X_X_X
$ ./Gen.sh CMSSW_X_X_X
  • The directory includes cmdLog, igprof_cpu/porfile.sh , igprof_mem_step3/profile_v2.sh, igprof_mem_step4/profile_v2.sh, logs files
  • You can generate events of all datatier using cmdLog files

1.1 About cmdLog file

  • This is the sample of cmdLog file: http://jiwoong.web.cern.ch/jiwoong/results/phase2/cmdlog_CMSSW_11_1_0_pre3
  • 100 events are generated
  • I use multi threading only in step1 and step2 to save time
  • --customise=Validation/Performance/TimeMemoryInfo.py option can make time and memory information in logfiles ( step3.log, step4.log )
  • step3.log and step4.log are also used in analysis
  • --customise HLTrigger/Timer/FastTimer.customise_timer_service_singlejob option is needed for making Circle Piechart
  • Do not use the customise=Validation/Performance/TimeMemoryInfo.py with customise HLTrigger/Timer/FastTimer.customise_timer_service_singlejob simultaneously. This can occur interference.

2. Igprof

  • First, you should add the following lines to config file:
from Validation.Performance.IgProfInfo import customise
process = customise(process)

3. Analysis

  • Go to Analyze_tool directory

4. Circle pie-chart

  • Circle plot: Reference
  • First, add the following lines in cmdlog and re-run it
--customise HLTrigger/Timer/FastTimer.customise_timer_service_singlejob  
  • Add the following lines in config files:
# customisation of the process.
process.load( "HLTrigger.Timer.FastTimerService_cfi")
process.FastTimerService.writeJSONSummary = cms.untracked.bool(True)
process.FastTimerService.jsonFileName = cms.untracked.string('resources_RECO_11_2_0_pre11.json')  
  • Clone the Reference to your www directory in LXPLUS server
  • copy the OUTPUT_NAME.json to circles/web/data
  • Following html link can show the Piechart
  • Please do not use the ".json" in this link. Just write the name of Json file.
http://jiwoong.web.cern.ch/jiwoong/circles/web/piechart.html?local=false&dataset=OUTPUT_NAME&resource=time_real&colours=default&groups=reco_PhaseII&threshold=0  

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published