TWiki> NA62 Web>NA62MonteCarlo (revision 37)EditAttach

NA62 Monte Carlo Simulations

This wiki describes how to set up and distribute the NA62 Monte Carlo simulation code.

Software

  • Test tarball from Antonino Sergi: NA62MC.tgz
  • Job submission and output management system code components are held on and SVN repo at IC (access list: Dan, Janusz, Stuart). The files attached to this wiki are not the latest versions.

Code compilation

  • Versions:
    • v4 - Contains bug in the MC which Tonino spotted after giving us the tar ball
    • v5 - Installed by Janusz on May 10 (r170, see table below)
    • v6 - September 2012 version (r188)
    • v7 - r193 uses GEANT4 9.5p01, improves processing speed roughly by a factor of 5 wrt the previous version
  • Unpack tarball to NA62MC
  • Fix libs path problems in GNUMakefile-s (Generator/ and Beam/)
     cp ../NA62/backups/Beam.GNUmakefile Beam/GNUmakefile
     cp ../NA62/backups/Generator.GNUmakefile Generator/GNUmakefile 
  • Make changes to env.sh: source 'offline' environment, clear XAWLIBS variable, rearrange paths (move system paths after NA62-specific paths):
     export XAWLIBS=" "
  • Source the the environment file (source scripts/env.sh)
  • Type make and be patient

Code distribution

      tar -czvf NA62MC_v7.tgz NA62MC
      cd /afs/cern.ch
      tar -czvf ~/G4-libs.tgz sw/lcg/external/geant4/9.5.p01/x86_64-slc5-gcc43/lib
      tar -czvf ~/Qt-libs.tgz sw/lcg/external/qt/4.6.3p2/x86_64-slc5-gcc43-opt/lib
  • Run a special job (with an SGM Admin role) to wget and unpack these tarballs on sites (InstallSoftware.sh)
  • Run test job

Job submission

  • Run parameters given in the StandardRun.mac file: run number, number of events, random seed, root output file name
  • Job environment parameters are set by sourcing the na62jobenv.sh script created by InstallSoftware.sh
  • The .mac is modified using sed on the worker node to modify paths to LAV matrix files, which are installed in the software area by InstallSoftware.sh
  • The actual job script is attached (needs editing and streamlining)

Automated jobs scripts creator

There's now a suite of tools for submitting jobs either one-by-one or in bulk. Jobs submitted via this interface have the advantage that everything about the jobs (input and output files, scripts, run parameters and statistics) are archived for later reference.

The script creator interface lets the production manager (PM) set up the job parameters (both MC parameters and output options) and choose the number of 'runs' to launch. The scripter prints out in the browser a list of commands that the PM has to run on his grid UI in order to launch the job or production with his credentials. For individual jobs, the PM updates the DB by hand, for multiple runs, it is done via a wrapper script. A cron job periodically updates the list of jobs and files in the DB.

Site resources

This is a simple table to keep track of site resources (please update if changes occur):

Site CPU WMS Support Storage FTS Channel to RAL FTS Channel to CERN NA62 S/W
Glasgow DONE DONE DONE DONE DONE r188
IC DONE DONE DONE DONE DONE r188+r193
RAL DONE DONE DONE -- PEND r188+r193
Liverpool DONE DONE DONE DONE PEND  
Birmingham DONE DONE DONE DONE PEND r188+r193
UCL DONE DONE DONE      

Note on s/w labelling: both a NA62 release number (e.g. r170) and a tarball version (e.g. v5) are used. They are kept track of in a dedicated DB table. FTS channels might not be needed is FTS3 is used (latest wrapper scripts).

Site admins - persons to contact in case something goes wrong on one of the sites are:

  • Glasgow - Dan Protopopescu (dan.protopopeascu#glasgow.ac.uk), Stuart Purdie (stuart.purdie#glasgow.ac.uk)
  • IC - Janusz Martyniak (janusz.martyniak#imperial.ac.uk)
  • RAL - Andrew Lahiff (andrew.lahiff#stfc.ac.uk)
  • Liverpool - Stephen Jones (sjones#hep.ph.liv.ac.uk)
  • Birmingham - Mark Slater (mslater#cern.ch)
  • UCL - Sergey Podolsky (spodolsky#mail.ru), Pavel Demin (pavel.demin#uclouvain.be)
Please replace the #-s.

NA62-GridPP-Sites.png

Cron jobs

Cronjobs are employed to keep track of jobs and output files:
Cronjobs-small.png

To do before next production round

  • Install new tarball once it's available from Tonino (Dan & Janusz)
  • Open remaining FTS channels (Janusz)
  • DONE Move web UI to a dedicated monitoring webserver (Dan)
  • Set up a controller-side cron job to double-check the FTS transfers of job outputs to CERN (Janusz)

Troubleshooting

To log problems encountered (and solutions) use this wiki:

Links

Topic attachments
I Attachment History Action Size Date Who Comment
Texttxt CreateTarballs.sh.txt r1 manage 2.7 K 2012-05-10 - 14:23 DanProtopopescu (not final!) This is run on the Software Manager's UI machine to create the software tarballs for distribution
PNGpng Cronjobs-small.png r5 r4 r3 r2 r1 manage 127.7 K 2012-10-18 - 10:53 DanProtopopescu Cronjobs diagram
Unix shell scriptsh InstallSoftware.sh r1 manage 1.2 K 2012-05-01 - 11:06 DanProtopopescu Script to install NA62 MC software on a given site
PNGpng JobSubmissionComponents.png r1 manage 83.2 K 2012-05-01 - 13:37 DanProtopopescu Job submission components diagram
PNGpng NA62-GridPP-Sites.png r1 manage 88.3 K 2012-09-18 - 09:46 DanProtopopescu Sites Map (September 2012)
PNGpng NA62MC-org-chart.png r1 manage 56.4 K 2012-06-21 - 16:04 DanProtopopescu NA62 MC workflow
Texttxt StandardRun_template.mac.txt r1 manage 15.5 K 2012-05-01 - 10:36 DanProtopopescu StandardRun.mac template
Texttxt ganga-script.txt r2 r1 manage 0.6 K 2012-05-01 - 13:16 DanProtopopescu Ganga script for multiple job submission: na62job.gpy
Texttxt jobscript.sh.txt r1 manage 4.7 K 2012-05-01 - 11:22 DanProtopopescu Job script
Edit | Attach | Watch | Print version | History: r57 | r39 < r38 < r37 < r36 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r37 - 2012-10-22 - DanProtopopescu
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback