Difference: NA62MonteCarlo (56 vs. 57)

Revision 572016-03-11 - DanProtopopescu

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

NA62 Monte Carlo Simulations

<--
Access control:  
-->

This wiki describes how to set up and distribute the NA62 Monte Carlo simulation code.

Software

Changed:
<
<
  • Test tarball from Antonino Sergi: NA62MC.tgz or follow this howto
  • Obtain release number and read about modifications in NA62MC/HISTORY

Job submission and output management system code components are held on the na62.gla.ac.uk server. The files attached to this wiki are not the latest versions.

>
>
Source or precompiled production version provided by Antonino Sergi. Job submission and output management system code components are held on the na62.gla.ac.uk server.
 

Installation from scratch on a SL6 desktop

This was done for testing purposes and is documented in a separate wiki, NA62onSL6.

Deleted:
<
<

Code compilation

  • Versions:
    • v4 - Contains bug in the MC which Tonino spotted after giving us the tar ball
    • v5 - Installed by Janusz on May 10 (r170, see table below)
    • v6 - September 2012 version (r188)
    • v7 - r193: uses GEANT4 9.5p01, improves processing speed roughly by a factor of 5 wrt the previous version
    • v8 - r244: installed directly or via CVMFS (see table below)
    • v9 - r261: fatal bug in 4-lepton decay generator fixed, memory leak fixed, points to geant4 9.5.p02
  • Unpack tarball to NA62MC
  • Fix libs path problems in GNUMakefile-s (Generator/ and Beam/)
     cp ../NA62/backups/Beam.GNUmakefile Beam/GNUmakefile
     cp ../NA62/backups/Generator.GNUmakefile Generator/GNUmakefile 
  • Make changes to env.sh: source 'offline' environment, clear XAWLIBS variable, rearrange paths (move system paths after NA62-specific paths):
     export XAWLIBS=" "
  • Source the the environment file (source scripts/env.sh)
  • Type make and be patient
 

Code distribution

Deleted:
<
<
      tar -czvf NA62MC_v7.tgz NA62MC
      cd /afs/cern.ch
      tar -czvf ~/G4-libs.tgz sw/lcg/external/geant4/9.5.p01/x86_64-slc5-gcc43/lib
      tar -czvf ~/Qt-libs.tgz sw/lcg/external/qt/4.6.3p2/x86_64-slc5-gcc43-opt/lib
      tar -czvf ~/Boost_libs.tgz sw/lcg/external/Boost/1.48.0_python2.6/x86_64-slc5-gcc43-opt/lib
  • Add the G4EMLOW6.23.tgz tarball
      [protopop@ppepc102 gridsw]$ ls v8/
      Boost_libs_v8.tgz  G4EMLOW6.23.tgz  G4_libs_v8.tgz  NA62MC_v8.tgz  Qt_libs_v8.tgz  sqlite_v8.tgz
  • Run a special job (with an SGM Admin role) to wget and unpack these tarballs on sites (InstallSoftware.sh)
  • Run test job

CVMFS

 CVMFS is used for software distribution to sites. A guide is provided here: https://www.gridpp.ac.uk/wiki/RALnonLHCCVMFS

Scripts preparation

The following files need to be checked and updated for each new s/w release:

  • Job wrapper script - update version number
  • .mac file - check for new settings, new decay types etc.
  • input_files.tgz - check if any new files need to be included in this archive
Deleted:
<
<
Read the HISTORY file to find out what changes might have appeared.
 

Job submission

Changed:
<
<
  • Run parameters given in the StandardRun.mac file: run number, number of events, random seed, root output file name
  • Job environment parameters are set by sourcing the na62jobenv.sh script created by InstallSoftware.sh
  • The .mac is modified using sed on the worker node to modify paths to LAV matrix files, which are installed in the software area by InstallSoftware.sh
  • The actual job script is attached (needs editing and streamlining)

<--
Bulk job submission (first proposed option) 
  1. Create N .mac files using the template
  2. Create one Ganga script including the list of N .mac files
  3. Run this script via Ganga
-->
>
>
Job submission is fully automated via https://na62.gla.ac.uk/
 

Automated jobs scripts creator

There's now a suite of tools for submitting jobs either one-by-one or in bulk. Jobs submitted via this interface have the advantage that everything about the jobs (input and output files, scripts, run parameters and statistics) are archived for later reference.

Changed:
<
<
>
>
 
Changed:
<
<
>
>
  The script creator interface lets the production manager (PM) set up the job parameters (both MC parameters and output options) and choose the number of 'runs' to launch. The scripter prints out in the browser a list of commands that the PM has to run on his grid UI in order to launch the job or production with his credentials. For individual jobs, the PM updates the DB by hand, for multiple runs, it is done via a wrapper script. A cron job periodically updates the list of jobs and files in the DB.

Ganga

Mark Slater set up a Ganga service (http://ganga.web.cern.ch/ganga/) for managing entire production rounds. The Ganga request form is accessed via a link on the Production table. Once the request is submitted, a Ganga daemon from the Grid UI machine picks it up (within 10 minutes) and will submit and monitor jobs until the events target is reached.

How the Ganga service was set up and interacts with the other bot components is described in here: GangaService4NA62

Site resources

This is a simple table to keep track of site resources (please update if changes occur):
Changed:
<
<
Site CPU WMS Support Storage CVMFS NA62 S/W
Glasgow DONE DONE DONE DONE r261
IC DONE DONE DONE DONE r261
RAL DONE DONE DONE DONE r261
Liverpool DONE DONE DONE DONE r261
Birmingham DONE DONE DONE DONE r261
UCL DONE DONE DONE - r261
>
>
Site CPU Dirac Support Storage CVMFS
Glasgow DONE DONE DONE DONE
IC DONE DONE DONE DONE
RAL DONE DONE DONE DONE
Liverpool DONE DONE DONE DONE
Birmingham DONE DONE DONE DONE
UCL DONE DONE DONE DONE
CNAF DONE DONE DONE DONE
 
Changed:
<
<
Note on s/w labelling: both a NA62 release number (e.g. r261) and a tarball version (e.g. v9) are used.
>
>
Note on s/w labelling: both a NA62 release/version number (e.g. r261/v0.9.0) and a tarball version (e.g. v14) are used.
 They are kept track of in a dedicated DB table. FTS channels might not be needed is FTS3 is used (latest wrapper scripts).

Site admins - persons to contact in case something goes wrong on one of the sites are:

Changed:
<
<
  • Glasgow - Dan Protopopescu (dan.protopopeascu#glasgow.ac.uk), Stuart Purdie (stuart.purdie#glasgow.ac.uk)
>
>
  • Glasgow - Dan Protopopescu (dan.protopopeascu#glasgow.ac.uk)
 
  • IC - Janusz Martyniak (janusz.martyniak#imperial.ac.uk)
  • RAL - Andrew Lahiff (andrew.lahiff#stfc.ac.uk)
  • Liverpool - Stephen Jones (sjones#hep.ph.liv.ac.uk)
  • Birmingham - Mark Slater (mslater#cern.ch)
  • UCL - Sergey Podolsky (spodolsky#mail.ru), Pavel Demin (pavel.demin#uclouvain.be)
Added:
>
>
  • CNAF - Daniele Cesini (daniele.cesini#cnaf.infn.it)
 Please replace the #-s.

Changed:
<
<
NA62-GridPP-Sites.png
>
>
NA62-GridPP-Sites.png
 

Cron jobs

Cronjobs are employed to keep track of jobs and output files:
Cronjobs-small.png

Troubleshooting

To log problems encountered (and solutions) use this wiki:

Links

<-- verbatim
  SW_DIR=$VO_SW_DIR/na62
  DEFAULT_SE="$DPM_HOST"
  VOMS_SERVERS="vomss://voms.gridpp.ac.uk:8443/voms/na62.vo.gridpp.ac.uk"
  VOMSES='"na62.vo.gridpp.ac.uk" "voms.gridpp.ac.uk" "15501" "/C=UK/O=eScience/OU=Manchester/L=HEP/CN=voms.gridpp.ac.uk" "na62.vo.gridpp.ac.uk"'
  STORAGE_DIR=$DPM_BASE_PATH/na62.vo.gridpp.ac.uk
  VOMS_CA_DN="'/C=UK/O=eScienceCA/OU=Authority/CN=UK e-Science CA 2B'"
verbatim -->

META FILEATTACHMENT attachment="StandardRun_template.mac.txt" attr="" comment="StandardRun.mac template" date="1335868566" name="StandardRun_template.mac.txt" path="StandardRun_template.mac.txt" size="15837" stream="StandardRun_template.mac.txt" tmpFilename="/usr/tmp/CGItemp21850" user="Main.DanProtopopescu" version="1"
META FILEATTACHMENT attachment="InstallSoftware.sh" attr="" comment="Script to install NA62 MC software on a given site" date="1335870411" name="InstallSoftware.sh" path="InstallSoftware.sh" size="1267" stream="InstallSoftware.sh" tmpFilename="/usr/tmp/CGItemp21516" user="Main.DanProtopopescu" version="1"
META FILEATTACHMENT attachment="jobscript.sh.txt" attr="" comment="Job script" date="1335871339" name="jobscript.sh.txt" path="jobscript.sh.txt" size="4799" stream="jobscript.sh.txt" tmpFilename="/usr/tmp/CGItemp21726" user="Main.DanProtopopescu" version="1"
META FILEATTACHMENT attachment="ganga-script.txt" attr="" comment="Ganga script for multiple job submission: na62job.gpy" date="1335878174" name="ganga-script.txt" path="na62job.gpy" size="621" stream="na62job.gpy" tmpFilename="/usr/tmp/CGItemp25104" user="Main.DanProtopopescu" version="2"
META FILEATTACHMENT attachment="JobSubmissionComponents.png" attr="" comment="Job submission components diagram" date="1335879460" name="JobSubmissionComponents.png" path="JobSubmissionComponents.png" size="85200" stream="JobSubmissionComponents.png" tmpFilename="/usr/tmp/CGItemp20928" user="DanProtopopescu" version="1"
META FILEATTACHMENT attachment="CreateTarballs.sh.txt" attr="" comment="(not final!) This is run on the Software Manager's UI machine to create the software tarballs for distribution" date="1336659806" name="CreateTarballs.sh.txt" path="CreateTarballs.sh.txt" size="2734" stream="CreateTarballs.sh.txt" tmpFilename="/usr/tmp/CGItemp24496" user="DanProtopopescu" version="1"
META FILEATTACHMENT attachment="na62-button-apple-small.png" attr="h" comment="iPhone webapp button" date="1339769065" name="na62-button-apple-small.png" path="na62-button-apple-small.png" size="10818" stream="na62-button-apple-small.png" tmpFilename="/usr/tmp/CGItemp46125" user="DanProtopopescu" version="3"
META FILEATTACHMENT attachment="NA62MC-org-chart.png" attr="" comment="NA62 MC workflow" date="1340294677" name="NA62MC-org-chart.png" path="NA62MC-org-chart.png" size="57752" stream="NA62MC-org-chart.png" tmpFilename="/usr/tmp/CGItemp23581" user="DanProtopopescu" version="1"
Changed:
<
<
META FILEATTACHMENT attachment="NA62-GridPP-Sites.png" attr="" comment="Sites Map (September 2012)" date="1347961595" name="NA62-GridPP-Sites.png" path="NA62-GridPP-Sites.png" size="90381" stream="NA62-GridPP-Sites.png" tmpFilename="/usr/tmp/CGItemp21810" user="DanProtopopescu" version="1"
>
>
META FILEATTACHMENT attachment="NA62-GridPP-Sites.png" attr="" comment="Sites Map (March 2016)" date="1457693850" name="NA62-GridPP-Sites.png" path="NA62-GridPP-Sites.png" size="162689" user="DanProtopopescu" version="2"
 
META FILEATTACHMENT attachment="Cronjobs-small.png" attr="" comment="Cronjobs diagram" date="1360934943" name="Cronjobs-small.png" path="Cronjobs-robots-small.png" size="153549" stream="Cronjobs-robots-small.png" tmpFilename="/usr/tmp/CGItemp30372" user="DanProtopopescu" version="6"
META TOPICMOVED by="DanProtopopescu" date="1335878717" from="Main.NA62MonteCarlo" to="NA62.NA62MonteCarlo"
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback