(r14) NA62MonteCarlo < NA62

NA62 Web>NA62>NA62MonteCarlo (revision 14) (raw view)~~EditAttach~~

---++ NA62 Monte Carlo Simulations

<!--
__Access control:__
   * Set ALLOWTOPICCHANGE = Main.DanProtopopescu,Main.JanuszMartyniak,StuartPurdie
   * Set ALLOWTOPICRENAME = Main.DanProtopopescu,Main.JanuszMartyniak
-->

This wiki describes how to set up and distribute the NA62 Monte Carlo simulation code.

%TOC% 

---+++ Software 

   * Test tarball from Antonino Sergi: [[%ATTACHURL%/NA62MC.tar.zip][NA62MC.tar.zip]]
   * Job submission and output management system code components are held on and SVN repo at IC (access list: Dan, Janusz, Stuart). The files attached to this wiki are not the latest versions.

---+++ Code compilation

   * Versions:
      * v4 - Contains bug in the MC which Tonino spotted after giving us the tar ball
      * v5 - Installed by Janusz on May 10 (see table below)
   * Unpack tarball to !NA62MC
   * Fix libs path problems in GNUMakefile-s (Generator/ and Beam/)
   * Make changes to env.sh: source 'offline' environment; clear XAWLIBS variable
   * Rearrange paths (move system paths after NA62-specific paths)
   * Type 'make' and be patient

---+++ Code distribution

   * Create tarballs for geant4, root, X11 and sw ([[%ATTACHURL%/CreateTarballs.sh.txt][CreateTarballs.sh]])
   * Run special job (with an SGM Admin role) to wget and unpack these tarballs on sites ([[%ATTACHURL%/InstallSoftware.sh][InstallSoftware.sh]])
   * Run test job 

---+++ Job submission

   * Run parameters given in the [[%ATTACHURL%/StandardRun_template.mac.txt][StandardRun.mac]] file: run number, number of events, random seed, root output file name
   * Job environment parameters are set by sourcing the =na62jobenv.sh= script created by =InstallSoftware.sh=
   * The .mac is modified using =sed= on the worker node to modify paths to LAV matrix files, which are installed in the software area by =InstallSoftware.sh=
   * The actual [[%ATTACHURL%/jobscript.sh.txt][job script]] is attached (needs editing and streamlining)

<!--
Bulk job submission (first proposed option)
   1. Create N .mac files using the  [[%ATTACHURL%/StandardRun_template.mac.txt][template]]
   1. Create one [[%ATTACHURL%/ganga-script.txt][Ganga script]] including the list of N .mac files
   1. Run this script via Ganga
-->

---+++ Automated jobs scripts creator

There's now a suite of tools for submitting jobs either one-by-one or in bulk. Jobs submitted via this interface have the advantage that everything about the jobs (input and output files, scripts, run parameters and statistics) are archived for later reference.

<a href="http://ppewww.physics.gla.ac.uk/~protopop/apps/na62/" alt='iPhone webapp'><img style="float: right; width: 60px; height: 60px; padding-right: 50px" src="%ATTACHURLPATH%/na62-button-apple-small.png"></a>

   * Toolbox located at: http://ppewww.physics.gla.ac.uk/~protopop/na62/mc/tools/scripter.php
   * Submitted jobs list (with a !MySQL DB backend) is located [[http://ppewww.physics.gla.ac.uk/~protopop/na62/mc/tools/index.php&task=jobs][here]]
   * Jobs status [[http://ppewww.physics.gla.ac.uk/~protopop/apps/na62/][iPhone webapp]].
   * Production rounds: [[http://ppewww.physics.gla.ac.uk/~protopop/na62/mc/tools/index.php?task=production][listed here]].

The *script creator* interface lets the production manager (PM) set up the job parameters (both MC parameters and output options) and choose the number of 'runs' to launch. The *scripter* prints out in the browser a list of commands that the PM has to run on his grid UI in order to launch the job or production with _his credentials_. For individual jobs, the PM updates the DB by hand, for multiple runs, it is done via a wrapper script.  A cron job periodically updates the list of jobs and files in the DB.

---+++ Workflow

<img src="%ATTACHURLPATH%/NA62MC-org-chart.png" alt="NA62MC-org-chart.png" width='562' height='430' />

---+++ Site resources

This is a simple table to keep track of site resources (please update if changes occur):

 |   *Site*                  | *CPU* | *WMS Support* | *Storage* | *FTS Channel* | *NA62 S/W* |
 |  Glasgow              |  %Y%  |        %Y%          |                  |                         |       r170       |
 |  IC                        |   %Y%  |        %Y%         |     %Y%     |      %Y%           |       r170       |
 |  RAL                     |  %Y%  |        %Y%         |                  |                         |       r170       |
 |  UCL (Belgium)    |            |                          |                  |                         |                     |
 |  Liverpool             |            |                          |                  |                         |                     |

Note on s/w labelling: both a NA62 release number (e.g. r170) and a tarball version (e.g. v5) are used. They are kept track of in a dedicated DB table.

---+++ To do before next production round

   * Install new tarball once it's available from Tonino
   * Resolve CERN FTS channel problem [[https://ggus.eu/ws/ticket_info.php?ticket=83133][GGUS ticket #83133]]
   * Scale scripts for largers submissions 

To log problems encountered and solutions use this wiki:
   
   * [[TroubleshootingMC][Troubleshooting page]] 

---+++ Links
   * NA62 voms server: https://voms.gridpp.ac.uk:8443/voms/na62.vo.gridpp.ac.uk/
   * Info from https://www.gridpp.ac.uk/wiki/GridPP_approved_VOs:
<!-- verbatim
  SW_DIR=$VO_SW_DIR/na62
  DEFAULT_SE="$DPM_HOST"
  VOMS_SERVERS="vomss://voms.gridpp.ac.uk:8443/voms/na62.vo.gridpp.ac.uk"
  VOMSES='"na62.vo.gridpp.ac.uk" "voms.gridpp.ac.uk" "15501" "/C=UK/O=eScience/OU=Manchester/L=HEP/CN=voms.gridpp.ac.uk" "na62.vo.gridpp.ac.uk"'
  STORAGE_DIR=$DPM_BASE_PATH/na62.vo.gridpp.ac.uk
  VOMS_CA_DN="'/C=UK/O=eScienceCA/OU=Authority/CN=UK e-Science CA 2B'"
verbatim -->

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
txt	CreateTarballs.sh.txt	r1	manage	2.7 K	2012-05-10 - 14:23	DanProtopopescu	(not final!) This is run on the Software Manager's UI machine to create the software tarballs for distribution
sh	InstallSoftware.sh	r1	manage	1.2 K	2012-05-01 - 11:06	DanProtopopescu	Script to install NA62 MC software on a given site
png	JobSubmissionComponents.png	r1	manage	83.2 K	2012-05-01 - 13:37	DanProtopopescu	Job submission components diagram
png	NA62MC-org-chart.png	r3 r2 r1	manage	56.0 K	2012-06-15 - 14:03	DanProtopopescu	NA62 MC organisational chart
zip	NA62MC.tar.zip	r1	manage	16523.0 K	2012-04-05 - 10:07	DanProtopopescu	Test tarball from Antonino Sergi
txt	StandardRun_template.mac.txt	r1	manage	15.5 K	2012-05-01 - 10:36	DanProtopopescu	StandardRun.mac template
txt	ganga-script.txt	r2 r1	manage	0.6 K	2012-05-01 - 13:16	DanProtopopescu	Ganga script for multiple job submission: na62job.gpy
txt	jobscript.sh.txt	r1	manage	4.7 K	2012-05-01 - 11:22	DanProtopopescu	Job script

Topic revision: r14 - 2012-06-21 - DanProtopopescu

NA62