Difference: NA62MonteCarlo (10 vs. 11)

Revision 112012-06-15 - DanProtopopescu

Line: 1 to 1
 
META TOPICPARENT name="NA62"

NA62 Monte Carlo Simulations

Line: 41 to 41
 
  • The .mac is modified using sed on the worker node to modify paths to LAV matrix files, which are installed in the software area by InstallSoftware.sh
  • The actual job script is attached (needs editing and streamlining)
Added:
>
>
<--
Bulk job submission (first proposed option) 
  1. Create N .mac files using the template
  2. Create one Ganga script including the list of N .mac files
  3. Run this script via Ganga
-->
 

Automated jobs scripts creator

Changed:
<
<
>
>
There's now a suite of tools for submitting jobs either one-by-one or in bulk. Jobs submitted via this interface have the advantage that everything about the jobs (input and output files, scripts, run parameters and statistics) are archived for later reference.
 
Changed:
<
<

Bulk job submission (job splitting)

>
>
 
Changed:
<
<
  1. Create N .mac files using the template
  2. Create one Ganga script including the list of N .mac files
  3. Run this script via Ganga
>
>
The script creator interface lets the production manager (PM) set up the job parameters (both MC parameters and output options) and choose the number of 'runs' to launch. The scripter prints out in the browser a list of commands that the PM has to run on his grid UI in order to launch the job or production with his credentials. For individual jobs, the PM updates the DB by hand, for multiple runs, it is done via a wrapper script. A cron job periodically updates the list of jobs and files in the DB.

Workflow

NA62MC-org-chart.png

 

Site resources

This is a simple table to keep track of site resources (please update if changes occur):

Site CPU WMS Support Storage FTS Channel NA62 S/W
Changed:
<
<
Glasgow DONE DONE     v5
IC DONE DONE   DONE v5
RAL          
>
>
Glasgow DONE DONE     r170
IC DONE DONE DONE DONE r170
RAL DONE DONE     r170
 
UCL (Belgium)          
Added:
>
>
Liverpool          

Note on s/w labelling: both a NA62 release number (e.g. r170) and a tarball version (e.g. v5) are used. They are kept track of in a dedicated DB table.

 

Problems encountered

Changed:
<
<
  • DPM does not work properly
>
>
<-- DPM does not work properly  -->
 
Added:
>
>

Links

<-- verbatim
  SW_DIR=$VO_SW_DIR/na62
  DEFAULT_SE="$DPM_HOST"
  VOMS_SERVERS="vomss://voms.gridpp.ac.uk:8443/voms/na62.vo.gridpp.ac.uk"
  VOMSES='"na62.vo.gridpp.ac.uk" "voms.gridpp.ac.uk" "15501" "/C=UK/O=eScience/OU=Manchester/L=HEP/CN=voms.gridpp.ac.uk" "na62.vo.gridpp.ac.uk"'
  STORAGE_DIR=$DPM_BASE_PATH/na62.vo.gridpp.ac.uk
  VOMS_CA_DN="'/C=UK/O=eScienceCA/OU=Authority/CN=UK e-Science CA 2B'"
verbatim -->
 
META FILEATTACHMENT attachment="NA62MC.tar.zip" attr="" comment="Test tarball from Antonino Sergi" date="1333620431" moveby="DanProtopopescu" movedto="Main.NA62MonteCarlo.NA62MC.tar.zip" movedwhen="1335804947" movefrom="Main.NA62.NA62MC.tar.zip" name="NA62MC.tar.zip" path="NA62MC.tar.zip" size="16919575" stream="NA62MC.tar.zip" tmpFilename="/usr/tmp/CGItemp30898" user="Main.DanProtopopescu" version="1"
META FILEATTACHMENT attachment="StandardRun_template.mac.txt" attr="" comment="StandardRun.mac template" date="1335868566" name="StandardRun_template.mac.txt" path="StandardRun_template.mac.txt" size="15837" stream="StandardRun_template.mac.txt" tmpFilename="/usr/tmp/CGItemp21850" user="Main.DanProtopopescu" version="1"
META FILEATTACHMENT attachment="InstallSoftware.sh" attr="" comment="Script to install NA62 MC software on a given site" date="1335870411" name="InstallSoftware.sh" path="InstallSoftware.sh" size="1267" stream="InstallSoftware.sh" tmpFilename="/usr/tmp/CGItemp21516" user="Main.DanProtopopescu" version="1"
Line: 74 to 98
 
META FILEATTACHMENT attachment="ganga-script.txt" attr="" comment="Ganga script for multiple job submission: na62job.gpy" date="1335878174" name="ganga-script.txt" path="na62job.gpy" size="621" stream="na62job.gpy" tmpFilename="/usr/tmp/CGItemp25104" user="Main.DanProtopopescu" version="2"
META FILEATTACHMENT attachment="JobSubmissionComponents.png" attr="" comment="Job submission components diagram" date="1335879460" name="JobSubmissionComponents.png" path="JobSubmissionComponents.png" size="85200" stream="JobSubmissionComponents.png" tmpFilename="/usr/tmp/CGItemp20928" user="DanProtopopescu" version="1"
META FILEATTACHMENT attachment="CreateTarballs.sh.txt" attr="" comment="(not final!) This is run on the Software Manager's UI machine to create the software tarballs for distribution" date="1336659806" name="CreateTarballs.sh.txt" path="CreateTarballs.sh.txt" size="2734" stream="CreateTarballs.sh.txt" tmpFilename="/usr/tmp/CGItemp24496" user="DanProtopopescu" version="1"
Added:
>
>
META FILEATTACHMENT attachment="NA62MC-org-chart.png" attr="" comment="NA62 MC organisational chart" date="1337183954" moveby="DanProtopopescu" movedto="NA62.NA62MonteCarlo.NA62MC-org-chart.png" movedwhen="1339761567" movefrom="NA62.NA62.NA62MC-org-chart.png" name="NA62MC-org-chart.png" path="NA62MC-org-chart.png" size="57317" stream="NA62MC-org-chart.png" tmpFilename="/usr/tmp/CGItemp18961" user="DanProtopopescu" version="1"
 
META TOPICMOVED by="DanProtopopescu" date="1335878717" from="Main.NA62MonteCarlo" to="NA62.NA62MonteCarlo"
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback