Difference: NA62MonteCarlo (10 vs. 11)

Revision 112012-06-15 - DanProtopopescu

Line: 1 to 1

META TOPICPARENT	name="NA62"

NA62 Monte Carlo Simulations

Line: 41 to 41

The .mac is modified using sed on the worker node to modify paths to LAV matrix files, which are installed in the software area by InstallSoftware.sh
The actual job script is attached (needs editing and streamlining)

Added:

>
>

<--
Bulk job submission (first proposed option) 
 Create N .mac files using the  template
  Create one Ganga script including the list of N .mac files
  Run this script via Ganga
 
-->

Automated jobs scripts creator

Changed:

<
<

Toolbox located at: http://ppewww.physics.gla.ac.uk/~protopop/na62/mc/tools/
Submitted jobs list (with a MySQL DB backend) is located here

>
> There's now a suite of tools for submitting jobs either one-by-one or in bulk. Jobs submitted via this interface have the advantage that everything about the jobs (input and output files, scripts, run parameters and statistics) are archived for later reference.

Changed:

<
<

Bulk job submission (job splitting)

>
>

Toolbox located at: http://ppewww.physics.gla.ac.uk/~protopop/na62/mc/tools/scripter.php
Submitted jobs list (with a MySQL DB backend) is located here

Changed:

<
<

Create N .mac files using the template
Create one Ganga script including the list of N .mac files
Run this script via Ganga

>
>

The script creator interface lets the production manager (PM) set up the job parameters (both MC parameters and output options) and choose the number of 'runs' to launch. The scripter prints out in the browser a list of commands that the PM has to run on his grid UI in order to launch the job or production with his credentials. For individual jobs, the PM updates the DB by hand, for multiple runs, it is done via a wrapper script. A cron job periodically updates the list of jobs and files in the DB.

Workflow

Site resources

This is a simple table to keep track of site resources (please update if changes occur):

Site	CPU	WMS Support	Storage	FTS Channel	NA62 S/W

Changed:

<
<

Glasgow					v5
IC					v5
RAL

>
>

Glasgow					r170
IC					r170
RAL					r170

UCL (Belgium)

Added:

>
>

Liverpool

Note on s/w labelling: both a NA62 release number (e.g. r170) and a tarball version (e.g. v5) are used. They are kept track of in a dedicated DB table.

Problems encountered

Changed:

<
<

DPM does not work properly

>
>

<-- DPM does not work properly  -->

Troubleshooting page

Added:

>
>

Links

NA62 voms server: https://voms.gridpp.ac.uk:8443/voms/na62.vo.gridpp.ac.uk/
Info from https://www.gridpp.ac.uk/wiki/GridPP_approved_VOs:

<-- verbatim
  SW_DIR=$VO_SW_DIR/na62
  DEFAULT_SE="$DPM_HOST"
  VOMS_SERVERS="vomss://voms.gridpp.ac.uk:8443/voms/na62.vo.gridpp.ac.uk"
  VOMSES='"na62.vo.gridpp.ac.uk" "voms.gridpp.ac.uk" "15501" "/C=UK/O=eScience/OU=Manchester/L=HEP/CN=voms.gridpp.ac.uk" "na62.vo.gridpp.ac.uk"'
  STORAGE_DIR=$DPM_BASE_PATH/na62.vo.gridpp.ac.uk
  VOMS_CA_DN="'/C=UK/O=eScienceCA/OU=Authority/CN=UK e-Science CA 2B'"
verbatim -->

META FILEATTACHMENT	attachment="NA62MC.tar.zip" attr="" comment="Test tarball from Antonino Sergi" date="1333620431" moveby="DanProtopopescu" movedto="Main.NA62MonteCarlo.NA62MC.tar.zip" movedwhen="1335804947" movefrom="Main.NA62.NA62MC.tar.zip" name="NA62MC.tar.zip" path="NA62MC.tar.zip" size="16919575" stream="NA62MC.tar.zip" tmpFilename="/usr/tmp/CGItemp30898" user="Main.DanProtopopescu" version="1"
META FILEATTACHMENT	attachment="StandardRun_template.mac.txt" attr="" comment="StandardRun.mac template" date="1335868566" name="StandardRun_template.mac.txt" path="StandardRun_template.mac.txt" size="15837" stream="StandardRun_template.mac.txt" tmpFilename="/usr/tmp/CGItemp21850" user="Main.DanProtopopescu" version="1"
META FILEATTACHMENT	attachment="InstallSoftware.sh" attr="" comment="Script to install NA62 MC software on a given site" date="1335870411" name="InstallSoftware.sh" path="InstallSoftware.sh" size="1267" stream="InstallSoftware.sh" tmpFilename="/usr/tmp/CGItemp21516" user="Main.DanProtopopescu" version="1"

Line: 74 to 98

META FILEATTACHMENT	attachment="ganga-script.txt" attr="" comment="Ganga script for multiple job submission: na62job.gpy" date="1335878174" name="ganga-script.txt" path="na62job.gpy" size="621" stream="na62job.gpy" tmpFilename="/usr/tmp/CGItemp25104" user="Main.DanProtopopescu" version="2"
META FILEATTACHMENT	attachment="JobSubmissionComponents.png" attr="" comment="Job submission components diagram" date="1335879460" name="JobSubmissionComponents.png" path="JobSubmissionComponents.png" size="85200" stream="JobSubmissionComponents.png" tmpFilename="/usr/tmp/CGItemp20928" user="DanProtopopescu" version="1"
META FILEATTACHMENT	attachment="CreateTarballs.sh.txt" attr="" comment="(not final!) This is run on the Software Manager's UI machine to create the software tarballs for distribution" date="1336659806" name="CreateTarballs.sh.txt" path="CreateTarballs.sh.txt" size="2734" stream="CreateTarballs.sh.txt" tmpFilename="/usr/tmp/CGItemp24496" user="DanProtopopescu" version="1"

Added:

>
>

META FILEATTACHMENT

attachment="NA62MC-org-chart.png" attr="" comment="NA62 MC organisational chart" date="1337183954" moveby="DanProtopopescu" movedto="NA62.NA62MonteCarlo.NA62MC-org-chart.png" movedwhen="1339761567" movefrom="NA62.NA62.NA62MC-org-chart.png" name="NA62MC-org-chart.png" path="NA62MC-org-chart.png" size="57317" stream="NA62MC-org-chart.png" tmpFilename="/usr/tmp/CGItemp18961" user="DanProtopopescu" version="1"

META TOPICMOVED	by="DanProtopopescu" date="1335878717" from="Main.NA62MonteCarlo" to="NA62.NA62MonteCarlo"

View topic | History: r57 < r56 < r55 < r54 | More topic actions...