DatasetAccess < LinearCollider

LinearCollider Web>DatasetAccess (2015-09-09, AidanRobson) (raw view)

---++ Dataset access

%TOC%

LCD-WG datasets are accessed through Dirac, as explained in:

   * https://twiki.cern.ch/twiki/bin/view/CLIC/DiracUsage

---+++ Quick start

<verbatim>
source /afs/cern.ch/eng/clic/software/DIRAC/bashrc
dirac-proxy-init
</verbatim>

---+++ Registration

Before first use, register in ILC VO, and email grid certificate DN to ilcdirac-register@cern.ch asking to be added to ilcdirac.

Not clear whether special credentials are needed. If so: in ~/.glite/vomses add:

"ilc" "grid-voms.desy.de" "15110" "/C=DE/O=GermanGrid/OU=DESY/CN=host/grid-voms.desy.de" "ilc" "24"

---+++ File access

To see what's in there, do:
<verbatim>
dirac-dms-filecatalog-cli
ls /ilc/prod/clic/
</verbatim>

To get a file:
<verbatim>
dirac-dms-get-file /ilc/prod/clic/500gev/ZZ/ILD/DST/00000443/000/ZZ_dst_443_90.slcio
</verbatim>

There is a datasets directory on AFS in =/afs/phas.gla.ac.uk/data/ilc/datasets01/= and there is a simple script, =/afs/phas.gla.ac.uk/data/ilc/datasets01/get_clic_files.sh=, that one can use to download the files listed in the SignalDatasets1 wiki.

---+++ Data Catalogues

Online data catalogues:
   * ILD MC Production Database: https://ilcproddb.desy.de/admin/ild/gen/
   * Simulations DB: http://www-flc.desy.de/simulation/databasesimulation/

To understand the labelling of the dataset directories, the WHIZARD nomenclature might prove useful.

<img src="%ATTACHURLPATH%/Screen_Shot_2013-07-26_at_13.19.47.png" alt="Screen_Shot_2013-07-26_at_13.19.47.png" width='336' height='445' />

A useful list of available MC samples can be found here: https://twiki.cern.ch/twiki/bin/view/CLIC/MonteCarloSamplesForTheHiggsPaper

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
png	Screen_Shot_2013-07-26_at_13.19.47.png	r2 r1	manage	25.8 K	2013-07-26 - 12:34	DanProtopopescu	WHIZARD nomenclature used in the labeling of channels

Topic revision: r9 - 2015-09-09 - AidanRobson

LinearCollider