Grid Installations

• ILC Software Grid Installations overview: http://ilcsoft.desy.de/grid/ilcsoft_overview.html
• ILC Software Grid Installations - Talk by J. Engels (2011)

• LC Forum

. /afs/phas.gla.ac.uk/data/ilc/software/ilcsoft/v01-14/init_ilcsoft.sh
cd StandardConfig/current
Mokka -M ILD_o1_v05 -e ./particle.tbl bbudsc_3evt.steer
anajob bbudsc_3evt.slcio
Marlin bbudsc_3evt_stdreco.xml
dumpevent bbudsc_3evt_DST.slcio 2 

The visualisation bit did not work though.

See https://svnsrv.desy.de/viewvc/marlinreco/ILDConfig/trunk/StandardConfig/current/README?view=markup

new tag for mokka was mokka-08-00-03. All that was necessary to install it was

to change the version in:

/afs/phas.gla.ac.uk/data/ilc/software/tags/v01-14/releases/v01-14/release-versions.py

from Mokka_version = "mokka-08-00-02" to Mokka_version = "mokka-08-00-03"

and when you run:

./ilcsoft-install -p releases/v01-14/release-scratch.cfg -i

it automatically picks up the new version. Downloads it and builds it.

/afs/phas.gla.ac.uk/data/ilc/software

and downloaded:

• ilcsoft local installation temporarily at /data/atlas01/ILC/ilcsoft

/data/atlas01/ILC

tar xvfz ilctools-tags.tar.gz

/data/atlas01/ILC/tags

Preparing for build - separate packages to install

/data/atlas01/ILC

mkdir xerces-c

wget http://apache.mirror.rbftpnetworks.com//xerces/c/3/binaries/xerces-c-3.1.1-x86_64-linux-gcc-3.4.tar.gz

wget http://wwwasd.web.cern.ch/wwwasd/cernlib/download/2006b_x86_64-slc5-gcc41-opt/tar/cernlib.tar.gz
wget http://wwwasd.web.cern.ch/wwwasd/cernlib/download/2006b_x86_64-slc5-gcc41-opt/tar/include.tar.gz

Preparing release version file

/data/atlas01/ILC/v01-14/releases/v01-14/release-versions.py

ilcsoft_install_prefix = "/data/atlas01/ILC/ilcsoft/"

MySQL_path = "/usr/"
Java_path = "/usr/java/latest/"
CERNLIB_path = "/data/atlas01/ILC/2006b/"
XERCESC_ROOT_DIR = "/data/atlas01/ILC/xerces-c/xerces-c-3.1.1-x86_64-linux-gcc-3.4/"

Starting a full build for all packages

path_where_this_file_lives = "/data/atlas01/ILC/tags/v01-14/releases/v01-14"

./ilcsoft-install -p releases/v01-14/release-scratch.cfg -p (to check all is ok)
./ilcsoft-install -p releases/v01-14/release-scratch.cfg -I (to install)

/data/atlas01/ILC/ilcsoft/lcio/v02-01-02/CMakeLists.txt

#MESSAGE( STATUS "BUILD_F77_TESTJOBS = ${BUILD_F77_TESTJOBS}" )

# fortran examples
#OPTION( BUILD_F77_TESTJOBS "Set to ON to build LCIO F77 testjobs" OFF )
#IF( BUILD_F77_TESTJOBS )
# ADD_SUBDIRECTORY( ./src/f77 f77 )
#ENDIF()

cd /data/atlas01/ILC/ilcsoft/KalTest/v01-05/build

cd /data/atlas01/ILC/ilcsoft/KalDet/v01-09/build
source ../../../root/5.28.00f/bin/thisroot.sh
cmake -DILCUTIL_DIR=../../../ilcutil/ -DROOT_DIR=$ROOTSYS ..
make install

cd /data/atlas01/ILC/ilcsoft/LCFIPlus/v00-05/build
source ../../../root/5.28.00f/bin/thisroot.sh
cmake -DILCUTIL_DIR=../../../ilcutil/ -DROOT_DIR=$ROOTSYS ..
make install

cd /data/atlas01/ILC/ilcsoft/bbq/v00-01-02/build
source ../../../root/5.28.00f/bin/thisroot.sh
cmake -DILCUTIL_DIR=../../../ilcutil/ -DROOT_DIR=$ROOTSYS ..

Running a Marlin processor example in your home area

Preparing the home area

[tdoherty@ppepc144 ExampleDSTAnalysis]$ ls -lart
total 908
drwxr-xr-x 3 tdoherty grid 77 Aug 3 15:12 include
drwxr-xr-x 2 tdoherty grid 66 Aug 3 15:14 src
drwxr-xr-x 3 tdoherty grid 121 Aug 3 15:17 lib
drwxr-xr-x 5 tdoherty grid 4096 Aug 3 15:26 build

FIND_PACKAGE( ROOT REQUIRED )

FOREACH( pkg ROOT ) 
 IF( ${pkg}_FOUND )
  INCLUDE_DIRECTORIES( ${${pkg}_INCLUDE_DIRS} )
  ADD_DEFINITIONS( ${${pkg}_DEFINITIONS} )
 ENDIF()
ENDFOREACH()

cd build

cmake -C $ILCSOFT/ILCSoft.cmake ..

make install

export MARLIN_DLL=$PWD/lib/libExampleDSTAnalysis.so

• • ILC Software Framework - Frank Gaede's CHEP 2009 talk

Preparing for build - seperate packages to install

Starting a full build for all packages

Problems to expect and fix:

LCIO compilation problems

installation. I did this for all pacakages by changing:

ilcsoft.envcmake["INSTALL_DOC"]="ON" to ilcsoft.envcmake["INSTALL_DOC"]="OFF"

in /data/atlas01/ILC/v01-14/releases/v01-14/release-scratch.cfg

but it could be done at just a package level here:

/data/atlas01/ILC/ilcsoft/lcio/v02-01-02/CMakeLists.txt

(2) We don't want fortran examples - and they cause problems in compilation

anyway - so I commented out:

#MESSAGE( STATUS "BUILD_F77_TESTJOBS = ${BUILD_F77_TESTJOBS}" )

And:

# fortran examples

#OPTION( BUILD_F77_TESTJOBS "Set to ON to build LCIO F77 testjobs" OFF )

#IF( BUILD_F77_TESTJOBS )

# ADD_SUBDIRECTORY( ./src/f77 f77 )

#ENDIF()

again in: /data/atlas01/ILC/ilcsoft/lcio/v02-01-02/CMakeLists.txt

(3) I also turned off the optional root dict build for LCIO

ilcsoft.module("LCIO").envcmake['BUILD_ROOTDICT']='OFF'

in /data/atlas01/ILC/v01-14/releases/v01-14/release-scratch.cfg

Building Root Dict manually for certain packages

The Root Dict compilation does not work for some packages when

building using the main compilation script so it is necessary to do

the following:

KALTEST:

Comment out of /data/atlas01/ILC/tags/v01-14/releases/v01-14/release-scratch.cfg

cd /data/atlas01/ILC/ilcsoft/KalTest/v01-05/build

# set up root (installed with ilcsoft)

source ../../../root/5.28.00f/bin/thisroot.sh

cmake -DILCUTIL_DIR=../../../ilcutil/ -DROOT_DIR=$ROOTSYS ..

make install

When installed – can uncomment in release-scratch.cfg again.

KALDET:

Comment out of /data/atlas01/ILC/tags/v01-14/releases/v01-14/release-scratch.cfg

cd /data/atlas01/ILC/ilcsoft/KalDet/v01-09/build

source ../../../root/5.28.00f/bin/thisroot.sh

cmake -DILCUTIL_DIR=../../../ilcutil/ -DROOT_DIR=$ROOTSYS ..

make install

When installed – can uncomment in release-scratch.cfg

LCFIPlus:

Comment out of /data/atlas01/ILC/tags/v01-14/releases/v01-14/release-scratch.cfg

cd /data/atlas01/ILC/ilcsoft/LCFIPlus/v00-05/build

source ../../../root/5.28.00f/bin/thisroot.sh

cmake -DILCUTIL_DIR=../../../ilcutil/ -DROOT_DIR=$ROOTSYS ..

make install

When installed – can uncomment in release-scratch.cfg but make sure not to reinstall.

BBQ:

Comment out of /data/atlas01/ILC/tags/v01-14/releases/v01-14/release-scratch.cfg

cd /data/atlas01/ILC/ilcsoft/bbq/v00-01-02/build

source ../../../root/5.28.00f/bin/thisroot.sh

cmake -DILCUTIL_DIR=../../../ilcutil/ -DROOT_DIR=$ROOTSYS ..

When installed – can uncomment in release-scratch.cfg but make sure not to reinstall.

Installing a new tag for one package within ilcsoft suite

STILL TO BE COMPLETED: Mokka needs to be reinstalled because of problem:

http://forum.linearcollider.org/index.php?t=tree&th=780&goto=2237&rid=151&S=18debae024982841a2da6aff71fca849#msg_2237

Running a validation test for Mokka and Marlin installations

STILL TO BE COMPLETED: See https://svnsrv.desy.de/viewvc/marlinreco/ILDConfig/trunk/StandardConfig/current/README?view=markup

Running a Marlin processor example in your home area

Preparing the home area

In this example we are building and running a Marlin processor called ExampleDSTAnalysis

(1) Make the directory named as you wish - for example: /home/tdoherty/ILCWork/Marlin/ExampleDSTAnalysis

(2) In the ExampleDSTAnalysis directory create a build, src, include and lib directory - like:

[tdoherty@ppepc144 ExampleDSTAnalysis]$ ls -lart
total 908
drwxr-xr-x 3 tdoherty grid 77 Aug 3 15:12 include
drwxr-xr-x 2 tdoherty grid 66 Aug 3 15:14 src
drwxr-xr-x 3 tdoherty grid 121 Aug 3 15:17 lib
drwxr-xr-x 5 tdoherty grid 4096 Aug 3 15:26 build

(3) Place the source (ExampleDSTAnalysis.cc) code for your processor in the src directory and the header (ExampleDSTAnalysis.h) file in the include directory

(4) Copy the CMakeLists .txt file from the mymarlin example given with Marlin into the ExampleDSTAnalysis folder:

cp /data/atlas01/ILC/ilcsoft/Marlin/v01-03/examples/mymarlin/CMakeLists.txt .

(5) Open up this file and just change the name of the project from mymarlin to ExampleDSTAnalysis

From PROJECT(mymarlin) to PROJECT(ExampleDSTAnalysis )

(6) If your processor code requires ROOT then add:

FIND_PACKAGE( ROOT REQUIRED )

and

FOREACH( pkg ROOT )
IF( ${pkg}_FOUND )
INCLUDE_DIRECTORIES( ${${pkg}_INCLUDE_DIRS} )
ADD_DEFINITIONS( ${${pkg}_DEFINITIONS} )
ENDIF()
ENDFOREACH()

to CMakeLists.txt so that your c++ code can pull in ROOT header files.

Building the processor

(1) First set up the ilcsoft software by running this script

./data/atlas01/ILC/ilcsoft/init_ilcsoft.sh
(2) cd into the build directory of this processor in your home area

cd build

(3) Then:

cmake -C $ILCSOFT/ILCSoft.cmake ..

(4) And:

make install

This should create library: lib/libExampleDSTAnalysis.so

Loading the processor into Marlin

(1) Point to the .so file

export MARLIN_DLL=$PWD/lib/libExampleDSTAnalysis.so

(2) Create the steering file. This steering file is used to tell Marlin in what

order to run your processor with other standard processors. It is used

to set some global variables aswell as the input stdio file and the output file

name. You also need to point to the gear (geometry) file that was used to

create your input stdio file. Marlin automatically creates this file for you

but you must edit the input/output files at least. The global variables will

be taken from your c++ code. To create the file just do:

Marlin -x > mysteer.xml

(3) As mentioned you must edit the steering file to point to the input .stdio

and gear.xml file you are using for your analysis.

Running Marlin processor

Simply do:

Marlin mysteer.xml

Preparing for build

privileges are necessary. Java is already installed on our network. So it was necessary to install

xerces-c and Cernlib. I installed them in the:

/data/atlas01/ILC

directory. For xerces-c I did the following:

mkdir xerces-c

And in this directory I:

wget http://apache.mirror.rbftpnetworks.com//xerces/c/3/binaries/xerces-c-3.1.1-x86_64-linux-gcc-3.4.tar.gz

for 64 bit. And untarred.

For Cernlib I realised that the installation here (/usr/lib64/cernlib) did not have the inlcude

directories needed so I also went to /data/atlas01/ILC and created directory 2006b

and in this directory I downloaded:

wget http://wwwasd.web.cern.ch/wwwasd/cernlib/download/2006b_x86_64-slc5-gcc41-opt/tar/cernlib.tar.gz_

and

wget http://wwwasd.web.cern.ch/wwwasd/cernlib/download/2006b_x86_64-slc5-gcc41-opt/tar/include.tar.gz_

and untarred them.

Preparing release version file

First of all I created a directory where the ilcsoft software packages will actually be installed

into. This is called: /data/atlas01/ILC/ilcsoft

It is now necessary to point to the above installations (MySQL etc.) in the release file that comes with

the ilcsoft installer. To do this I went to file:

/data/atlas01/ILC/v01-14/releases/v01-14/release-versions.py

But I first tell this file where the ilcsoft install directory is by setting:

ilcsoft_install_prefix = "/data/atlas01/ILC/ilcsoft/"

I then added:

MySQL_path = "/usr/"

Java_path = "/usr/java/latest/"

CERNLIB_path = "/data/atlas01/ILC/2006b/"

XERCESC_ROOT_DIR = "/data/atlas01/ILC/xerces-c/xerces-c-3.1.1-x86_64-linux-gcc-3.4/"

to this file

Starting a full build for all packakges

The file at the centre of this build is called 'release-scratch.cfg' which can be found in

the same directory as the release-versions.py: /data/atlas01/ILC/v01-14/releases/v01-14/

This file has the list and order in which all packages must be installed. First of all it is

necessary to point to the release-version.py file from within this file:

path_where_this_file_lives = "/data/atlas01/ILC/tags/v01-14/releases/v01-14"

Then do:

./ilcsoft-install -p releases/v01-14/release-scratch.cfg –p (to check all is ok)

./ilcsoft-install -p releases/v01-14/release-scratch.cfg –I (to install)

More to come.........

Getting the latest version

tar xvfz ilctools-tags.tar.gz

I then went into the directory:

/data/atlas01/ILC/tags

and removed all other tags except for the latest v01-14.

(Using svn to check out this tag would have been a more sensible way - will do next time!)

• gaede_ildsoft_chep09.pdf: ILC Software Framework - Frank Gaede's CHEP 2009 talk

<-- img style="width: 222; float: right" alt="ild.gif" src="https://ppes8.physics.gla.ac.uk/twiki/pub/LinearCollider/WebHome/ild.gif" title="ild.gif" height="169" -->

went to:

https://svnsrv.desy.de/viewvc/ilctools/ilcinstall/tags/

and downloaded the tar file accessible here:

https://svnsrv.desy.de/viewvc/ilctools/ilcinstall/tags/?view=tar

into the temporary directory

/data/atlas01/ILC

Linear Collider activities in Glasgow

<-- img style="width: 222; float: right" alt="ild.gif" src="https://ppes8.physics.gla.ac.uk/twiki/pub/LinearCollider/WebHome/ild.gif" title="ild.gif" height="169" -->

Installation of ILC software at Glasgow

Two choices for

• VO membership via ilc link at http://grid.desy.de/certs/vos.html
• ilcsoft local installation temporarily at /data/atlas01/ILC/ilcsoft

• DatasetAccess

Datasets

• DatasetAccess

• • CLIC Conceptual Design Report: Physics and Detectors (Feb 2012)
  • ILD Letter of Intent (Feb 2010)

Linear Collider activities in Glasgow

Software

• ilcsoft local installation

Useful Links

• ILCSoft
• CERN LC Physics & Detectors Group
• LCD-WG Indico
• CLIC Detector Twiki
• Documents:
  • ILD Letter of Intent
  • CLIC Conceptual Design Report: Physics and Detectors

LinearCollider Web Utilities

• - advanced search

Welcome to the LinearCollider web

Available Information

• ...
• ...
• ...

LinearCollider Web Utilities