Difference: CVMFS (1 vs. 5)

Revision 52018-01-11 - GordonStewart

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

CVMFS

Line: 20 to 20
 

CVMFS at Glasgow

Changed:
<
<
On PPE Linux machines, the CVMFS repositories can often be found mounted under /cvmfs. These repositories are read-only, but can otherwise be access like any other local directory:
>
>
On PPE Linux machines, the CVMFS repositories can often be found mounted under /cvmfs. These repositories are read-only, but can otherwise be accessed like any other local directory:
 
$ ll /cvmfs

Revision 42016-04-25 - GordonStewart

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Changed:
<
<

CVMFS

>
>

CVMFS

 
Changed:
<
<
CVMFS is a network file system based on HTTP and optimized to deliver experiment software in a fast, scalable, and reliable way. It was originally developed as part of the CernVM project and has the following features:
>
>
CVMFS (the CernVM File System) is a network file system, originally developed as part of the CernVM project as a way to deliver software in a fast, scalable and reliable manner. It has been designed with the following features:
 
Changed:
<
<
  • Caching, Read-only
  • Based on very standard technologies - outgoing http, fuse...
  • Scales very easily with additional squid caches
  • File checksums (currently SHA1) are verified against a trusted catalog obtained over HTTPS
  • File based deduplication as a handy side effect of the signed file catalog
  • Uses fuse to mount a virtual filesystem (based on a signed-catalog downloaded form the server)
  • Performance is close to a locally installed sofwtare after initial cache population
  • Jobs run faster than with either NFS or AFS
  • Removes the need for local software install jobs at every site
>
>
  • Built from common, widely-supported technologies.
  • Uses local caches for simple scaling.
  • Performance is close to that of locally-installed software, often exceeding that of NFS or AFS.
 
Changed:
<
<
(borrowed from the gridpp CVMFS page https://www.gridpp.ac.uk/wiki/RAL_Tier1_CVMFS, some instructions are on the page https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ATLASLocalRootBase)
>
>
Providing software via CVMFS removes the need to install applications locally at every site, greatly simplifying the deployment process. Software updates need to be applied once to the application instance in CVMFS, rather than being pushed out to multiple sites.
 
Changed:
<
<

CVMFS at Glasgow

>
>
If you need to use software provided by experiments at CERN or elsewhere, or require access to standard libraries or dependencies, you are strongly recommended to check whether these exist in CVMFS; if they are, then using the CVMFS copy will likely be significantly easier than trying replicate the environment and build the software locally.
 
Changed:
<
<
On the local batch and desktops the CVMFS repositories are mounted under the /cvmfs directory. Currently the ams.cern.ch, atlas.cern.ch, atlas-condb.cern.ch, atlas-nightlies.cern.ch, cms.cern.ch, geant4.cern.ch, lhcb.cern.ch, na61.cern.ch and sft.cern.ch are repositories are available.
>
>
Further information about using CVMFS can be found here:
 
Changed:
<
<
[~]$ ll /cvmfs
total 5
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 ams.cern.ch
drwxrwxr-x 1 cvmfs cvmfs    0 Mar  5  2012 atlas.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 atlas-condb.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 atlas-nightlies.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 cms.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 geant4.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 lhcb.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 na61.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 sft.cern.ch
>
>
 
Added:
>
>

CVMFS at Glasgow

 
Added:
>
>
On PPE Linux machines, the CVMFS repositories can often be found mounted under /cvmfs. These repositories are read-only, but can otherwise be access like any other local directory:
 
Deleted:
<
<
-- AndrewPickford - 2013-11-11
 \ No newline at end of file
Added:
>
>
$ ll /cvmfs
total 0
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 ams.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 atlas.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 atlas-condb.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 atlas-nightlies.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 cms.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 geant4.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 grid.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 ilc.desy.de
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 lhcb.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 na61.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 na62.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 na62.egi.eu
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 sft.cern.ch

Revision 32014-01-07 - AndrewPickford

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

CVMFS

Line: 14 to 14
 
  • Jobs run faster than with either NFS or AFS
  • Removes the need for local software install jobs at every site
Changed:
<
<
(borrowed from the gridpp CVMFS page https://www.gridpp.ac.uk/wiki/RAL_Tier1_CVMFS)
>
>
(borrowed from the gridpp CVMFS page https://www.gridpp.ac.uk/wiki/RAL_Tier1_CVMFS, some instructions are on the page https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ATLASLocalRootBase)
 

CVMFS at Glasgow

Revision 22013-11-11 - AndrewPickford

Line: 1 to 1
 
META TOPICPARENT name="WebHome"
Changed:
<
<

CVMFS at Glasgow

>
>

CVMFS

  CVMFS is a network file system based on HTTP and optimized to deliver experiment software in a fast, scalable, and reliable way. It was originally developed as part of the CernVM project and has the following features:
Line: 16 to 16
  (borrowed from the gridpp CVMFS page https://www.gridpp.ac.uk/wiki/RAL_Tier1_CVMFS)
Changed:
<
<

CVMFS on batch and desktops

>
>

CVMFS at Glasgow

 
Changed:
<
<
The CVMFS repositories are mounted under the /cvmfs directory. Currently the ams.cern.ch, atlas.cern.ch, atlas-condb.cern.ch, atlas-nightlies.cern.ch, cms.cern.ch, geant4.cern.ch, lhcb.cern.ch, na61.cern.ch and sft.cern.ch are repositories are available.
>
>
On the local batch and desktops the CVMFS repositories are mounted under the /cvmfs directory. Currently the ams.cern.ch, atlas.cern.ch, atlas-condb.cern.ch, atlas-nightlies.cern.ch, cms.cern.ch, geant4.cern.ch, lhcb.cern.ch, na61.cern.ch and sft.cern.ch are repositories are available.
 
[~]$ ll /cvmfs

Revision 12013-11-11 - AndrewPickford

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="WebHome"

CVMFS at Glasgow

CVMFS is a network file system based on HTTP and optimized to deliver experiment software in a fast, scalable, and reliable way. It was originally developed as part of the CernVM project and has the following features:

  • Caching, Read-only
  • Based on very standard technologies - outgoing http, fuse...
  • Scales very easily with additional squid caches
  • File checksums (currently SHA1) are verified against a trusted catalog obtained over HTTPS
  • File based deduplication as a handy side effect of the signed file catalog
  • Uses fuse to mount a virtual filesystem (based on a signed-catalog downloaded form the server)
  • Performance is close to a locally installed sofwtare after initial cache population
  • Jobs run faster than with either NFS or AFS
  • Removes the need for local software install jobs at every site

(borrowed from the gridpp CVMFS page https://www.gridpp.ac.uk/wiki/RAL_Tier1_CVMFS)

CVMFS on batch and desktops

The CVMFS repositories are mounted under the /cvmfs directory. Currently the ams.cern.ch, atlas.cern.ch, atlas-condb.cern.ch, atlas-nightlies.cern.ch, cms.cern.ch, geant4.cern.ch, lhcb.cern.ch, na61.cern.ch and sft.cern.ch are repositories are available.

[~]$ ll /cvmfs
total 5
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 ams.cern.ch
drwxrwxr-x 1 cvmfs cvmfs    0 Mar  5  2012 atlas.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 atlas-condb.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 atlas-nightlies.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 cms.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 geant4.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 lhcb.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 na61.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 sft.cern.ch

-- AndrewPickford - 2013-11-11

 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback