Difference: CVMFS (1 vs. 5)

Revision 52018-01-11 - GordonStewart

Line: 1 to 1

META TOPICPARENT	name="WebHome"

CVMFS

Line: 20 to 20

CVMFS at Glasgow

Changed:

<
< On PPE Linux machines, the CVMFS repositories can often be found mounted under /cvmfs. These repositories are read-only, but can otherwise be access like any other local directory:

>
> On PPE Linux machines, the CVMFS repositories can often be found mounted under /cvmfs. These repositories are read-only, but can otherwise be accessed like any other local directory:

$ ll /cvmfs

Revision 42016-04-25 - GordonStewart

  META TOPICPARENT 
 name="WebHome"
- META TOPICPARENT
+ name="WebHome"
-<
<
+ CVMFS
->
>
+ CVMFS
-<
<
+CVMFS is a network file system based on HTTP and optimized to deliver experiment software in a fast, scalable, and reliable way. It was originally developed as part of the CernVM project and has the following features:
->
>
+CVMFS (the CernVM File System) is a network file system, originally developed as part of the CernVM project as a way to deliver software in a fast, scalable and reliable manner.  It has been designed with the following features:
-<
<
+ Caching, Read-only
  Based on very standard technologies - outgoing http, fuse...
  Scales very easily with additional squid caches
  File checksums (currently SHA1) are verified against a trusted catalog obtained over HTTPS
  File based deduplication as a handy side effect of the signed file catalog
  Uses fuse to mount a virtual filesystem (based on a signed-catalog downloaded form the server)
  Performance is close to a locally installed sofwtare after initial cache population
  Jobs run faster than with either NFS or AFS
  Removes the need for local software install jobs at every site
->
>
+ Built from common, widely-supported technologies.
  Uses local caches for simple scaling.
  Performance is close to that of locally-installed software, often exceeding that of NFS or AFS.
-<
<
+(borrowed from the gridpp CVMFS page https://www.gridpp.ac.uk/wiki/RAL_Tier1_CVMFS, some instructions are on the page https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ATLASLocalRootBase)
->
>
+Providing software via CVMFS removes the need to install applications locally at every site, greatly simplifying the deployment process.  Software updates need to be applied once to the application instance in CVMFS, rather than being pushed out to multiple sites.
-<
<
+ CVMFS at Glasgow
->
>
+If you need to use software provided by experiments at CERN or elsewhere, or require access to standard libraries or dependencies, you are strongly recommended to check whether these exist in CVMFS; if they are, then using the CVMFS copy will likely be significantly easier than trying replicate the environment and build the software locally.
-<
<
+On the local batch and desktops the CVMFS repositories are mounted under the /cvmfs directory. Currently the ams.cern.ch, atlas.cern.ch, atlas-condb.cern.ch, atlas-nightlies.cern.ch, cms.cern.ch, geant4.cern.ch, lhcb.cern.ch, na61.cern.ch and sft.cern.ch are repositories are available.
->
>
+Further information about using CVMFS can be found here:
-<
<
+[~]$ ll /cvmfs
total 5
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 ams.cern.ch
drwxrwxr-x 1 cvmfs cvmfs    0 Mar  5  2012 atlas.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 atlas-condb.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 atlas-nightlies.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 cms.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 geant4.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 lhcb.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 na61.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 sft.cern.ch
->
>
+ https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ATLASLocalRootBase
  https://www.gridpp.ac.uk/wiki/A_quick_guide_to_CVMFS
->
>
+ CVMFS at Glasgow
->
>
+On PPE Linux machines, the CVMFS repositories can often be found mounted under /cvmfs.  These repositories are read-only, but can otherwise be access like any other local directory:
-<
<
+-- AndrewPickford - 2013-11-11
 \ No newline at end of file
->
>
+$ ll /cvmfs
total 0
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 ams.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 atlas.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 atlas-condb.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 atlas-nightlies.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 cms.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 geant4.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 grid.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 ilc.desy.de
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 lhcb.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 na61.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 na62.cern.ch
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 na62.egi.eu
dr-xr-xr-x. 2 root root 0 Apr 11 09:05 sft.cern.ch

Revision 32014-01-07 - AndrewPickford

Line: 1 to 1

META TOPICPARENT	name="WebHome"

CVMFS

Line: 14 to 14

Jobs run faster than with either NFS or AFS
Removes the need for local software install jobs at every site

Changed:

<
<

(borrowed from the gridpp CVMFS page https://www.gridpp.ac.uk/wiki/RAL_Tier1_CVMFS

)

>
>

(borrowed from the gridpp CVMFS page https://www.gridpp.ac.uk/wiki/RAL_Tier1_CVMFS

, some instructions are on the page https://twiki.atlas-canada.ca/bin/view/AtlasCanada/ATLASLocalRootBase

)

CVMFS at Glasgow

Revision 22013-11-11 - AndrewPickford

Line: 1 to 1

META TOPICPARENT	name="WebHome"

Changed:

<
<

CVMFS at Glasgow

>
>

CVMFS

CVMFS is a network file system based on HTTP and optimized to deliver experiment software in a fast, scalable, and reliable way. It was originally developed as part of the CernVM project and has the following features:

Line: 16 to 16

(borrowed from the gridpp CVMFS page https://www.gridpp.ac.uk/wiki/RAL_Tier1_CVMFS)

Changed:

<
<

CVMFS on batch and desktops

>
>

CVMFS at Glasgow

Changed:

<
< The CVMFS repositories are mounted under the /cvmfs directory. Currently the ams.cern.ch, atlas.cern.ch, atlas-condb.cern.ch, atlas-nightlies.cern.ch, cms.cern.ch, geant4.cern.ch, lhcb.cern.ch, na61.cern.ch and sft.cern.ch are repositories are available.

>
> On the local batch and desktops the CVMFS repositories are mounted under the /cvmfs directory. Currently the ams.cern.ch, atlas.cern.ch, atlas-condb.cern.ch, atlas-nightlies.cern.ch, cms.cern.ch, geant4.cern.ch, lhcb.cern.ch, na61.cern.ch and sft.cern.ch are repositories are available.

[~]$ ll /cvmfs

Revision 12013-11-11 - AndrewPickford

Line: 1 to 1

Added:

>
>

META TOPICPARENT	name="WebHome"

CVMFS at Glasgow

Caching, Read-only
Based on very standard technologies - outgoing http, fuse...
Scales very easily with additional squid caches
File checksums (currently SHA1) are verified against a trusted catalog obtained over HTTPS
File based deduplication as a handy side effect of the signed file catalog
Uses fuse to mount a virtual filesystem (based on a signed-catalog downloaded form the server)
Performance is close to a locally installed sofwtare after initial cache population
Jobs run faster than with either NFS or AFS
Removes the need for local software install jobs at every site

(borrowed from the gridpp CVMFS page https://www.gridpp.ac.uk/wiki/RAL_Tier1_CVMFS)

CVMFS on batch and desktops

The CVMFS repositories are mounted under the /cvmfs directory. Currently the ams.cern.ch, atlas.cern.ch, atlas-condb.cern.ch, atlas-nightlies.cern.ch, cms.cern.ch, geant4.cern.ch, lhcb.cern.ch, na61.cern.ch and sft.cern.ch are repositories are available.

[~]$ ll /cvmfs
total 5
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 ams.cern.ch
drwxrwxr-x 1 cvmfs cvmfs    0 Mar  5  2012 atlas.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 atlas-condb.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 atlas-nightlies.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 cms.cern.ch
drwxr-xr-x 2 cvmfs cvmfs    0 Nov  8 13:28 geant4.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 lhcb.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 na61.cern.ch
dr-xr-xr-x 2 root  root     0 Nov  8 13:28 sft.cern.ch






-- AndrewPickford - 2013-11-11

View topic | History: r5 < r4 < r3 < r2 | More topic actions...