Skip to content

wiene/cvmfs

This branch is 3029 commits behind cvmfs/cvmfs:devel.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

22c4a63 · Jan 10, 2021
Dec 6, 2017
Sep 8, 2020
Dec 5, 2020
Jan 10, 2021
May 31, 2016
Dec 14, 2020
Jul 13, 2020
Dec 5, 2020
Dec 6, 2020
Sep 17, 2019
Jan 10, 2021
Jun 29, 2017
Jan 6, 2017
Feb 15, 2019
Oct 12, 2018
Sep 17, 2020
Oct 12, 2018
Nov 17, 2020
Jun 22, 2018
Dec 9, 2011
Feb 27, 2015
Jan 7, 2021
Feb 5, 2018
Jul 19, 2011
Oct 26, 2017
Mar 16, 2018
Jul 13, 2020
Feb 2, 2016
Sep 20, 2016
Sep 8, 2016
Sep 18, 2015
Nov 28, 2012
Jul 10, 2016
Jul 10, 2016
Feb 21, 2015
Dec 9, 2019

Repository files navigation

Build Status Documentation Status DOI

The CernVM-File System (CernVM-FS) provides a scalable, reliable and low- maintenance software distribution service. It was developed to assist High Energy Physics (HEP) collaborations to deploy software on the worldwide- distributed computing infrastructure used to run data processing applications. CernVM-FS is implemented as a POSIX read-only file system in user space (a FUSE module). Files and directories are hosted on standard web servers and mounted in the universal namespace /cvmfs. Internally, CernVM-FS uses content- addressable storage and Merkle trees in order to maintain file data and meta-data. CernVM-FS uses outgoing HTTP connections only, thereby it avoids most of the firewall issues of other network file systems. It transfers data and meta-data on demand and verifies data integrity by cryptographic hashes.

By means of aggressive caching and reduction of latency, CernVM-FS focuses specifically on the software use case. Software usually comprises many small files that are frequently opened and read as a whole. Furthermore, the software use case includes frequent look-ups for files in multiple directories when search paths are examined.

Content is published into /cvmfs by means of dedicated "release manager machines". The release manager machines provide a writeable CernVM-FS instance by means of a union file system (aufs or overlayfs) on top of the read-only client. When publishing, the CernVM-FS server tools process new and modified data from the union file system's writable branch and transform the data into the CernVM-FS storage format.

CernVM-FS is actively used by small and large scientific collaborations. In many cases, it replaces package managers and shared software areas on cluster file systems as means to distribute the software used to process experiment data.

Packages

No packages published

Languages

  • C++ 75.4%
  • Shell 10.3%
  • Perl 6.1%
  • CMake 2.3%
  • Go 1.9%
  • C 1.9%
  • Other 2.1%