From DaqWiki
Jump to navigation Jump to search

The Experimental Data Storage is a facility dedicated to store large amount of data produced by TRIUMF experimental groups. This system is based on the DCache software (Desy and FermiLab) and consists uniquely of storage. No CPU power is available. To the users, only the main server machine TRDATA00 is visible. The files are stored on one or several disk server machines. The system is easily expendable. To obtain disk space on this system, please contact Pierre Amaudruz or Thomas Lindner ( The disk servers are running RAID 6 software but the files are not backed up to another system. The users should not count on this facility as a permanent archive at this point. Currently the system has ~125 TB available.

We are currently migrating the dcache system from an older version to a new version on a new computer. The following is useful information for the transition period:

  • the new system is already up and running. You can see the new dcache interface here:

  • Files from the old dcache system have been all copied to the new system (except for pienu files, for which special arrangements are being made).
  • You can copy file from the new system with either the dccp command:

dccp dcap:// .

or the globus-url-copy grid command (assuming you have grid tools installed and a valid, registered grid certificate):

globus-url-copy -p 5 -vb gsi file:///home/lindner/run00750.mid.gz

  • Installing dccp itself is pretty easy. To install from a standard SL5/6 desktop you can just use the version of dccp that you get from EPEL; ie, just do
yum install dcap

Installing globus-url-copy is more complicated and involved. Contact Thomas Lindner for more information.

  • (For sys-admins only): from TRIUMF computers you can also mount the dcache system by doing following:
   mkdir -p /pnfs
   edit /etc/rc.local, add to the end of file: "mount -o intr,rw,noac,hard,nfsvers=3 trdata00:/pnfs /pnfs"
   . /etc/rc.local 
  • After March 4th, the new system was eenamed as trdata00 and the old system became unavailable.

There is administrative details TRDATA admin

You can also access the original documentation for the old trdata setup.