TrdataDcache: Difference between revisions
No edit summary |
m (16 revisions imported) |
||
| (13 intermediate revisions by one other user not shown) | |||
| Line 1: | Line 1: | ||
The Experimental Data Storage is a facility dedicated to store large amount of data produced by TRIUMF experimental groups. This system is based on the DCache software (Desy and FermiLab) and consists uniquely of storage. No CPU power is available. To the users, only the main server machine TRDATA00 is visible. The files are stored on one or several disk server machines. The system is easily expendable. To obtain disk space on this system, please contact Pierre Amaudruz or Thomas Lindner. The disk servers are running RAID 6 software but the files are not backed up to another system. The users should not count on this facility as a permanent archive at this point. Currently the system has ~125 TB available. | The Experimental Data Storage is a facility dedicated to store large amount of data produced by TRIUMF experimental groups. This system is based on the DCache software (Desy and FermiLab) and consists uniquely of storage. No CPU power is available. To the users, only the main server machine TRDATA00 is visible. The files are stored on one or several disk server machines. The system is easily expendable. To obtain disk space on this system, please contact Pierre Amaudruz or Thomas Lindner (lindner@triumf.ca). The disk servers are running RAID 6 software but the files are not backed up to another system. The users should not count on this facility as a permanent archive at this point. Currently the system has ~125 TB available. | ||
We are currently migrating the dcache system from an older version to a new version on a new computer. The following is useful information for the transition period: | We are currently migrating the dcache system from an older version to a new version on a new computer. The following is useful information for the transition period: | ||
| Line 5: | Line 5: | ||
* the new system is already up and running. You can see the new dcache interface here: | * the new system is already up and running. You can see the new dcache interface here: | ||
http:// | http://trdata00.triumf.ca:2288 | ||
* Files from the old dcache system have been all copied to the new system (except for pienu files, for which special arrangements are being made). | * Files from the old dcache system have been all copied to the new system (except for pienu files, for which special arrangements are being made). | ||
| Line 11: | Line 11: | ||
* You can copy file from the new system with either the dccp command: | * You can copy file from the new system with either the dccp command: | ||
dccp dcap:// | '''dccp dcap://trdata00.triumf.ca/pnfs/triumf.ca/data/iris/2015/iris_000029060000.mid.gz .''' | ||
or the globus-url-copy grid command (assuming you have grid tools installed and a valid, registered grid certificate): | or the globus-url-copy grid command (assuming you have grid tools installed and a valid, registered grid certificate): | ||
globus-url-copy -p 5 -vb gsiftp:// | '''globus-url-copy -p 5 -vb gsiftp://trdata00.triumf.ca/pnfs/triumf.ca/data/iris/2012/run00750.mid.gz file:///home/lindner/run00750.mid.gz''' | ||
* Installing dccp itself is pretty easy. To install from a standard SL5/6 desktop you can just use the version of dccp that you get from EPEL; ie, just do | |||
yum install dcap | |||
Installing globus-url-copy is more complicated and involved. Contact Thomas Lindner for more information. | |||
* (For sys-admins only): from TRIUMF computers you can also mount the dcache system by doing following: | * (For sys-admins only): from TRIUMF computers you can also mount the dcache system by doing following: | ||
mkdir -p /pnfs | mkdir -p /pnfs | ||
edit /etc/rc.local, add to the end of file: "mount -o intr,rw,noac,hard,nfsvers=3 | edit /etc/rc.local, add to the end of file: "mount -o intr,rw,noac,hard,nfsvers=3 trdata00:/pnfs /pnfs" | ||
. /etc/rc.local | . /etc/rc.local | ||
* After March 4th, the new system | * After March 4th, the new system was eenamed as trdata00 and the old system became unavailable. | ||
There is administrative details [[trdata_admin|TRDATA admin]] | |||
You can also access the [http://ccn.triumf.ca/file-storage/experimental-data-storage original documentation] for the old trdata setup. | |||
Latest revision as of 09:32, 2 February 2022
The Experimental Data Storage is a facility dedicated to store large amount of data produced by TRIUMF experimental groups. This system is based on the DCache software (Desy and FermiLab) and consists uniquely of storage. No CPU power is available. To the users, only the main server machine TRDATA00 is visible. The files are stored on one or several disk server machines. The system is easily expendable. To obtain disk space on this system, please contact Pierre Amaudruz or Thomas Lindner (lindner@triumf.ca). The disk servers are running RAID 6 software but the files are not backed up to another system. The users should not count on this facility as a permanent archive at this point. Currently the system has ~125 TB available.
We are currently migrating the dcache system from an older version to a new version on a new computer. The following is useful information for the transition period:
- the new system is already up and running. You can see the new dcache interface here:
http://trdata00.triumf.ca:2288
- Files from the old dcache system have been all copied to the new system (except for pienu files, for which special arrangements are being made).
- You can copy file from the new system with either the dccp command:
dccp dcap://trdata00.triumf.ca/pnfs/triumf.ca/data/iris/2015/iris_000029060000.mid.gz .
or the globus-url-copy grid command (assuming you have grid tools installed and a valid, registered grid certificate):
globus-url-copy -p 5 -vb gsiftp://trdata00.triumf.ca/pnfs/triumf.ca/data/iris/2012/run00750.mid.gz file:///home/lindner/run00750.mid.gz
- Installing dccp itself is pretty easy. To install from a standard SL5/6 desktop you can just use the version of dccp that you get from EPEL; ie, just do
yum install dcap
Installing globus-url-copy is more complicated and involved. Contact Thomas Lindner for more information.
- (For sys-admins only): from TRIUMF computers you can also mount the dcache system by doing following:
mkdir -p /pnfs edit /etc/rc.local, add to the end of file: "mount -o intr,rw,noac,hard,nfsvers=3 trdata00:/pnfs /pnfs" . /etc/rc.local
- After March 4th, the new system was eenamed as trdata00 and the old system became unavailable.
There is administrative details TRDATA admin
You can also access the original documentation for the old trdata setup.