Adding pool

Following are the necessary steps to add a new pool group (ie add a new experiment) to trdata. Following example is for smd experiment.

Set up pool on data machine

Assume we set data pool on data machine trdata05.

Create the pool (with 600GB of space)

/opt/d-cache/bin/dcache pool create --size=600G /data/dcache/pool/smd_05_00 smd_05_00 trdata05_00PoolDomain

in smd_05_00 05 indicates this is trdata05 and 00 means the first data device on this machine.

the restart dcache

service dcache restart

Note: nothing in dcache prevents you from oversubscribing the space on a particular machine. Ie, you could allocate two pools with 15TB of space on a device with just 20TB of space overall. You need to check that yourself.

Configuration on trdata00

Next steps are on trdata00.

First, if dcache PNFS is not mounted, mount it

mount -o intr,rw,noac,hard,nfsvers=3 trdata00:/pnfs /pnfs

Now create a local user, with the same UID as the experiments user account.

groupadd -g 6016 smd
adduser -u 6016 -g smd smd

Now create the top level directory in dcache for smd

/opt/d-cache/bin/chimera-cli.sh Mkdir /pnfs/triumf.ca/data/smd 
echo "data" | /opt/d-cache/bin/chimera-cli.sh Writetag /pnfs/triumf.ca/data/smd sGroup
echo "StoreName trekdata" | /opt/d-cache/bin/chimera-cli.sh Writetag /pnfs/triumf.ca/data/smd OSMTemplate

Check that this worked

1. cd /pnfs/triumf.ca/data/smd/

root@trdata00:/pnfs/triumf.ca/data/smd

1. cat '.(tag)(OSMTemplate)'

StoreName smd root@trdata00:/pnfs/triumf.ca/data/smd

1. cat '.(tag)(sGroup)'

data

Make the directory belong to the right user

/opt/d-cache/bin/chimera-cli.sh Chown /pnfs/triumf.ca/data/smd 6016 /opt/d-cache/bin/chimera-cli.sh Chgrp /pnfs/triumf.ca/data/smd 6016

Admin Configuration on trdata00

Now we do the last setup with the obscure dcache interface.

[trdata00.triumf.ca] (local) admin > cd PoolManager [trdata00.triumf.ca] (PoolManager) admin > [trdata00.triumf.ca] (PoolManager) admin > [trdata00.triumf.ca] (PoolManager) admin > psu create pgroup trek-pgroup [trdata00.triumf.ca] (PoolManager) admin > psu create pool trek_05_00 java.lang.IllegalArgumentException: Duplicated entry : trek_05_00 [trdata00.triumf.ca] (PoolManager) admin > psu addto pgroup trek-pgroup trek_05_00 [trdata00.triumf.ca] (PoolManager) admin > psu create unit -store trek:data@osm [trdata00.triumf.ca] (PoolManager) admin > psu create ugroup trek-cond [trdata00.triumf.ca] (PoolManager) admin > psu addto ugroup trek-cond Syntax error: (2) Invalid number of arguments Help : psu addto ugroup <uGroup> <unit> [trdsm [trdata00.triumf.ca] (PoolManager) admin > [trdata00.triumf.ca] (PoolManager) admin > psu addto ugroup trek-cond trek:data@osm java.lang.IllegalArgumentException: trek:data@osm already member of trek-cond [trdata00.triumf.ca] (PoolManager) admin > psu create link trek-link trek-cond [trdata00.triumf.ca] (PoolManager) admin > psu set link trek-link -readpref=10 -writepref=10 -cachepref=10 -p2ppref=-1 [trdata00.triumf.ca] (PoolManager) admin > psu add link trek-link trek-pgroup [trdata00.triumf.ca] (PoolManager) admin > save [trdata00.triumf.ca] (PoolManager) admin >

mkdir /daq/pnfs/triumf.ca/data/trek/test [trek@ladd00 ~]$ dccp tdc_CP_run1263.pdf/daq/pnfs/triumf.ca/data/trek/test/.