IRIS: Difference between revisions

From DaqWiki
Jump to navigation Jump to search
 
(8 intermediate revisions by the same user not shown)
Line 25: Line 25:


Home directories:
Home directories:
on iris00 2x240GB SSD (ZFS mirror) /zssd/home1
on iris00 2x240GB SSD (ZFS mirror) /home1


Data storage:
Data storage:
on iris00 2x10TB HDD (ZFS mirror) /z10tb/iris, NFS mounted as /iris/data0/iris
on iris00 2x20TB HDD (ZFS mirror) /zdata/iris, NFS mounted as /iris/data0/iris


=== DAQ instructions ===
=== DAQ instructions ===
=== Dcache ===
* apt install dcap dcap-dev
* add to rc.local
<pre>
mkdir -p /daq/pnfs
mount trdata00:/pnfs /daq/pnfs -w -o noac,vers=3 &
</pre>


=== How to rebuild IRIS DAQ ===
=== How to rebuild IRIS DAQ ===


* EPICS see https://epics.anl.gov/
* build EPICS see https://epics.anl.gov/
<pre>
<pre>
cd $HOME/packages
cd $HOME/packages
Line 42: Line 51:
make -j
make -j
ls -l bin/linux-x86_64/
ls -l bin/linux-x86_64/
</pre>
* build MIDAS with EPICS:
** set MIDASSYS to $HOME/packages/midas
** set EPICSSYS to $HOME/packages/epics-base
** cd $MIDASSYS
** make cmake
** check that build/examples/eventbuilder/mevb and build/examples/epics/fe_epics were built
* build ROOTANA
** make sure ROOTSYS is set and points to a working version of ROOT
** cd $HOME/packages/rootana
** make clean; make
** there should be no errors
* build iris-daqtools
** cd $HOME/packages/iris-daqtools
** rm -rf build; mkdir build; cd build; cmake ..; make
** there should be no errors
* build VME frontends and event builder
** cd online/src
** make
** feairis.exe, fetiris.exe and eb_iris.exe should be built
** event builder should be run: eb_iris.exe -b BUF
* build DT5740 frontend
** install CAEN drivers and libraries
** cd online/dt5740
** make
** fedt5740.exe should be built
* build analyzer
** cd $HOME/current/anaIris
** make
** there should be no errors, bin/anaIris should be built.
=== Install CAEN DT5740 driver ===
* ssh root@iris00
* download and untar CAENUSBdrvB-1.5.5
* apt install linux-headers-generic
* apt install gcc-12 ### only if "make" complains about it!
* cd CAENUSBdrvB-1.5.5
* make
* make install
* modprobe CAENUSBdrvB
* in dmesg and in /var/log/syslog
<pre>
[6025297.550251] CAENUSBdrvB: module verification failed: signature and/or required key missing - tainting kernel
[6025297.550642] CAEN Desktop Waveform Digitizers Carrier found at address 5
[6025297.550736] probe: obuf address:00000000fe2b2e43
[6025297.550741] probe: ibuf address:00000000beb0270c
[6025297.550765] usbcore: registered new interface driver v1718
[6025297.550766] CAEN USB driver version 1.5.5
</pre>
now go back to iris@iris00, cd online/dt5740, ./fedt5740.exe should print this:
<pre>
iris00:~/online/dt5740> ./fedt5740.exe
Frontend name          :    feDT5740
Event buffer size      :    2186000
User max event size    :    1088000
User max frag. size    :    5242880
# of events per buffer :    2
Connect to experiment iris...
OK
Init hardware...
begin of Init
[feDT5740,INFO] successfully opened digitizer
[feDT5740,INFO] Connected to CAEN Digitizer Model DT5740
ROC FPGA Release is 04.17 - Build 2110
AMC FPGA Release is 00.12 - Build 1516
acqctl - 0x8100: 0x0    err:0
end of Init
OK
</pre>
</pre>

Latest revision as of 14:24, 4 September 2024

Information on IRIS DAQ

Contacts

  • Experimental setup and operation - Rituparna Kanungo [ritu@triumf.ca]
  • DAQ hardware and software - TRIUMF-DAQ group / Pierre-A. Amaudruz [midas@triumf.ca]
  • mhall
  • malacorta

IRIS Linux DAQ cluster

IRIS is composed of 5 machines

  • IRIS00 - Main NFS server and DAQ (experimental floor)
  • IRIS01 - Auxiliary analysis computers (ISAC-II north counting room)
  • IRIS02 - Auxiliary analysis computers (ISAC-II north counting room)
  • lxiris01 - VME processor for ADCs Mesytec MADC32s (experimental floor)
  • lxiris02 - VME processor for TDCs CAEN V1190s (experimental floor)

and 2 VME crates:

  • irisvme1
  • irisvme2

Home directories: on iris00 2x240GB SSD (ZFS mirror) /home1

Data storage: on iris00 2x20TB HDD (ZFS mirror) /zdata/iris, NFS mounted as /iris/data0/iris

DAQ instructions

Dcache

  • apt install dcap dcap-dev
  • add to rc.local
mkdir -p /daq/pnfs
mount trdata00:/pnfs /daq/pnfs -w -o noac,vers=3 &

How to rebuild IRIS DAQ

cd $HOME/packages
git clone https://github.com/epics-base/epics-base
cd epics-base
git checkout R7.0.8
make -j
ls -l bin/linux-x86_64/
  • build MIDAS with EPICS:
    • set MIDASSYS to $HOME/packages/midas
    • set EPICSSYS to $HOME/packages/epics-base
    • cd $MIDASSYS
    • make cmake
    • check that build/examples/eventbuilder/mevb and build/examples/epics/fe_epics were built
  • build ROOTANA
    • make sure ROOTSYS is set and points to a working version of ROOT
    • cd $HOME/packages/rootana
    • make clean; make
    • there should be no errors
  • build iris-daqtools
    • cd $HOME/packages/iris-daqtools
    • rm -rf build; mkdir build; cd build; cmake ..; make
    • there should be no errors
  • build VME frontends and event builder
    • cd online/src
    • make
    • feairis.exe, fetiris.exe and eb_iris.exe should be built
    • event builder should be run: eb_iris.exe -b BUF
  • build DT5740 frontend
    • install CAEN drivers and libraries
    • cd online/dt5740
    • make
    • fedt5740.exe should be built
  • build analyzer
    • cd $HOME/current/anaIris
    • make
    • there should be no errors, bin/anaIris should be built.

Install CAEN DT5740 driver

  • ssh root@iris00
  • download and untar CAENUSBdrvB-1.5.5
  • apt install linux-headers-generic
  • apt install gcc-12 ### only if "make" complains about it!
  • cd CAENUSBdrvB-1.5.5
  • make
  • make install
  • modprobe CAENUSBdrvB
  • in dmesg and in /var/log/syslog
[6025297.550251] CAENUSBdrvB: module verification failed: signature and/or required key missing - tainting kernel
[6025297.550642] CAEN Desktop Waveform Digitizers Carrier found at address 5
[6025297.550736] probe: obuf address:00000000fe2b2e43
[6025297.550741] probe: ibuf address:00000000beb0270c
[6025297.550765] usbcore: registered new interface driver v1718
[6025297.550766] CAEN USB driver version 1.5.5

now go back to iris@iris00, cd online/dt5740, ./fedt5740.exe should print this:

iris00:~/online/dt5740> ./fedt5740.exe
Frontend name          :     feDT5740
Event buffer size      :     2186000
User max event size    :     1088000
User max frag. size    :     5242880
# of events per buffer :     2

Connect to experiment iris...
OK
Init hardware...
begin of Init
[feDT5740,INFO] successfully opened digitizer
[feDT5740,INFO] Connected to CAEN Digitizer Model DT5740
ROC FPGA Release is 04.17 - Build 2110
AMC FPGA Release is 00.12 - Build 1516
acqctl - 0x8100: 0x0    err:0
end of Init
OK