DS-PC

DarkSide-20k Front-End (DSFE) machine activation

ssh wheel@dsdaqgw
psswd: (ask Konstantin or Marek)

sudo /bin/bash
psswd: (ask Konstantin or Marek)

you are root now, see:
id

cd /nfsroot

zfs get all | grep dedup

mkdir dsfeXX

cd dsfe05

rsync -avx . ../dsfeXX/

cd ../dsfeXX/

edit etc/hostname
dsfe05 -> dsfeXX

edit etc/fstab (nothing to change...)

edit etc/rc.local

and comment out:

# ifconfig enp1s0f1 192.168.0.1 netmask 255.255.255.0
# systemctl restart dnsmasq

inspect /tftpboot/uefi/pxelinux.cfg/default
(no action here)

cd /etc
edit /etc/dnsmasq.conf
add dsfeXX under:
# uefi pxe

edit /etc/hosts
add dsfeXX under:
# FEP and TSP network

now we need dsfeXX MAC address

connect 10gige to the right DAC port on the back
power up

tail -f /var/log/syslog
last line (~ 1 min after powering up) will have dsfeXX MAC address
like here:
May 22 16:46:40 dsdaqgw dnsmasq-dhcp[110361]: 1756546062 DHCPDISCOVER(enp1s0f1) 40:a6:b7:c1:d2:8c ignored


edit /etc/dnsmasq.conf
add line below with dsfeXX MAC address below:
# backend network 192.168.4.x

systemctl restart dnsmasq

add dsfeXX to /etc/exports
exportfs -rv

cycle power on dsfeXX

observe /var/log/syslog:
tail -f /var/log/syslog
gets an ip address
loads /tftpboot/uefi/pxelinux.cfg/default
loads uefi/syslinux.efi
nfsroot authenticated mount request from 192.168.4.XXX for /nfsroot/dsfeXX (/nfsroot/dsfeXX)


ping dsfeXX
ssh dsfeXX

edit /etc/gonodeinfo.conf
update it with feXX

top
ifconfig -a 
df

observe /var/log/mini_httpd.log
http get /uefi/vmlinuz-6.5.0-18-generic
http get /uefi/initrd.img-6.5.0-18-generic

add network connection to the VX network 192.168.0.x.

in /etc/rc.local:

systemctl stop dnsmasq
ifconfig enp1s0f1 192.168.0.156 netmask 255.255.255.0
sysctl -w net.ipv4.ip_forward=1

192.168.0.156 is dsfe060 (dsfe06, network 0)
192.168.0.157 is dsfe070 and so forth

enp1s0f1 of each machine connected by DAC cable to vlan2 ports on the juniper switch ports 12,13,14,15.

ports 12,13,14,15 switched from 1gige back to 10gige (using the junos "delete" command).

ssh dsvslice4
edit /etc/netgroup

DarkSide-20k Time Slice Processor (DSTS) machine activation

ssh wheel@dsdaqgw
psswd: (ask Konstantin or Marek)

sudo /bin/bash
psswd: (ask Konstantin or Marek)

you are root now, see:
id

cd /nfsroot

mkdir dsts0X

cd dsts0X

rsync -av ../dsts01/ .

edit etc/hostname
-> dsts0X
edit etc/gonodeinfo.conf
-> dsts0X

edit /etc/exports

add line:

/nfsroot/dsts0X dsts0X(rw,no_root_squash,async,no_subtree_check)

exportfs -rv

edit /etc/dnsmasq.conf

under "pxe boot" add:

dhcp-option-force=tag:dsts0X,option:root-path,192.168.4.1:/nfsroot/dsts0X

under "backend network 192.168.4.x" add

add / comment out 

dhcp-host=ac:1f:6b:f8:2f:de,ac:1f:6b:f8:2f:df,dsts0X,infinite,set:pxe,set:dsts0X

remember to 1) chenage "set:pxe" and 2) add proper address (later)

cd ~
systemctl restart dnsmasq

ping dsts0X

ssh dsts0X

ifconfig

enp1s0f0: ether
enp1s0f1: ether

get the addresses and add to /etc/dnsmasq.conf (to the line added before)

systemctl restart dnsmasq

Might happen that the video driver will be unhappy about absent monitor and freeze the machine. 
Adding "nomodeset" to the kernel command line (in tftpboot/pxelinux.cfg/default) seems fix it.