VME-NIMIO32-Rev3

From DaqWiki
Jump to navigation Jump to search

VME-NIMIO32-Rev3

Links

General information

Hardware

  • FPGA: Cyclone5 5CGXFC7D7F27C8N
  • boot flash: EPCQ256
  • clock cleaner: IDT 8T49N241-009NLG1, I2C addr 1111'100b
  • mac address: Microchip 24AA02E48T-I/OT, I2C address 0xA0, bus MAC_SCL, MAC_SDA
  • eeprom: Microchip 24AA04T-I/OT, I2C address 0xA0, bus SCLK, SDATA
  • RGB_LED: driver TLC5929DBQR
  • clocks: OSC1, OSC2: 125 MHz, OSC3: 10 MHz
  • front panel double SATA connector: 1 serial communication, 1 clock (in our out) and trigger (in or out)
  • on board 3 double SATA connectors: 7 serial communication.
  • front panel SFP, (1/2.5/5 Gige ethernet?)
  • 16 double LEMO connectors: switchable between input and output. input: NIM or TTL. output: NIM
  • 16 ECL or LVDS inputs: onboard 34-pin header connector, LeCroy 4616 compatible.
  • 16 front panel LEDs: FP_LED driver: two faisy chained TLC5929DBQR

Front panel connectors

|
| RGB_LED
|
| dual SATA: XXX | XXX
|
| SFP ethernet
|
| FP_LED [30] and [31]
| LEMO [30] and [31]
| ...
| FP_LED [0] and [1]
| LEMO [0] and [1]
|

Input channel mapping

  • 0+16 : LVDS/ECL connector
  • 16+32 : LEMO inputs
  • 48+2: ESATA CLK, ESATA TRIG
  • 50+2: CLN_CLKOUT1, CLN_CLKOUT2 from clock cleaner
  • 52+1 : LVDS_OSC1 (125 MHz oscillator)

Firmware

for building firmware use: /opt/intelFPGA/20.1/nios2eds/nios2_command_shell.sh

git clone git@bitbucket.org:ttriumfdaq/vmeio.git
cd vmeio
/opt/intelFPGA/20.1/nios2eds/nios2_command_shell.sh
make
make jic
make load_jic

for jtag access, use /daq/quartus/13.1.3.178/quartus/bin/jtagconfig

daq01:intelFPGA$ /daq/quartus/13.1.3.178/quartus/bin/jtagconfig 
1) USB-Blaster [1-8]
  02B030DD   5CGTFD7(B5|C5|D5)/5CGXBC7B6/..

Firmware update procedure

  • obtain and build the VME programmer (srunner_vme) and IO32 test program (test_VMENIMIO32):
    • mkdir $HOME/packages
    • cd $HOME/packages
    • git clone https://bitbucket.org/ttriumfdaq/vme # get the repository, done once
    • cd vme
    • git pull # get latest version
    • make -k srunner_vme.exe srunner_vme_gef.exe test_VMENIMIO32.exe test_VMENIMIO32_gef.exe
  • read the firmware revision from VME register 0:
    • ./test_VMENIMIO32_gef.exe --addr 0x800000 --read 0
  • write FPGA firmware into the flash memory using the VME programmer:
    • ./srunner_vme_gef.exe -program -256 vmeio.pof 0x800020
  • reboot the FPGA into the new firmware:
    • ./test_VMENIMIO32_gef.exe --addr 0x800000 --reboot

Firmware registers

vmeio register set is a mix of IO32 registers and chronobox registers.

reg | rw/ro | quartus name | firmware | description
0 | ro | sof_revision_in | all | firmware revision timestamp code
#0 | wo | latch_scalers_out, zero_scalers_out | all | see [[#reg_0_write_bits]]
1 | rw | command | all | see [[#reg_1_command]]
2 | rw | reg2_led_ctrl | all | LED control, see [[#reg_2_led_control_bits]]
3 | rw | reg3_fp_led_out | all | FP LED output
4 | rw | reg4_test | all | 32-bit read-write test register
5 | rw | reg5_rgb_led_out | 0x630fcc67 | RGB LED output
6 | ro | ecl_in_async | all | read state of ECL inputs
#7 | ro | reg7_test_in | all | ???
8 | rw | flash_programmer_in, reg8_flash_programmer_out | all | 0xABCD srunner_vme flash programmer
#8 | rw | scaler_addr_out, reg8_scaler_data_in | all | top 16 bits of address becomes scaler bus address, 32 bit read is the corresponding scaler data
9 | ro | lemo_in_async | all | read state of LEMO inputs
#A | ro | gpio_in | all | read state of GPIO inputs
11 | rw | reg11_lemo_out | all | LEMO output data
#C | rw | regC_gpio_out | all | GPIO output data
#D | rw | regD_out_enable_out | all | enable output tristates: [31:24] - LEMO_OUT, [17:0] - GPIO_OUT
#E | rw | regE, reconfig_out | 0x5b6de806 | FPGA reboot: write inverted firmware revision (reg0) to reboot the FPGA
#F | ro | regF_input_num_in | 0x5b89e4b4 | number of chronobox inputs (to read scalers, add 1 for the clock counter)
#10 | ro | reg10_fifo_status | 0x5b8de2b0 | data fifo status, see below
#11 | ro | reg11_fifo_data | 0x5b8de2b0 | data fifo data, see below
#12 | rw | cb_invert_a | 0x5bf7557e | invert inputs 31..0
#13 | rw | cb_invert_b | 0x5bf7557e | invert inputs 63..32
#14 | rw | cb_enable_le_a | 0x5bf7557e | enable TSC leading edge
#15 | rw | cb_enable_le_b | 0x5bf7557e | enable TSC leading edge
#16 | rw | cb_enable_te_a | 0x5bf7557e | enable TSC trailing edge
#17 | rw | cb_enable_te_b | 0x5bf7557e | enable TSC trailing edge
#18 | ro | fc_ext_clk_100_counter | 0x5bf7557e | external clock frequency counter 100MHz reference
#19 | ro | fc_ext_clk_ext_counter | 0x5bf7557e | external clock frequency counter
#1A | ro | fc_ts_clk_100_counter | 0x5bf7557e | timestamp clock frequency counter 100MHz reference
#1B | ro | fc_ts_clk_ts_counter | 0x5bf7557e | timestamp clock frequency counter
#1C | ro | ts_clk_pll_status | 0x5bf7557e | timestamp clock PLL status
#1D | rw | cb_lemo_out_mux_ctrl | 0x5bfdc798 | 8*4 bits to control 8 LEMO output multiplexers (4 bits/16 options each mux)
#1E | rw | cb_sync_mask[31:0] | NEXT | source of chronobox sync signal, low bits
#1F | rw | cb_sync_mask[63:32] | NEXT | source of chronobox sync signal, high bits

reg 0 write bits

  1. bit | fw revision | quartus signal | description
  2. 0 | all | | latch scalers
  3. 1 | all | | zero scalers
  4. 2 | ... | fifo_rdreq_out | fifo_rdreq_out
  5. 3 | ... | ts_clk_pll_extswitch_out | clear ts_clk_pll_extswitch_out
  6. 4 | ... | ts_clk_pll_extswitch_out | set ts_clk_pll_extswitch_out
  7. 5 | NEXT | sync_arm | arm the synchronization sequence
  8. 6 | NEXT | cb_sync | activate the synchronization

reg 1 command

  • command 0: nothing
  • command 1: IO32_CMD_RESET: issue reset signal
  • command 2: IO32_CMD_FPGA_RECONFIGURE: reboot the FPGA

reg 2 led control bits

32 bits:

  • 0+4: select FP LED bus mux:
    • 0: default bus
    • 1: fp_led_out
    • 2: LEMO outputs
    • 3: LEMO inputs
    • 4: LVDS/ECL inputs
    • 5: OR of LEMO outputs, LEMO inputs and LVDS/ECL inputs
  • 4+4: select RGB LED bus mux:
    • 0: default bus
    • 1: rgb_led_out
  • 8+: unconnected
  • 31: reset LEDs

reg N

Data FIFO status bits:

31: fifo_full
30: fifo_empty
29: 0
28: 0
24+4: 0
0+24: fifo_usedw

reg 0x1C

Timestamp clock PLL status bits:

31 : PLL locked
30 : PLL active clock (0=internal, 1=external
29 : external clock bad
28 : internal clock bad
27 : ts_clk_pll_extswitch
0..26 : not used

Required board mods

  • VME_LWORD (VME_A[0]) jumper to FPGA pin E10 (VME_SERB)
  • VME_A29 jumper to FPGA pin P23 (VME_SYSFAILn)
  • RGB_LED_SDI jumper to FPGA pin W16
  • -3V external power supply

Test status

  • power up ok
  • fpga jtag ok
  • flash load ok
  • fpga boot from flash ok
  • !!! VME slave interface: A32/D32 single word cycle ok, 32-bit and 64-bit transfer untested (should work), 2eVME and 2eSST untested (should work).
  • !!! VME interface: D lines: read ok, drive ok, A lines read ok, A lines drive untested. AS/DS read ok, drive untested. DTACK read ok, drive ok.
  • JTAG JIC flash programmer ok ("serial flash loader" block)
  • VME flash programmer (srunner_vme): can read, verify and program vmeio_auto.rpd files
  • FPGA reboot ok ("remote update" block)
  • !!! front panel FP LEDs: partially tested (generally alive. mapping and individual leds untested)
  • !!! front panel RGB LED: tested (mapping to be confirmed)
  • !!! LVDS/ECL input: a few channels look ok
  • !!! -3.3V external power supply current 0.64 A
  • !!! NIM input: chan 0,1 ok
  • !!! TTL input: untested
  • !!! NIM output: chan 0,1 ok
  • !!! SATA connectors: untested
  • !!! clock cleaner: untested
  • !!! ethernet interface: RX/TX untested, SPI untested, ethernet MAC address flash memory untested

Mysteries:

  • set_location_assignment PIN_AC7 -to RGB_LED_SDI -disable -comment "vrefb3an0 PIN_AC7"
  • set_location_assignment PIN_L26 -to VME_A[29] -disable -comment "vrefb6an0 PIN_L26"
  • D8 - DIFFIO_TX_T56 - "VME-DIG-3.3V"
  • quartus messages pin eSATA_TRIG:
Critical Warning (12888): Cross talk of LVDS Pin eSATA_TRIG from SE IO is too high. Reassign or move one or more of the following SE I/Os pins location and re-run the analysis again.  Please refer to the guideline from the Knowledge Base solution ID: rd10102013_979 and ensure the total % of crosstalk for the following SE I/O pins does not exceed 100%.
    Info (12899): SE I/O from the bank contributed to 99.18% of the margin due to SSN
    Info (12900): SE I/O MAC_SDA contributed to 9.19% of margin due to crosstalk
    Info (12900): SE I/O MAC_SCL contributed to 7.02% of margin due to crosstalk
    Info (12900): SE I/O VME_BR_out[0] contributed to 0.46% of margin due to crosstalk
    Info (12900): SE I/O VME_D[27] contributed to 2.75% of margin due to crosstalk
    Info (12900): SE I/O FP_LED_LATCH contributed to 10.17% of margin due to crosstalk
  • quartus messages about pins eSATA_CLKmon, LVDS_OSC1:
Critical Warning (12887): Too many 2.5-V SE IO in bank 7A with LVDS RX pin LVDS_OSC1. Reduce the number of 2.5-V I/Os used and re-run the analysis again.  Please refer to th
e guideline from the Knowledge Base solution ID: rd10102013_979 and ensure the total % of SSN for the following SE I/O pins does not exceed 100%.
    Info (12899): SE I/O VME_AM[3] contributed to 4.96% of the margin due to SSN
    Info (12899): SE I/O VME_AM[1] contributed to 4.96% of the margin due to SSN
    Info (12899): SE I/O VME_AM[0] contributed to 4.96% of the margin due to SSN
    Info (12899): SE I/O VME_BGOUTn[3] contributed to 4.96% of the margin due to SSN
    Info (12899): SE I/O VME_BGOUTn[2] contributed to 4.96% of the margin due to SSN
    Info (12899): SE I/O VME_BGOUTn[0] contributed to 4.96% of the margin due to SSN
    Info (12899): SE I/O VME_IACKOUTn contributed to 4.96% of the margin due to SSN
    Info (12899): SE I/O SFP_SDA contributed to 4.96% of the margin due to SSN
    Info (12899): SE I/O VME_SYSCTRL contributed to 4.96% of the margin due to SSN
    Info (12899): SE I/O VME_ARBITER contributed to 4.96% of the margin due to SSN
...

ZZZ