Introduction: Difference between revisions

From MidasWiki
Jump to navigation Jump to search
No edit summary
 
(51 intermediate revisions by 2 users not shown)
Line 1: Line 1:
== What is Midas ==
== What is Midas ==
... DAQ for intermediate phys. expt.
"MIDAS" is an acronym for Maximum Integrated Data Acquisition System.
 
MIDAS is a general-purpose system for event-based data acquisition in small and medium scale Physics experiments. It is an on-going development at the Paul Scherrer Institute (Switzerland) and at TRIUMF (Canada), since 1993.
 
''' It is not to be confused with MIDAS (Multi Instance Data Acquisition System) from UK, or any of the MIDAS (Mobile Instrumentation Data Acquisition System), or MIDAS digital and analogue consoles and finally with MIDAS Brakes and Mufflers! '''
 
MIDAS is based on a modular networking capability and a central database system. MIDAS consists of a C library and several applications, which can run on many different platforms (i.e. operating systems) mainly UNIX-like based (we use to support Windows, VMS...). While the system is already in use in many laboratories, the development continues with addition of new features and tools. Recent developments involve multi-threading, FGPA/Linux support, MSCB extension.


==What Midas can do for you ==
==What Midas can do for you ==
... collect data from different source (HW, Network)
In a few words, Midas can:
* '''Collect data from local and/or remote clients.'''
* Provides a mean to configure the hardware managed by any of the client ([[Online_Database| Online database]])
* Manages the [[Run_States_and_Transitions | run transitions]] functions during run operation (start, stop, etc.)
* Provides a set of essential [[Application_listing| Applications]] to control and monitor a data acquisition sequence.
* Implements [[Feature_listing | features ]]) specific to Data Aquisition for physics experiment.
* Records the collected data to various [[mlogger|storage media]].
* Provides programming interfaces of the data stream to different analysis packages ([[ROOTANA]], [http://bitbucket.org/tmidas/manalyzer/src/master/ manalyzer]).
* Provides a web interface and tools to build custom display for run monitoring and control ([[mhttpd]], [[Status_Page]]).
 
==History==
In the early '90s, based on a previous Data Acquisition system running under MS-DOS with network capability (HIX), Dr. Stefan Ritt at Paul Sherrer Institute PSI (Switzerland) started coding a new set of applications which would be OS independent. At that time, OS such as VMS, ULTRIX, VxWorks and Windows were available.
The first deployment of Midas was for the "Canadian High Acceptance Orbital Spectrometer" (CHAOS) experimental facility at TRIUMF (Canada). Network based, the data were collected from a VME processor running VxWorks (collecting CAMAC, FastBus & VME data) and sending them to a backend computer running VMS and later ULTRIX.


== Midas components ==
Since then, Midas has been deployed on all major experiments at TRIUMF and PSI. It is also used around the world in over 80 locations. From simple workbench test setups to world class experiments such as PiBeta - muon decay [http://meg.icepp.s.u-tokyo.ac.jp/ '''MEG'''] (PSI, Switzerland) - trapping antihydrogen atoms [http://alpha.web.cern.ch/ '''ALPHA''', '''ALPHA-g'''] (CERN, Switzerland) - neutrino oscillation [http://t2k-experiment.org/ '''T2K'''](J-Parc, Japan) - Decay study Pienu - precision muon measurement Twist (TRIUMF, Canada) - Dark Matter search [http://deap.phy.queensu.ca/ '''DEAP'''] (Sudbury, Canada) - Neutron Capture DANCE (Los Alamos, USA), - Dark Matter search [https://surfacetreatments.infn.it/projects/darkside-20k-project/ '''DARKIDE-20K'''] (LNGS, Italy), - P-ONE neutrino telescope [https://www.pacific-neutrino.org/ '''P-ONE'''] (Cascadia Basin, Canada), - P-ONE neutrino telescope [https://nexo.llnl.gov/ '''nEXO'''] (Subury, Canada)
===Core system ===
Core functionalities ...
===Frontend ===
concept, hooks to the experiment ...


=== Data logging ===
Midas has demonstrated its versatile capabilities and proven to be a mature and modern Data Acquisition Software package.
Data collection scheme ...
A non-exhaustive list of experiments can be found [https://midas.triumf.ca/MidasWiki/index.php/MIDAS_around_the_world here].


=== Analysis ===
=== Recent Developments ===https://www.pacific-neutrino.org/p-one
Analysis client ...
* July 2013 : Stefan Ritt visit at Triumf
** Midas code from local SVN repository to Bitbucket cloud based GIT repository [https://bitbucket.org/tmidas/midas Tmidas]
** Implementation of multi-threading transition
** New Midas web page
** JSON, JSON-P for custom Midas web page support
*Jan 2014 : New History Logging scheme "FILE"
* July 2015 : Stefan Ritt visit at Triumf
* August 2015 : Important Network Security upgrades:
** Default MIDAS is now secure (clients must run on localhost only)
** Network connections must be explicity allowed (see [[Security]])
** [[mhttpd]] uses secure HTTPS connections
* January 2016 : mjson-rpc functions added to Javascript libary [[mhttpd.js]] - see [[mjsonrpc]]
* July 2017
** New web page layout with menu buttons on left side and alarm and message display on every page
** New custom pages based on the mjson-rpc layer - see [[Custom_Page|Custom Pages 2017]]


=== Online Database ===
==[[Overall Midas system diagram]]==
Experiment specific Midas Database ...
A graphical view of the generic acquisition components forming the MIDAS DAQ


=== Overall Midas system diagram ===
==[[Midas Core]]==
...
A general description of the different components composing the Midas Data Acquisition package
[[File:Midas intro-04.png|200px|thumb|left|alt text]]

Latest revision as of 14:13, 4 August 2023

What is Midas

"MIDAS" is an acronym for Maximum Integrated Data Acquisition System.

MIDAS is a general-purpose system for event-based data acquisition in small and medium scale Physics experiments. It is an on-going development at the Paul Scherrer Institute (Switzerland) and at TRIUMF (Canada), since 1993.

It is not to be confused with MIDAS (Multi Instance Data Acquisition System) from UK, or any of the MIDAS (Mobile Instrumentation Data Acquisition System), or MIDAS digital and analogue consoles and finally with MIDAS Brakes and Mufflers!

MIDAS is based on a modular networking capability and a central database system. MIDAS consists of a C library and several applications, which can run on many different platforms (i.e. operating systems) mainly UNIX-like based (we use to support Windows, VMS...). While the system is already in use in many laboratories, the development continues with addition of new features and tools. Recent developments involve multi-threading, FGPA/Linux support, MSCB extension.

What Midas can do for you

In a few words, Midas can:

  • Collect data from local and/or remote clients.
  • Provides a mean to configure the hardware managed by any of the client ( Online database)
  • Manages the run transitions functions during run operation (start, stop, etc.)
  • Provides a set of essential Applications to control and monitor a data acquisition sequence.
  • Implements features ) specific to Data Aquisition for physics experiment.
  • Records the collected data to various storage media.
  • Provides programming interfaces of the data stream to different analysis packages (ROOTANA, manalyzer).
  • Provides a web interface and tools to build custom display for run monitoring and control (mhttpd, Status_Page).

History

In the early '90s, based on a previous Data Acquisition system running under MS-DOS with network capability (HIX), Dr. Stefan Ritt at Paul Sherrer Institute PSI (Switzerland) started coding a new set of applications which would be OS independent. At that time, OS such as VMS, ULTRIX, VxWorks and Windows were available. The first deployment of Midas was for the "Canadian High Acceptance Orbital Spectrometer" (CHAOS) experimental facility at TRIUMF (Canada). Network based, the data were collected from a VME processor running VxWorks (collecting CAMAC, FastBus & VME data) and sending them to a backend computer running VMS and later ULTRIX.

Since then, Midas has been deployed on all major experiments at TRIUMF and PSI. It is also used around the world in over 80 locations. From simple workbench test setups to world class experiments such as PiBeta - muon decay MEG (PSI, Switzerland) - trapping antihydrogen atoms ALPHA, ALPHA-g (CERN, Switzerland) - neutrino oscillation T2K(J-Parc, Japan) - Decay study Pienu - precision muon measurement Twist (TRIUMF, Canada) - Dark Matter search DEAP (Sudbury, Canada) - Neutron Capture DANCE (Los Alamos, USA), - Dark Matter search DARKIDE-20K (LNGS, Italy), - P-ONE neutrino telescope P-ONE (Cascadia Basin, Canada), - P-ONE neutrino telescope nEXO (Subury, Canada)

Midas has demonstrated its versatile capabilities and proven to be a mature and modern Data Acquisition Software package. A non-exhaustive list of experiments can be found here.

=== Recent Developments ===https://www.pacific-neutrino.org/p-one

  • July 2013 : Stefan Ritt visit at Triumf
    • Midas code from local SVN repository to Bitbucket cloud based GIT repository Tmidas
    • Implementation of multi-threading transition
    • New Midas web page
    • JSON, JSON-P for custom Midas web page support
  • Jan 2014 : New History Logging scheme "FILE"
  • July 2015 : Stefan Ritt visit at Triumf
  • August 2015 : Important Network Security upgrades:
    • Default MIDAS is now secure (clients must run on localhost only)
    • Network connections must be explicity allowed (see Security)
    • mhttpd uses secure HTTPS connections
  • January 2016 : mjson-rpc functions added to Javascript libary mhttpd.js - see mjsonrpc
  • July 2017
    • New web page layout with menu buttons on left side and alarm and message display on every page
    • New custom pages based on the mjson-rpc layer - see Custom Pages 2017

Overall Midas system diagram

A graphical view of the generic acquisition components forming the MIDAS DAQ

Midas Core

A general description of the different components composing the Midas Data Acquisition package