Difference between revisions of "Cdms workshop"

From MidasWiki
Jump to navigation Jump to search
 
(8 intermediate revisions by the same user not shown)
Line 4: Line 4:
  
 
[[Image:Midas_intro-04.png|MIDAS general picture]]
 
[[Image:Midas_intro-04.png|MIDAS general picture]]
 
== MIDAS web security ==
 
 
[[Image:web_security.svg]]
 
[[Image:web_security.png]]
 
  
 
== MIDAS main data path ==
 
== MIDAS main data path ==
  
 
<pre>
 
<pre>
hardware ->  
+
hardware -> mfe user thread -> ring buffer ->
 +
(compression thread -> ring buffer ->)
 +
mfe main thread -> TCP socket ->
 +
mserver -> event buffer -> event builder thread -> SYSTEM buffer ->
 +
mlogger -> (ring buffer -> compression thread -> ) data file ->
 +
lazylogger -> dcache/castor/hadoop/cloud storage
 
</pre>
 
</pre>
 +
 +
Needs to scale from 0.5GB/0.3GHz/1core PPC on FPGA to 1GB/1GHz/1core 32-bit ARM to 64GB/4GHz/12core 64-bit x86!
 +
 +
== MIDAS web security ==
 +
 +
[[Image:web_security_svg.svg]]
 +
 +
[[Image:web_security.png]]
  
 
== MIDAS slow controls paths ==
 
== MIDAS slow controls paths ==
  
TBW
+
[[Image:web_paths_svg.svg]]
 +
 
 +
[[Image:web_paths.png]]
  
 
== MIDAS history paths ==
 
== MIDAS history paths ==
  
TBW
+
Write path:
 +
 
 +
<pre>
 +
hardware ->
 +
mfe -> SYSTEM buffer -> mlogger -> data.mid.gz
 +
mfe -> ODB -> hotlink
 +
mlogger -> hs_write -> .hst binary file, MySQL database, SQLITE database, (maybe "no sql" database)
 +
</pre>
 +
 
 +
Plot path:
 +
 
 +
<pre>
 +
user web browser ->
 +
mhttpd -> hs_read -> read from .hst binary file, MySQL database, etc
 +
-> use "gd" to make .png image -> send png file to user
 +
-> (future: return to user a JSON data, plot using JS graphics)
 +
</pre>

Latest revision as of 08:55, 10 March 2014

Notes for the CDMS workshop March 2014

MIDAS general picture

MIDAS general picture

MIDAS main data path

hardware -> mfe user thread -> ring buffer ->
(compression thread -> ring buffer ->)
mfe main thread -> TCP socket ->
mserver -> event buffer -> event builder thread -> SYSTEM buffer -> 
mlogger -> (ring buffer -> compression thread -> ) data file -> 
lazylogger -> dcache/castor/hadoop/cloud storage

Needs to scale from 0.5GB/0.3GHz/1core PPC on FPGA to 1GB/1GHz/1core 32-bit ARM to 64GB/4GHz/12core 64-bit x86!

MIDAS web security

Error creating thumbnail: convert-im6.q16: non-conforming drawing primitive definition `stroke-linecap' @ error/draw.c/RenderMVGContent/4300.

Web security.png

MIDAS slow controls paths

Error creating thumbnail: convert-im6.q16: non-conforming drawing primitive definition `stroke-linejoin' @ error/draw.c/RenderMVGContent/4300.

Web paths.png

MIDAS history paths

Write path:

hardware ->
mfe -> SYSTEM buffer -> mlogger -> data.mid.gz
mfe -> ODB -> hotlink
mlogger -> hs_write -> .hst binary file, MySQL database, SQLITE database, (maybe "no sql" database)

Plot path:

user web browser ->
mhttpd -> hs_read -> read from .hst binary file, MySQL database, etc
-> use "gd" to make .png image -> send png file to user
-> (future: return to user a JSON data, plot using JS graphics)