SUG 4 June 2013 (Andy, Chuck, Dave, Dick, Francisco, Jim B, Wes)
The discussion today was wide ranging with many good ideas.
I have tried to summarize the meeting as follows:
System Diagrams
All stations will provide a current system diagram. These should be available to everyone and stored in an archive. Jim Brown will send his system diagram to Dick.With this as a starting point I will develop guidelines so that all stations can provide compatible system diagrams to the same level of detail. I will probably need some help from other team members in developing these guidelines.
Storage – archival and workspace
Spectrograph data storage rate is approximately 165 MB per 12 hours per instrument (14 MB/hr). Dave is operating the UFRO machine and a dual spectrograph for RCP and LCP – for this count lets call that 3 instruments. Other stations are Wes 1, Jim B 1, Andy 1, Tom A 1). This yields a current total of 7 instruments producing data at a rate of 14MB per hour each, for a total of 98 (call it 100) MB per hour. The total predicted duration of Io-related storms for the 2013-2014 season is 118 hours which results in11.5 (call it 12) GB of data. This of course only accounts for Io related Jupiter activity and neglects non-Io activity and solar. Just a WAG, but lets add in another 100 hours per year for solar and non-Io events so the annual total is (7 spectrographs x 218 hours x 14 MB/hr) = 21 GB. By comparison, each instrument recording and saving 24/7 is 123 GB saved annually on eachlocal station hard drive. All 7 instruments together, running continuously, are generating 858 GB (almost a terabyte per year). Given the above estimates, we are planning on storing in shared workspace/archival space less than 2.5% of the total data collected. Where, and for how long data will be stored has yet to be decided (short term workspace vs long term archival). Suggestions welcome from all re short term vs long term.
Reports
One stated goal of the group is to prepare reports of storms based on our receptions. The level of detail and content is yet to be decided – to say nothing of who will get stuck writing these reports (probably Wes since he left today’s telecon early). They will likely be archived on the Jove website. Everyone, please forward me your thoughts as to what the reports might contain.
Science
One of the key reasons for the effort to collaborate in this data collection with spaced spectrographs is to contribute to some science results. Specific ideas are presently sparse. Andy did relate what sounds to be a powerful analysis methodology which may be useful in separating the multitude of effects acting upon the spectral emissions we receive. (source related, interplanetary effects, earth’s ionosphere, polarization, modulation lanes, Faraday lanes, arcs, burst types and multiple source locations to name several that come to mind).Please – we need more team member input in this area. Andy maybe you could summarize the methodology in a paragraph or so, helping to introduce us to the terminology and capabilities.
Overlay and Common Settings
The ability to overlay spectra from different stations is an important first step. Problem is that different stations may be operating over different frequency ranges, using different color and offset settings and even different color pallets. The original idea was to decide on common settings to be used by all stations. Dave offered an alternate idea that appears to have a lot of merit. He feels that it will be possible (within limits) to normalize data from different stations and perform the overlay operation in software. In other words we can use whatever color gain/offset/color pallet we like at each station for the data that is streamed over the internet. Later, the raw data can be normalized (in frequency, time and amplitude) in software to allow valid data overlays and comparisons. In order to perform the normalization of spectrograph data an amplitude calibration is necessary. Dave will generate an array of numbers representing the spectrograph ADC input voltage for each channel the spectrograph vs a range of input temperatures.
Calibration
To begin testing the normalization process (Dave, let me now if you want to call it something else) Dave will need a raw data file from each station with a noise source running at several different temperatures. Wes is probably the best equipped to provide data for this test since it requires a multistep calibrated noise source. The data file will reveal the spectrograph frequency response, log-detector linearity, and dynamic range.
Andy and Jim will need additional equipment to perform these tests at their stations. I wonder if in the UFRO treasure trove there is a spare HP461 and a good step attenuator that might be calibrated and used as a loaner instrument for this test. This is not a long term solution but may be worth considering.
Homework
Chuck and Francisco – please some science goals.
Jim B – please send me your system diagram.
Dick – will work up guidelines for system diagrams.
Dave – will prepare a request for data to use in the normalization procedure
Andy - cloud storage and a paragraph on analysis technique
Chuck – please look over storage requirements and let us know what you think can be handled by the Jove archive system.
All – Please add to, subtract from, and correct this report.
NEXT MEETING 18 June 5PM EDT
rf 4 June 2013