This readme file describes the data files available at http://www.met.reading.ac.uk/~spate/solarstormwatch/data_files/ These files provide all of the data used to produce the Solar Stormwatch Catalogue of CMEs. The data processing is detailed in "The Solar Stormwatch CME catalogue: Results from the first space weather citizen science project", DOI: 10.1002/2014SW001119, available at http://onlinelibrary.wiley.com/doi/10.1002/2014SW001119/abstract If you use these data, please cite the above reference. Any questions, please email l.a.barnard@reading.ac.uk www.solarstormwatch.com - Take part in Solar Stormwatch. www.met.reading.ac.uk/~spate/solarstormwatch/ - Use the data. ########################################################################### File 1: trace_it_raw.txt This is the raw data output from Trace-it and Incoming-Trace it, which was used to produce the Solar Stormwatch CME catalogue. This data file is not the most up to date version, but is the specific version the catalogue was generated from. If you are interested in accessing a more recent version, please email us. The file is constructed from lines of varying length, which include an asset name, providing the details of the J-map the resulting time-elongation profile was made from, the user id and then the time-elongation coordinate pairs. The times are given as julian dates and the elongations are given in degrees. The coordinates are seperated by colons, and fields are seperated by commas, so a line of the file looks like: asset_name,user_id,t1:e1,t2:e2,t3:e3 Asset name takes two forms, depending on whether the time-elongation profile was generated by the Trace-it, or the Incoming Trace-it activity. Trace-it asset name: asset_name = yyyymmdd_hiX_jmap_PPP yyyymmdd gives a date, hiX gives the craft, either hiA or hiB. PPP, gives the position angle of the J-map. PPP=999 denotes the ecliptic plane Incoming Trace-it asset name: asset_name = yyyymmdd_HHMMSS_hiX_jmap_PPP yyyymmdd gives a date, HHMMSS gives the time of the most recent update to the realtime data hiX gives the craft, either hiA or hiB. PPP, gives the position angle of the J-map. user_id = a unique number identifying each user. tn:en = the time-elongation coordiante pairs. ########################################################################### File 2: trace_it_sci.txt This data file contains the subset of the data in the trace_it_raw.txt file that corresponds to the time-elongation profiles generated in the Trace-it activity. The format of the file is the same as the time-elongation profiles made from Trace-it assets, which is described in the File 1: trace_it_raw.txt section of this readme. ########################################################################### File 3: trace_it_brt.txt This data file contains the subset of the data in the trace_it_raw.txt file that corresponds to the time-elongation profiles generated in the Incoming Trace-it activity. The format of the file is the same as the time-elongation profiles made from Incoming Trace-it assets, which is described in the File 1: trace_it_raw.txt section of this readme. ########################################################################### File 4: ssw_sci_trace_raw.txt This is a reformatted version of the data in the trace_it_sci.txt file. This only contains the time-elongation profiles generated in the Trace-it activity. This file is more simple to read in certain programming languages than the trace_it_sci.txt file, as each line has the same number of fields. Each line gives one time-elongation coordinate pair. The format of each line is Craft Position_angle User_ID Date Elongation For example: hiA 95 239274 2007-12-01T15:28:31.475 7.09 hiA 95 239274 2007-12-02T09:39:40.328 14.22 ########################################################################### File 5: ssw_sci_lvl1_QC_fail.txt This file contains the time-elongation profiles that were identified as being spurious by the data selection rules used in section 4.1 of the catalogue paper. These data are formatted the same as those in ssw_sci_trace_raw.txt. ########################################################################### File 6: ssw_sci_lvl1_QC_pass.txt This file contains the time-elongation profiles that accepted by the data selection rules used in section 4.1 of the catalogue paper. These data are formatted the same as those in ssw_sci_trace_raw.txt. ########################################################################### File 7: ssw_sci_lvl2_QC_fail.txt This file contains the time-elongation profiles that were identified as diverging from the main cluster of time-elongation profiles, and were therefore removed to avoid biasing the calculation of the consensus profiles. This process is detailed in section 4.3 of the catalogue paper. These rejected profiles can be viewed in the plots included in the rejected_profiles folder - this is detailed below. ########################################################################### File 8: ssw_sci_lvl2_QC_pass.txt This file contains the time-elongation profiles that were identified as belonging to the main cluster of time-elongation profiles, and were used in the calculation of the consensus profiles. This process is detailed in section 4.3 of the catalogue paper. These rejected profiles can be viewed in the plots included in the rejected_profiles folder - this is detailed below. ########################################################################### File 4: spot_it_cme_times.txt This file contains a list of times when CMEs were probably first visible in the HI1A or HI1B field of view, or both fields of view. These estimates were generated by clustering the votes made from viewing HI1A and HI1B movies in the Spot activity. Each row contains the timing information about when CMEs first entered the HI FOV. The format of each line is as follows: Craft , Julian Date, Year, Month, Day, Hour, Minute. Craft can take four values, "A only", "B only", "A both" and "B both", indicating whether the CME was identified only in A or B or both. The "A both" and "B both" lines are matched pairs, but the times can differ slightly between the two, as the CMEs do not necessarily enter the HI1A and HI1B fields of view at the same time and this is a statistical estimate of the onset time. ########################################################################### Folder 1: rejected_profiles This folder contains a set of summary plots that show the results of the time-elongation profile clustering quality control, detailed in section 4.3 of the catalogue paper (DOI: 10.1002/2014SW001119). Each plot shows the accepted time elongation profiles in black, and time-elongation profiles identified as outliers in red. The filenames are formatted as xxx_cme_pnnn_yyyymmdd_pa_zzz.png xxx = craft id, sta or stb pnnn = provisional event number, differs from final event number as some events are removed due to lack of confidence in how well they have been characterised due to removing divering time-elongation profiles. yyyymmdd = onset date of the event zzz = the position angle of the J-map these time-elongation profiles were genereated from. ###########################################################################