Data Quality Reports for Session: 179167 User: burrowss1 Completed: 08/22/2016


TABLE OF CONTENTS

DQR IDSubjectData Streams Affected Data Quality Metric
D140815.3SGP/AOD/ALL - Reprocessing Notice (RID 1212)sgpmfrsraod1michC1.c1, sgpmfrsraod1michE13.s1Does not affect quality
D150217.7SGP/AOD/ALL - Reprocess: airmass field is incorrectly set to -1 when failing QC.sgpmfrsraod1michC1.c1Does not affect quality


DQRID : D140815.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
10/28/2012000011/01/20132359Does not affect quality
Subject:
SGP/AOD/ALL - Reprocessing Notice (RID 1212)
DataStreams:sgpmfrsraod1michC1.c1, sgpmfrsraod1michE13.s1
Description:
See below for details of reprocessing that was completed on 20160127.  Original 
DQR category: 4 (Red, Incorrect).

-----------------------------------------------------------

For reasons not entirely understood, on or about Oct 28, 2012 the MFRSR AOD Value Added 
Product began to experience infrequent but serious data corruption issues.  This is evident 
in the data files from SGP as irradiance fields, calibrations, and AODs taking nonsense 
values – sometimes NaN, Inf, or other values orders of magnitude out of bounds with 
normal behavior.  The behavior is sometimes abrupt with drastic changes observed from one day 
to the next, but not within a given day.  This behavior was not reproducible when 
reprocessing on the development system. 

We have developed a new version of the MFRSR AOD Value Added Product using a different 
library suite and have confirmed successful reproduction of the existing product when the 
existing product was not corrupt, and consistent replacement of the corrupt periods with 
reliable results.
Measurements:sgpmfrsraod1michC1.c1:
  • Ratio of direct_normal_narrowband_filter5 to diffuse_hemisp_narrowband_filter5(direct_diffuse_ratio_filter5)
  • Ratio of direct_normal_narrowband_filter3 to diffuse_hemisp_narrowband_filter3(direct_diffuse_ratio_filter3)
  • Ratio of direct_normal_narrowband_filter4 to diffuse_hemisp_narrowband_filter4(direct_diffuse_ratio_filter4)
  • Ratio of direct_normal_narrowband_filter1 to diffuse_hemisp_narrowband_filter1(direct_diffuse_ratio_filter1)
  • Ratio of direct_normal_narrowband_filter2 to diffuse_hemisp_narrowband_filter2(direct_diffuse_ratio_filter2)
  • direct_horizontal_narrowband_filter2
  • direct_horizontal_narrowband_filter3
  • direct_horizontal_narrowband_filter1
  • direct_horizontal_narrowband_filter4
  • direct_horizontal_narrowband_filter5
  • Radiation, shortwave, hemispheric irradiance, 870 nm wavelength(hemisp_narrowband_filter5)
  • Narrowband hemispheric irradiance, filter 4, nominal wavelength is 660 nm*(hemisp_narrowband_filter4)
  • nominal_calibration_factor_filter1
  • nominal_calibration_factor_filter5
  • nominal_calibration_factor_filter4
  • nominal_calibration_factor_filter3
  • nominal_calibration_factor_filter2
  • Radiation, shortwave, hemispheric irradiance, 500 nm wavelength(hemisp_narrowband_filter2)
  • Radiation, shortwave, hemispheric irradiance, 615 nm wavelength(hemisp_narrowband_filter3)
  • Radiation, shortwave, hemispheric irradiance, 415 nm wavelength (hemisp_narrowband_filter1)
  • normalized_transmittance_filter4
  • normalized_transmittance_filter5
  • normalized_transmittance_filter2
  • normalized_transmittance_filter3
  • normalized_transmittance_filter1
  • Aerosol optical depth filter 5(aerosol_optical_depth_filter5)
  • Aerosol optical depth filter 2(aerosol_optical_depth_filter2)
  • Aerosol optical depth filter 1(aerosol_optical_depth_filter1)
  • Aerosol optical depth filter 4(aerosol_optical_depth_filter4)
  • Aerosol optical depth filter 3(aerosol_optical_depth_filter3)
  • Direct normal narrowband irradiance, filter 2(direct_normal_narrowband_filter2)
  • Radiation, shortwave, direct normal irradiance, 415 nm wavelength(direct_normal_narrowband_filter1)
  • Direct normal narrowband irradiance, filter 5(direct_normal_narrowband_filter5)
  • Radiation, shortwave, direct normal irradiance, 673 nm wavelength(direct_normal_narrowband_filter4)
  • Direct normal narrowband irradiance, filter 3(direct_normal_narrowband_filter3)
  • Radiation, shortwave, diffuse hemispheric irradiance, 870 nm wavelength(diffuse_hemisp_narrowband_filter5)
  • Radiation, shortwave, diffuse hemispheric irradiance, 500 nm wavelength (diffuse_hemisp_narrowband_filter2)
  • Radiation, shortwave, diffuse hemispheric irradiance, 415 nm wavelength (diffuse_hemisp_narrowband_filter1)
  • Radiation, shortwave, diffuse hemispheric irradiance, 673 nm wavelength (diffuse_hemisp_narrowband_filter4)
  • Radiation, shortwave, diffuse hemispheric irradiance, 615 nm wavelength (diffuse_hemisp_narrowband_filter3)
  • Total optical depth direct narrowband filter 4(total_optical_depth_filter4)
  • Total optical depth direct narrowband filter 5(total_optical_depth_filter5)
  • Io_filter5
  • Io_filter3
  • Io_filter4
  • Io_filter1
  • Io_filter2
  • Total optical depth direct narrowband filter 1(total_optical_depth_filter1)
  • Total optical depth direct narrowband filter 2(total_optical_depth_filter2)
  • Total optical depth direct narrowband filter 3(total_optical_depth_filter3)

sgpmfrsraod1michE13.s1:
  • Ratio of direct_normal_narrowband_filter2 to diffuse_hemisp_narrowband_filter2(direct_diffuse_ratio_filter2)
  • Ratio of direct_normal_narrowband_filter3 to diffuse_hemisp_narrowband_filter3(direct_diffuse_ratio_filter3)
  • Ratio of direct_normal_narrowband_filter1 to diffuse_hemisp_narrowband_filter1(direct_diffuse_ratio_filter1)
  • Ratio of direct_normal_narrowband_filter4 to diffuse_hemisp_narrowband_filter4(direct_diffuse_ratio_filter4)
  • Ratio of direct_normal_narrowband_filter5 to diffuse_hemisp_narrowband_filter5(direct_diffuse_ratio_filter5)
  • nominal_calibration_factor_filter3
  • Radiation, shortwave, direct normal irradiance, 673 nm wavelength(direct_normal_narrowband_filter4)
  • Direct normal narrowband irradiance, filter 5(direct_normal_narrowband_filter5)
  • nominal_calibration_factor_filter4
  • nominal_calibration_factor_filter1
  • Direct normal narrowband irradiance, filter 2(direct_normal_narrowband_filter2)
  • nominal_calibration_factor_filter2
  • Direct normal narrowband irradiance, filter 3(direct_normal_narrowband_filter3)
  • Radiation, shortwave, direct normal irradiance, 415 nm wavelength(direct_normal_narrowband_filter1)
  • nominal_calibration_factor_filter5
  • Radiation, shortwave, diffuse hemispheric irradiance, 415 nm wavelength (diffuse_hemisp_narrowband_filter1)
  • Io_filter1
  • Radiation, shortwave, hemispheric irradiance, 870 nm wavelength(hemisp_narrowband_filter5)
  • Radiation, shortwave, hemispheric irradiance, 500 nm wavelength(hemisp_narrowband_filter2)
  • Radiation, shortwave, hemispheric irradiance, 415 nm wavelength (hemisp_narrowband_filter1)
  • Narrowband hemispheric irradiance, filter 4, nominal wavelength is 660 nm*(hemisp_narrowband_filter4)
  • Radiation, shortwave, hemispheric irradiance, 615 nm wavelength(hemisp_narrowband_filter3)
  • Radiation, shortwave, diffuse hemispheric irradiance, 673 nm wavelength (diffuse_hemisp_narrowband_filter4)
  • Radiation, shortwave, diffuse hemispheric irradiance, 870 nm wavelength(diffuse_hemisp_narrowband_filter5)
  • Radiation, shortwave, diffuse hemispheric irradiance, 500 nm wavelength (diffuse_hemisp_narrowband_filter2)
  • Radiation, shortwave, diffuse hemispheric irradiance, 615 nm wavelength (diffuse_hemisp_narrowband_filter3)
  • Io_filter5
  • Io_filter4
  • Io_filter3
  • Io_filter2
  • direct_horizontal_narrowband_filter4
  • direct_horizontal_narrowband_filter3
  • direct_horizontal_narrowband_filter5
  • direct_horizontal_narrowband_filter1
  • direct_horizontal_narrowband_filter2
  • Total optical depth direct narrowband filter 1(total_optical_depth_filter1)
  • Total optical depth direct narrowband filter 2(total_optical_depth_filter2)
  • Total optical depth direct narrowband filter 3(total_optical_depth_filter3)
  • Total optical depth direct narrowband filter 4(total_optical_depth_filter4)
  • Total optical depth direct narrowband filter 5(total_optical_depth_filter5)
  • normalized_transmittance_filter4
  • normalized_transmittance_filter3
  • normalized_transmittance_filter2
  • normalized_transmittance_filter1
  • normalized_transmittance_filter5
  • Aerosol optical depth filter 4(aerosol_optical_depth_filter4)
  • Aerosol optical depth filter 5(aerosol_optical_depth_filter5)
  • Aerosol optical depth filter 2(aerosol_optical_depth_filter2)
  • Aerosol optical depth filter 3(aerosol_optical_depth_filter3)
  • Aerosol optical depth filter 1(aerosol_optical_depth_filter1)


Back To Table of Contents

DQRID : D150217.7
Start DateStart TimeEnd DateEnd Time Data Quality Metric
10/01/2010000003/31/20132359Does not affect quality
Subject:
SGP/AOD/ALL - Reprocess: airmass field is incorrectly set to -1 when failing QC.
DataStreams:sgpmfrsraod1michC1.c1
Description:
The qc_airmass field indicates that values in the airmass field are set to -9999, the 
missing_value, when qc_airmass = 1 (QC bit 1 has tripped). In reality, the values are set to 
-1 and will not be filtered out by programs that automatically remove missing values. 
This will be fixed in a future reprocessing task.
Measurements:sgpmfrsraod1michC1.c1:
  • airmass


Back To Table of Contents



END OF DATA