Data Quality Reports for Session: 179498 User: shig1 Completed: 09/08/2016

TABLE OF CONTENTS

DQR IDSubjectData Streams Affected Data Quality Metric
D101220.2SGP/MFRSR/C1 - Shadowband Misalignmentsgpmfrsraod1michC1.c1Incorrect
D110607.4SGP/MFRSR/C1 - Shading Problemsgpmfrsraod1michC1.c1Incorrect
D140815.3SGP/AOD/ALL - Reprocessing Notice (RID 1212)sgpmfrsraod1michC1.c1Does not affect quality
D150217.7SGP/AOD/ALL - Reprocess: airmass field is incorrectly set to -1 when failing QC.sgpmfrsraod1michC1.c1Does not affect quality
D150812.3SGP/AOD/C1 - Unstable calibrationsgpmfrsraod1michC1.c1Incorrect


DQRID : D101220.2
Start DateStart TimeEnd DateEnd Time Data Quality Metric
11/23/2010190912/03/20101700Incorrect
Subject:
SGP/MFRSR/C1 - Shadowband Misalignment
DataStreams:sgpmfrsraod1michC1.c1
Description:
Shadowband slipped on the motor shaft. Maintenance resolved the issue on 20101203 @ 1700 
UTC. The shading issue is particularly bad. Do not use data covered by this DQR.
Measurements:sgpmfrsraod1michC1.c1:
  • Ratio of direct_normal_narrowband_filter5 to diffuse_hemisp_narrowband_filter5(direct_diffuse_ratio_filter5)
  • direct_diffuse_ratio_filter6
  • Ratio of direct_normal_narrowband_filter3 to diffuse_hemisp_narrowband_filter3(direct_diffuse_ratio_filter3)
  • Ratio of direct_normal_narrowband_filter4 to diffuse_hemisp_narrowband_filter4(direct_diffuse_ratio_filter4)
  • Ratio of direct_normal_narrowband_filter1 to diffuse_hemisp_narrowband_filter1(direct_diffuse_ratio_filter1)
  • Ratio of direct_normal_narrowband_filter2 to diffuse_hemisp_narrowband_filter2(direct_diffuse_ratio_filter2)
  • Aerosol optical depth filter 5(aerosol_optical_depth_filter5)
  • Aerosol optical depth filter 2(aerosol_optical_depth_filter2)
  • Aerosol optical depth filter 1(aerosol_optical_depth_filter1)
  • Aerosol optical depth filter 4(aerosol_optical_depth_filter4)
  • Aerosol optical depth filter 3(aerosol_optical_depth_filter3)
  • diffuse_hemisp_narrowband_filter1_raw
  • Direct Normal Broadband Irradiance, broadband scale applied(direct_normal_broadband)
  • hemisp_narrowband_filter2_raw
  • direct_horizontal_narrowband_filter2
  • hemisp_broadband_raw
  • Direct normal narrowband irradiance, filter 2(direct_normal_narrowband_filter2)
  • direct_horizontal_narrowband_filter3
  • Radiation, shortwave, direct normal irradiance, 415 nm wavelength(direct_normal_narrowband_filter1)
  • direct_horizontal_narrowband_filter1
  • Direct normal narrowband irradiance, filter 6(direct_normal_narrowband_filter6)
  • Direct normal narrowband irradiance, filter 5(direct_normal_narrowband_filter5)
  • Radiation, shortwave, direct normal irradiance, 673 nm wavelength(direct_normal_narrowband_filter4)
  • angstrom exponent(angstrom_exponent)
  • diffuse_hemisp_narrowband_filter3_raw
  • hemisp_narrowband_filter4_raw
  • Direct normal narrowband irradiance, filter 3(direct_normal_narrowband_filter3)
  • diffuse_hemisp_narrowband_filter6_raw
  • Hemispheric broadband irradiance*(hemisp_broadband)
  • direct_horizontal_broadband
  • diffuse_hemisp_broadband_raw
  • direct_horizontal_narrowband_filter6
  • direct_horizontal_narrowband_filter4
  • direct_horizontal_narrowband_filter5
  • diffuse_hemisp_narrowband_filter4_raw
  • hemisp_narrowband_filter6_raw
  • Radiation, shortwave, diffuse hemispheric irradiance, 940 nm wavelength(diffuse_hemisp_narrowband_filter6)
  • Radiation, shortwave, diffuse hemispheric irradiance, 870 nm wavelength(diffuse_hemisp_narrowband_filter5)
  • Radiation, shortwave, diffuse hemispheric irradiance, 500 nm wavelength (diffuse_hemisp_narrowband_filter2)
  • Radiation, shortwave, diffuse hemispheric irradiance, 415 nm wavelength (diffuse_hemisp_narrowband_filter1)
  • Radiation, shortwave, diffuse hemispheric irradiance, 673 nm wavelength (diffuse_hemisp_narrowband_filter4)
  • Radiation, shortwave, diffuse hemispheric irradiance, 615 nm wavelength (diffuse_hemisp_narrowband_filter3)
  • diffuse_hemisp_narrowband_filter5_raw
  • hemisp_narrowband_filter3_raw
  • Total optical depth direct narrowband filter 4(total_optical_depth_filter4)
  • Total optical depth direct narrowband filter 5(total_optical_depth_filter5)
  • Io_filter5
  • Io_filter3
  • Io_filter4
  • Io_filter1
  • Io_filter2
  • diffuse_hemisp_broadband
  • diffuse_hemisp_narrowband_filter2_raw
  • hemisp_narrowband_filter5_raw
  • Total optical depth direct narrowband filter 1(total_optical_depth_filter1)
  • Total optical depth direct narrowband filter 2(total_optical_depth_filter2)
  • Total optical depth direct narrowband filter 3(total_optical_depth_filter3)
  • Radiation, shortwave, hemispheric irradiance, 940 nm wavelength (hemisp_narrowband_filter6)
  • Radiation, shortwave, hemispheric irradiance, 870 nm wavelength(hemisp_narrowband_filter5)
  • Narrowband hemispheric irradiance, filter 4, nominal wavelength is 660 nm*(hemisp_narrowband_filter4)
  • hemisp_narrowband_filter1_raw
  • direct_diffuse_ratio_broadband
  • Radiation, shortwave, hemispheric irradiance, 500 nm wavelength(hemisp_narrowband_filter2)
  • Radiation, shortwave, hemispheric irradiance, 615 nm wavelength(hemisp_narrowband_filter3)
  • Radiation, shortwave, hemispheric irradiance, 415 nm wavelength (hemisp_narrowband_filter1)

Back To Table of Contents

DQRID : D110607.4
Start DateStart TimeEnd DateEnd Time Data Quality Metric
04/05/2011140004/05/20111900Incorrect
Subject:
SGP/MFRSR/C1 - Shading Problem
DataStreams:sgpmfrsraod1michC1.c1
Description:
On 20110405 in the morning there is a signature of a shading issue.  This is the only time 
it is evident.  Possible it was noticed right away during a regular site visit.  Data 
the rest of the month look fine.
Measurements:sgpmfrsraod1michC1.c1:
  • Ratio of direct_normal_narrowband_filter5 to diffuse_hemisp_narrowband_filter5(direct_diffuse_ratio_filter5)
  • direct_diffuse_ratio_filter6
  • Ratio of direct_normal_narrowband_filter3 to diffuse_hemisp_narrowband_filter3(direct_diffuse_ratio_filter3)
  • Ratio of direct_normal_narrowband_filter4 to diffuse_hemisp_narrowband_filter4(direct_diffuse_ratio_filter4)
  • Ratio of direct_normal_narrowband_filter1 to diffuse_hemisp_narrowband_filter1(direct_diffuse_ratio_filter1)
  • Ratio of direct_normal_narrowband_filter2 to diffuse_hemisp_narrowband_filter2(direct_diffuse_ratio_filter2)
  • Aerosol optical depth filter 5(aerosol_optical_depth_filter5)
  • Aerosol optical depth filter 2(aerosol_optical_depth_filter2)
  • Aerosol optical depth filter 1(aerosol_optical_depth_filter1)
  • Aerosol optical depth filter 4(aerosol_optical_depth_filter4)
  • Aerosol optical depth filter 3(aerosol_optical_depth_filter3)
  • diffuse_hemisp_narrowband_filter1_raw
  • Direct Normal Broadband Irradiance, broadband scale applied(direct_normal_broadband)
  • hemisp_narrowband_filter2_raw
  • direct_horizontal_narrowband_filter2
  • hemisp_broadband_raw
  • Direct normal narrowband irradiance, filter 2(direct_normal_narrowband_filter2)
  • direct_horizontal_narrowband_filter3
  • Radiation, shortwave, direct normal irradiance, 415 nm wavelength(direct_normal_narrowband_filter1)
  • direct_horizontal_narrowband_filter1
  • Direct normal narrowband irradiance, filter 6(direct_normal_narrowband_filter6)
  • Direct normal narrowband irradiance, filter 5(direct_normal_narrowband_filter5)
  • Radiation, shortwave, direct normal irradiance, 673 nm wavelength(direct_normal_narrowband_filter4)
  • angstrom exponent(angstrom_exponent)
  • diffuse_hemisp_narrowband_filter3_raw
  • hemisp_narrowband_filter4_raw
  • Direct normal narrowband irradiance, filter 3(direct_normal_narrowband_filter3)
  • diffuse_hemisp_narrowband_filter6_raw
  • Hemispheric broadband irradiance*(hemisp_broadband)
  • direct_horizontal_broadband
  • diffuse_hemisp_broadband_raw
  • direct_horizontal_narrowband_filter6
  • direct_horizontal_narrowband_filter4
  • direct_horizontal_narrowband_filter5
  • diffuse_hemisp_narrowband_filter4_raw
  • hemisp_narrowband_filter6_raw
  • Radiation, shortwave, diffuse hemispheric irradiance, 940 nm wavelength(diffuse_hemisp_narrowband_filter6)
  • Radiation, shortwave, diffuse hemispheric irradiance, 870 nm wavelength(diffuse_hemisp_narrowband_filter5)
  • Radiation, shortwave, diffuse hemispheric irradiance, 500 nm wavelength (diffuse_hemisp_narrowband_filter2)
  • Radiation, shortwave, diffuse hemispheric irradiance, 415 nm wavelength (diffuse_hemisp_narrowband_filter1)
  • Radiation, shortwave, diffuse hemispheric irradiance, 673 nm wavelength (diffuse_hemisp_narrowband_filter4)
  • Radiation, shortwave, diffuse hemispheric irradiance, 615 nm wavelength (diffuse_hemisp_narrowband_filter3)
  • diffuse_hemisp_narrowband_filter5_raw
  • hemisp_narrowband_filter3_raw
  • Total optical depth direct narrowband filter 4(total_optical_depth_filter4)
  • Total optical depth direct narrowband filter 5(total_optical_depth_filter5)
  • Io_filter5
  • Io_filter3
  • Io_filter4
  • Io_filter1
  • Io_filter2
  • diffuse_hemisp_broadband
  • diffuse_hemisp_narrowband_filter2_raw
  • hemisp_narrowband_filter5_raw
  • Total optical depth direct narrowband filter 1(total_optical_depth_filter1)
  • Total optical depth direct narrowband filter 2(total_optical_depth_filter2)
  • Total optical depth direct narrowband filter 3(total_optical_depth_filter3)
  • Radiation, shortwave, hemispheric irradiance, 940 nm wavelength (hemisp_narrowband_filter6)
  • Radiation, shortwave, hemispheric irradiance, 870 nm wavelength(hemisp_narrowband_filter5)
  • Narrowband hemispheric irradiance, filter 4, nominal wavelength is 660 nm*(hemisp_narrowband_filter4)
  • hemisp_narrowband_filter1_raw
  • direct_diffuse_ratio_broadband
  • Radiation, shortwave, hemispheric irradiance, 500 nm wavelength(hemisp_narrowband_filter2)
  • Radiation, shortwave, hemispheric irradiance, 615 nm wavelength(hemisp_narrowband_filter3)
  • Radiation, shortwave, hemispheric irradiance, 415 nm wavelength (hemisp_narrowband_filter1)

Back To Table of Contents

DQRID : D140815.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
10/28/2012000011/01/20132359Does not affect quality
Subject:
SGP/AOD/ALL - Reprocessing Notice (RID 1212)
DataStreams:sgpmfrsraod1michC1.c1
Description:
See below for details of reprocessing that was completed on 20160127.  Original 
DQR category: 4 (Red, Incorrect).

-----------------------------------------------------------

For reasons not entirely understood, on or about Oct 28, 2012 the MFRSR AOD Value Added 
Product began to experience infrequent but serious data corruption issues.  This is evident 
in the data files from SGP as irradiance fields, calibrations, and AODs taking nonsense 
values – sometimes NaN, Inf, or other values orders of magnitude out of bounds with 
normal behavior.  The behavior is sometimes abrupt with drastic changes observed from one day 
to the next, but not within a given day.  This behavior was not reproducible when 
reprocessing on the development system. 

We have developed a new version of the MFRSR AOD Value Added Product using a different 
library suite and have confirmed successful reproduction of the existing product when the 
existing product was not corrupt, and consistent replacement of the corrupt periods with 
reliable results.
Measurements:sgpmfrsraod1michC1.c1:
  • normalized_transmittance_filter4
  • normalized_transmittance_filter5
  • normalized_transmittance_filter2
  • Ratio of direct_normal_narrowband_filter5 to diffuse_hemisp_narrowband_filter5(direct_diffuse_ratio_filter5)
  • normalized_transmittance_filter3
  • Ratio of direct_normal_narrowband_filter3 to diffuse_hemisp_narrowband_filter3(direct_diffuse_ratio_filter3)
  • Ratio of direct_normal_narrowband_filter4 to diffuse_hemisp_narrowband_filter4(direct_diffuse_ratio_filter4)
  • normalized_transmittance_filter1
  • Ratio of direct_normal_narrowband_filter1 to diffuse_hemisp_narrowband_filter1(direct_diffuse_ratio_filter1)
  • Ratio of direct_normal_narrowband_filter2 to diffuse_hemisp_narrowband_filter2(direct_diffuse_ratio_filter2)
  • Aerosol optical depth filter 5(aerosol_optical_depth_filter5)
  • Aerosol optical depth filter 2(aerosol_optical_depth_filter2)
  • Aerosol optical depth filter 1(aerosol_optical_depth_filter1)
  • Aerosol optical depth filter 4(aerosol_optical_depth_filter4)
  • Aerosol optical depth filter 3(aerosol_optical_depth_filter3)
  • Total optical depth direct narrowband filter 4(total_optical_depth_filter4)
  • Total optical depth direct narrowband filter 5(total_optical_depth_filter5)
  • Io_filter5
  • Io_filter3
  • Io_filter4
  • Io_filter1
  • Io_filter2
  • Total optical depth direct narrowband filter 1(total_optical_depth_filter1)
  • Total optical depth direct narrowband filter 2(total_optical_depth_filter2)
  • Total optical depth direct narrowband filter 3(total_optical_depth_filter3)
  • direct_horizontal_narrowband_filter2
  • Direct normal narrowband irradiance, filter 2(direct_normal_narrowband_filter2)
  • direct_horizontal_narrowband_filter3
  • Radiation, shortwave, direct normal irradiance, 415 nm wavelength(direct_normal_narrowband_filter1)
  • Radiation, shortwave, hemispheric irradiance, 870 nm wavelength(hemisp_narrowband_filter5)
  • Narrowband hemispheric irradiance, filter 4, nominal wavelength is 660 nm*(hemisp_narrowband_filter4)
  • direct_horizontal_narrowband_filter1
  • nominal_calibration_factor_filter1
  • Direct normal narrowband irradiance, filter 5(direct_normal_narrowband_filter5)
  • Radiation, shortwave, direct normal irradiance, 673 nm wavelength(direct_normal_narrowband_filter4)
  • Direct normal narrowband irradiance, filter 3(direct_normal_narrowband_filter3)
  • nominal_calibration_factor_filter5
  • nominal_calibration_factor_filter4
  • nominal_calibration_factor_filter3
  • nominal_calibration_factor_filter2
  • direct_horizontal_narrowband_filter4
  • direct_horizontal_narrowband_filter5
  • Radiation, shortwave, diffuse hemispheric irradiance, 870 nm wavelength(diffuse_hemisp_narrowband_filter5)
  • Radiation, shortwave, diffuse hemispheric irradiance, 500 nm wavelength (diffuse_hemisp_narrowband_filter2)
  • Radiation, shortwave, hemispheric irradiance, 500 nm wavelength(hemisp_narrowband_filter2)
  • Radiation, shortwave, diffuse hemispheric irradiance, 415 nm wavelength (diffuse_hemisp_narrowband_filter1)
  • Radiation, shortwave, hemispheric irradiance, 615 nm wavelength(hemisp_narrowband_filter3)
  • Radiation, shortwave, diffuse hemispheric irradiance, 673 nm wavelength (diffuse_hemisp_narrowband_filter4)
  • Radiation, shortwave, diffuse hemispheric irradiance, 615 nm wavelength (diffuse_hemisp_narrowband_filter3)
  • Radiation, shortwave, hemispheric irradiance, 415 nm wavelength (hemisp_narrowband_filter1)

Back To Table of Contents

DQRID : D150217.7
Start DateStart TimeEnd DateEnd Time Data Quality Metric
10/01/2010000003/31/20132359Does not affect quality
Subject:
SGP/AOD/ALL - Reprocess: airmass field is incorrectly set to -1 when failing QC.
DataStreams:sgpmfrsraod1michC1.c1
Description:
The qc_airmass field indicates that values in the airmass field are set to -9999, the 
missing_value, when qc_airmass = 1 (QC bit 1 has tripped). In reality, the values are set to 
-1 and will not be filtered out by programs that automatically remove missing values. 
This will be fixed in a future reprocessing task.
Measurements:sgpmfrsraod1michC1.c1:
  • airmass

Back To Table of Contents

DQRID : D150812.3
Start DateStart TimeEnd DateEnd Time Data Quality Metric
04/01/2005000004/30/20052359Incorrect
Subject:
SGP/AOD/C1 - Unstable calibration
DataStreams:sgpmfrsraod1michC1.c1
Description:
Calibration unstable. MFRSR C1 produced substantial AOD discrepancies (up to 0.05) in 
respect to AERONET and MFRSR E13.
Measurements:sgpmfrsraod1michC1.c1:
  • Ratio of direct_normal_narrowband_filter5 to diffuse_hemisp_narrowband_filter5(direct_diffuse_ratio_filter5)
  • direct_diffuse_ratio_filter6
  • Ratio of direct_normal_narrowband_filter3 to diffuse_hemisp_narrowband_filter3(direct_diffuse_ratio_filter3)
  • Ratio of direct_normal_narrowband_filter4 to diffuse_hemisp_narrowband_filter4(direct_diffuse_ratio_filter4)
  • Ratio of direct_normal_narrowband_filter1 to diffuse_hemisp_narrowband_filter1(direct_diffuse_ratio_filter1)
  • Ratio of direct_normal_narrowband_filter2 to diffuse_hemisp_narrowband_filter2(direct_diffuse_ratio_filter2)
  • Aerosol optical depth filter 5(aerosol_optical_depth_filter5)
  • Aerosol optical depth filter 2(aerosol_optical_depth_filter2)
  • Aerosol optical depth filter 1(aerosol_optical_depth_filter1)
  • Aerosol optical depth filter 4(aerosol_optical_depth_filter4)
  • Aerosol optical depth filter 3(aerosol_optical_depth_filter3)
  • Direct Normal Broadband Irradiance, broadband scale applied(direct_normal_broadband)
  • alltime_hemisp_broadband
  • direct_horizontal_narrowband_filter2
  • Direct normal narrowband irradiance, filter 2(direct_normal_narrowband_filter2)
  • direct_horizontal_narrowband_filter3
  • Radiation, shortwave, direct normal irradiance, 415 nm wavelength(direct_normal_narrowband_filter1)
  • direct_horizontal_narrowband_filter1
  • Direct normal narrowband irradiance, filter 6(direct_normal_narrowband_filter6)
  • Direct normal narrowband irradiance, filter 5(direct_normal_narrowband_filter5)
  • Radiation, shortwave, direct normal irradiance, 673 nm wavelength(direct_normal_narrowband_filter4)
  • angstrom exponent(angstrom_exponent)
  • Direct normal narrowband irradiance, filter 3(direct_normal_narrowband_filter3)
  • direct_horizontal_narrowband_filter6
  • direct_horizontal_narrowband_filter4
  • direct_horizontal_narrowband_filter5
  • alltime_hemisp_narrowband_filter5
  • alltime_hemisp_narrowband_filter6
  • Radiation, shortwave, diffuse hemispheric irradiance, 940 nm wavelength(diffuse_hemisp_narrowband_filter6)
  • Radiation, shortwave, diffuse hemispheric irradiance, 870 nm wavelength(diffuse_hemisp_narrowband_filter5)
  • Radiation, shortwave, diffuse hemispheric irradiance, 500 nm wavelength (diffuse_hemisp_narrowband_filter2)
  • Radiation, shortwave, diffuse hemispheric irradiance, 415 nm wavelength (diffuse_hemisp_narrowband_filter1)
  • Radiation, shortwave, diffuse hemispheric irradiance, 673 nm wavelength (diffuse_hemisp_narrowband_filter4)
  • Radiation, shortwave, diffuse hemispheric irradiance, 615 nm wavelength (diffuse_hemisp_narrowband_filter3)
  • alltime_hemisp_narrowband_filter4
  • alltime_hemisp_narrowband_filter3
  • alltime_hemisp_narrowband_filter2
  • alltime_hemisp_narrowband_filter1
  • Total optical depth direct narrowband filter 4(total_optical_depth_filter4)
  • Total optical depth direct narrowband filter 5(total_optical_depth_filter5)
  • Io_filter5
  • Io_filter3
  • Io_filter4
  • Io_filter1
  • Io_filter2
  • Total optical depth direct narrowband filter 1(total_optical_depth_filter1)
  • Total optical depth direct narrowband filter 2(total_optical_depth_filter2)
  • Total optical depth direct narrowband filter 3(total_optical_depth_filter3)
  • Radiation, shortwave, hemispheric irradiance, 940 nm wavelength (hemisp_narrowband_filter6)
  • Radiation, shortwave, hemispheric irradiance, 870 nm wavelength(hemisp_narrowband_filter5)
  • Narrowband hemispheric irradiance, filter 4, nominal wavelength is 660 nm*(hemisp_narrowband_filter4)
  • Radiation, shortwave, hemispheric irradiance, 500 nm wavelength(hemisp_narrowband_filter2)
  • Radiation, shortwave, hemispheric irradiance, 615 nm wavelength(hemisp_narrowband_filter3)
  • Radiation, shortwave, hemispheric irradiance, 415 nm wavelength (hemisp_narrowband_filter1)

Back To Table of Contents


END OF DATA