Data Quality Reports for Session: 153414 User: wandjiw1 Completed: 10/07/2013


TABLE OF CONTENTS

DQR IDSubjectData Streams Affected
D080222.2SGP/RSS/C1 - Stability and nonlinearity correctionssgprssC1.00, sgprssC1.b1
D130725.2SGP/SURFSPECALB/C1 - Data processing problemsgpsurfspecalb1mlawerC1.c1, sgpsurfspecalb1mlawerC1.s1


DQRID : D080222.2
Start DateStart TimeEnd DateEnd Time
06/01/2003120009/27/20070017
Subject:
SGP/RSS/C1 - Stability and nonlinearity corrections
DataStreams:sgprssC1.00, sgprssC1.b1
Description:
From the very beginning after deployment in May 2003 we observed several effects that we 
did not anticipate during the pre-deployment lab test.   They were: (1) Rapid drop in 
responsivity; (2) Responsivity having 1/lambda wavelike periodicity; (3) Appearance of 
nonlinearity within 3 months; (4) Larger than expected diurnal wavelength changes and long term 
wavelength drift. 

Right away we responded with development of correction algorithms and methods.  (1) and 
(2) are corrected to within 2-3% with biweekly lamp calibrations; (3) Nonlinearity factor 
is derived from calibration data and applied in correction; and (4) is efficiently 
corrected with Fourier correlation algorithm applied to every spectrum (once a minute).

Furthermore we perform Langley regression processing  (not a part of official data stream) 
that corrects longer term drifts in responsivity and  should correct calibration lamp 
biases.  The Vo's from Langley regressions are available via RSS  web page.

The overhaul of the instrument is planned to eliminate or at least reduce  nonlinerarity 
stability problems.  We hope that after the overhaul data processing would  be simplified 
and the frequency of calibrations would be reduced.
Measurements:sgprssC1.00:
  • AVHRR satellite images for Darwin from BOM (RAW)(raw)

sgprssC1.b1:
  • sdf_dn
  • sdf_diff
  • Wavelength of spectrum data(wavelength)
  • Radiation, Shortwave, Downwelling, Diffuse(diffuse)
  • blue_shift
  • sdf_th
  • red_shift
  • Radiation, Shortwave, Downwelling, Direct normal(directnormal)
  • Radiation, Shortwave, Downwelling, Global(totalhorizontal)


Back To Table of Contents

DQRID : D130725.2
Start DateStart TimeEnd DateEnd Time
01/01/2004000001/26/20130000
Subject:
SGP/SURFSPECALB/C1 - Data processing problem
DataStreams:sgpsurfspecalb1mlawerC1.c1, sgpsurfspecalb1mlawerC1.s1
Description:
An intermediate process, surfspecalb_transform, of the surfspecalb1mlawer VAP incorrectly 
treated its input datastream (intermediate datastream surfspecalbmfrsr.c0) as it had a 
bin alignment equal to the end of the bin, but it was actually the middle of the bin.  The 
result was a shifting of the values with respect to time 10 seconds to the left.  The 
impact on the primary measurement, spectral albedo, was considered to be less than the 
uncertainty of that measurement.  The attached plot 
sgpsurfspecalb1mlawerC1.20040101.000000.spectral_albedo.png, shows the before and after values of the spectral albedo (in red, the 
blue line is not visible because the values are almost the same), and the absolute value 
of the difference of these values (in purple).  The axis on the left is for the red line 
representing albedo, the axis for the difference (purple line) is on the right. 
The problem occurs for all measurements dimensioned by time.
Measurements:sgpsurfspecalb1mlawerC1.c1:
  • hemisp_narrowband_mfrsr
  • lat
  • be_hemisp_broadband_status_mfrsr
  • be_surface_albedo_mfr_broadband_10m_status
  • be_up_hemisp_narrowband_status_mfr25mC1
  • Broadband albedo at 10m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_10m)
  • hemisp_narrowband_mfrsrC1
  • PSP broadband surface albedo at the 10m tower
    (up_short_hemisp_beflux1longC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_10m)
  • hemisp_broadband_mfrsrC1
  • Best estimate MFR narrowband surface albedo at the 10m tower(be_surface_albedo_mfr_narrowband_10m)
  • hemisp_broadband_facility_mfrsr
  • short_direct_normal_beflux1longC1
  • direct_normal_broadband_mfrsrE13
  • up_hemisp_narrowband_mfr10mC1
  • Broadband albedo at 25m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_25m)
  • up_hemisp_narrowband_mfr25mC1
  • Best estimate MFR broadband surface albedo at the 10m tower(be_surface_albedo_mfr_broadband_10m)
  • estimated_spectral_albedo_25m
  • direct_normal_narrowband_mfrsrC1
  • hemisp_broadband_mfrsrE13
  • be_up_hemisp_narrowband_status_mfr10mC1
  • be_up_hemisp_broadband_status_mfr10mC1
  • direct_normal_broadband_mfrsrC1
  • be_surface_albedo_mfr_narrowband_10m_status
  • cosine_solar_zenith_angle_mfr10mC1
  • be_hemisp_narrowband_status_mfrsr
  • up_hemisp_broadband_mfr10mC1
  • Best estimate MFR broadband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_broadband_25m)
  • be_up_hemisp_broadband_status_mfr25mC1
  • hemisp_narrowband_mfrsrE13
  • be_up_hemisp_narrowband_mfr25mC1
  • lon
  • Derived surface type under the 10 tower(surface_type_10m_tower)
  • filter
  • up_short_hemisp_irt25mC1
  • Best estimate MFR narrowband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_narrowband_25m)
  • base_time
  • diffuse_hemisp_broadband_mfrsrE13
  • estimated_spectral_albedo_10m
  • be_up_hemisp_narrowband_mfr10mC1
  • up_hemisp_broadband_mfr25mC1
  • down_short_hemisp_beflux1longC1
  • surface_albedo_mfr_broadband_25m
  • wavenumber
  • up_short_hemisp_beflux1longC1
  • Derived surface type under the 25 tower(surface_type_25m_tower)
  • diffuse_hemisp_narrowband_mfrsrE13
  • surface_albedo_mfr_broadband_10m
  • PSP broadband surface albedo at 25m on the 60m tower
    (up_short_hemisp_irt25mC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_25m)
  • surface_albedo_mfr_narrowband_25m
  • be_up_hemisp_broadband_mfr10mC1
  • diffuse_hemisp_narrowband_mfrsrC1
  • be_up_hemisp_broadband_mfr25mC1
  • be_surface_albedo_mfr_broadband_25m_status
  • be_surface_albedo_mfr_narrowband_25m_status
  • be_hemisp_narrowband_mfrsr
  • direct_normal_narrowband_mfrsrE13
  • be_hemisp_broadband_mfrsr
  • diffuse_hemisp_broadband_mfrsrC1
  • surface_albedo_mfr_narrowband_10m
  • hemisp_narrowband_facility_mfrsr
  • hemisp_broadband_mfrsr
  • cosine_solar_zenith_angle_mfr25mC1
  • alt
  • time
  • time_offset

sgpsurfspecalb1mlawerC1.s1:
  • estimated_spectral_albedo_10m
  • up_short_hemisp_irt25mC1
  • cosine_solar_zenith_angle_mfr10mC1
  • be_hemisp_broadband_status_mfrsr
  • down_short_hemisp_beflux1longC1
  • be_up_hemisp_broadband_mfr10mC1
  • be_hemisp_broadband_mfrsr
  • be_up_hemisp_broadband_mfr25mC1
  • Best estimate MFR broadband surface albedo at the 10m tower(be_surface_albedo_mfr_broadband_10m)
  • base_time
  • be_up_hemisp_broadband_status_mfr10mC1
  • Best estimate MFR narrowband surface albedo at the 10m tower(be_surface_albedo_mfr_narrowband_10m)
  • be_hemisp_narrowband_mfrsr
  • be_hemisp_narrowband_status_mfrsr
  • estimated_spectral_albedo_25m
  • time
  • be_up_hemisp_narrowband_mfr25mC1
  • Derived surface type under the 10 tower(surface_type_10m_tower)
  • be_surface_albedo_mfr_narrowband_10m_status
  • time_offset
  • Broadband albedo at 10m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_10m)
  • up_short_hemisp_beflux1longC1
  • Derived surface type under the 25 tower(surface_type_25m_tower)
  • Best estimate MFR broadband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_broadband_25m)
  • Best estimate MFR narrowband surface albedo at 25m on the 60m tower(be_surface_albedo_mfr_narrowband_25m)
  • be_surface_albedo_mfr_broadband_10m_status
  • be_surface_albedo_mfr_broadband_25m_status
  • be_up_hemisp_narrowband_status_mfr10mC1
  • be_surface_albedo_mfr_narrowband_25m_status
  • be_up_hemisp_broadband_status_mfr25mC1
  • cosine_solar_zenith_angle_mfr25mC1
  • filter
  • short_direct_normal_beflux1longC1
  • hemisp_broadband_facility_mfrsr
  • alt
  • lat
  • lon
  • be_up_hemisp_narrowband_mfr10mC1
  • hemisp_narrowband_facility_mfrsr
  • be_up_hemisp_narrowband_status_mfr25mC1
  • wavenumber
  • PSP broadband surface albedo at the 10m tower
    (up_short_hemisp_beflux1longC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_10m)
  • PSP broadband surface albedo at 25m on the 60m tower
    (up_short_hemisp_irt25mC1/down_short_hemisp_beflux1longC1)(be_surface_albedo_psp_broadband_25m)
  • Broadband albedo at 25m tower estimated from integrating spectral albedos
    weighted by surface flux calculated from CHARTS(broadband_from_spectral_albedo_25m)


Back To Table of Contents



END OF DATA