Data Quality Reports for Session: 151316 User: yanhrong04 Completed: 07/09/2013


TABLE OF CONTENTS

DQR IDSubjectData Streams Affected
D020717.18TWP/TSI/C3 - Missing data due to Mentor ActivitiestwptsiskycoverC3.a1, twptsiskycoverC3.b1, twptsiskyimageC3.a1, twptsiC3.00
D030130.2TWP/TSI/C3 - Metadata Errors in NetCDF HeadertwptsiskycoverC3.a1, twptsiskycoverC3.b1
D040610.2TWP/TSI/C3 - poor imagestwptsiskycoverC3.b1, twptsiskyimageC3.a1, twptsicldmaskC3.a1
D041014.3TWP/TSI/C3 - camera failuretwptsiskycoverC3.b1, twptsiskyimageC3.a1
D050224.5TWP/TSI/C3 - initial configuration twptsicldmaskC3.a1, twptsiskycoverC3.b1, twptsiskyimageC3.a1
D051114.1TWP/TSI/C3 - Missing datatwptsicldmaskC3.a1, twptsimovieC3.a1, twptsiskycoverC3.b1, twptsiskyimageC3.a1
D060519.2TWP/TSI/C3 - controller board failuretwptsiskycoverC3.b1, twptsicldmaskC3.a1, twptsimovieC3.a1, twptsiskyimageC3.a1
D080502.3TWP/TSI/C3 - mirror continously rotatingtwptsicldmaskC3.a1, twptsiskycoverC3.b1
D100108.1TWP/TSI/C3 - Mirror continuously rotatingtwptsicldmaskC3.a1, twptsiskycoverC3.b1
D100113.1TWP/TSI/C3 - Maintenance/Control board updatetwptsicldmaskC3.a1, twptsiskycoverC3.b1, twptsiskyimageC3.a1
D111006.6TWP/TSI/C1/C2/C3 - Ingest ProblemtwptsiskycoverC1.b1, twptsiskycoverC2.b1, twptsiskycoverC3.b1
D120314.1TWP/TSI/C3 - Power supply failuretwptsicldmaskC3.a1, twptsimovieC3.a1, twptsiskycoverC3.b1, twptsiskyimageC3.a1
D130226.5TWP/TSI/C3 - Water on lenstwptsiskycoverC3.b1
D130415.4TWP/TSI/C3 - Reprocess: RecalibrationtwptsicldmaskC3.a1, twptsiskycoverC3.b1
D130503.3TWP/TSI/C3 - Reprocess: RecalibrationtwptsicldmaskC3.a1, twptsiskycoverC3.b1


DQRID : D020717.18
Start DateStart TimeEnd DateEnd Time
07/17/2002070507/17/20021805
Subject:
TWP/TSI/C3 - Missing data due to Mentor Activities
DataStreams:twptsiskycoverC3.a1, twptsiskycoverC3.b1, twptsiskyimageC3.a1, twptsiC3.00
Description:
Darwin TSI on-board image collection and processing
had been turned off for Instrument Mentor to make
fine tuning adjustments. Mentor then forgot to turn
the on-board image collection and processing back
on.  All data for this time period is missing and
unrecoverable.
Measurements:twptsiskycoverC3.a1:
  • alt
  • lat
  • count.opaque
  • count.box
  • count.sub.horz
  • region.sun.count.thin
  • region.horizon.count
  • region.sun.count.opaque
  • count.unknown
  • solar.altitude
  • base_time
  • sun.strength
  • Cloud amount, thin (percent)(percent.thin)
  • region.zenith.count.thin
  • count.mask
  • region.sun.count
  • Cloud amount, opaque (percent)(percent.opaque)
  • solar.azimuth
  • region.zenith.count.opaque
  • region.horizon.count.thin
  • region.zenith.count
  • count.sky
  • Sunshine Meter(sunny)
  • count.thin
  • lon
  • region.horizon.count.opaque
  • count.sub.proczen
  • time_offset

twptsiskycoverC3.b1:
  • region.zenith.count
  • count.unknown
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.horizon.count
  • region.zenith.count.thin
  • region.horizon.count.opaque
  • time_offset
  • solar.altitude
  • count.box
  • count.opaque
  • count.sky
  • solar.azimuth
  • count.sub.proczen
  • count.sub.horz
  • sun.strength
  • Sunshine Meter(sunny)
  • region.sun.count
  • lat
  • Cloud amount, thin (percent)(percent.thin)
  • region.sun.count.opaque
  • count.thin
  • alt
  • lon
  • region.zenith.count.opaque
  • region.horizon.count.thin
  • base_time
  • count.mask
  • region.sun.count.thin

twptsiC3.00:
  • Raw data stream - documentation not supported

twptsiskyimageC3.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D030130.2
Start DateStart TimeEnd DateEnd Time
07/16/2002000001/20/20032359
Subject:
TWP/TSI/C3 - Metadata Errors in NetCDF Header
DataStreams:twptsiskycoverC3.a1, twptsiskycoverC3.b1
Description:
The value of "sample_int" reported in the netCDF header is
incorrect.  The correct sampling interval is 30 seconds.

The maximum values for the variable "sunny" is incorrect.  
It should be 1, not 100 as documented in the netCDF header. 
Users should disregard the "qc_sunny" flag during this
period of time and apply their own qc check if desired.

The minimum value for the variable "solar.altitude" is
incorrect. It should be -90, not 10 as documented in the
netCDF header.  Users should disregard the "qc_solar.altitude"
flag during this period of time and apply their own qc check
if desired.
Measurements:twptsiskycoverC3.a1:
  • time_offset

twptsiskycoverC3.b1:
  • time_offset
  • solar.altitude
  • Sunshine Meter(sunny)


Back To Table of Contents

DQRID : D040610.2
Start DateStart TimeEnd DateEnd Time
06/03/2004113506/10/20042318
Subject:
TWP/TSI/C3 - poor images
DataStreams:twptsiskycoverC3.b1, twptsiskyimageC3.a1, twptsicldmaskC3.a1
Description:
The resolution of TSI images were very poor and the colors were wrong.  The clear sky 
appeared a reddish-brown during the day causing the processed image to be 100% opaque. The 
problem was corrected when the instrument was power cycled.
Measurements:twptsiskycoverC3.b1:
  • Cloud amount, thin (percent)(percent.thin)
  • region.horizon.count
  • count.sub.proczen
  • region.sun.count.opaque
  • count.thin
  • region.zenith.count.thin
  • region.horizon.count.opaque
  • region.zenith.count
  • count.sub.horz
  • count.box
  • count.opaque
  • region.zenith.count.opaque
  • count.unknown
  • count.sky
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.horizon.count.thin
  • sun.strength
  • count.mask
  • region.sun.count
  • region.sun.count.thin
  • Sunshine Meter(sunny)

twptsiskyimageC3.a1:
  • JPEG data stream - documentation not yet available

twptsicldmaskC3.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents

DQRID : D041014.3
Start DateStart TimeEnd DateEnd Time
10/14/2004205511/09/20041146
Subject:
TWP/TSI/C3 - camera failure
DataStreams:twptsiskycoverC3.b1, twptsiskyimageC3.a1
Description:
The TSI image was out of focus due to condensation on the camera lens and PC board that 
led to camera failure. The problem was corrected by replacing the camera with a spare and 
adjusting the shadowband.
Measurements:twptsiskycoverC3.b1:
  • Cloud amount, thin (percent)(percent.thin)
  • region.horizon.count
  • region.sun.count.opaque
  • count.sub.proczen
  • count.thin
  • region.zenith.count.thin
  • region.horizon.count.opaque
  • region.zenith.count
  • count.sub.horz
  • count.box
  • region.zenith.count.opaque
  • count.opaque
  • count.unknown
  • count.sky
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.horizon.count.thin
  • region.sun.count.thin
  • region.sun.count
  • count.mask

twptsiskyimageC3.a1:
  • JPEG data stream - documentation not yet available


Back To Table of Contents

DQRID : D050224.5
Start DateStart TimeEnd DateEnd Time
02/03/2005024002/10/20052238
Subject:
TWP/TSI/C3  - initial configuration
DataStreams:twptsicldmaskC3.a1, twptsiskycoverC3.b1, twptsiskyimageC3.a1
Description:
When the TSI-660 was deployed, there were several days of initial adjustments to the 
shadowband alignment and sky filter.
Measurements:twptsiskycoverC3.b1:
  • count.sub.proczen
  • region.zenith.count
  • count.sub.horz
  • count.unknown
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • Sunshine Meter(sunny)
  • region.sun.count
  • lat
  • Cloud amount, thin (percent)(percent.thin)
  • region.horizon.count
  • region.sun.count.opaque
  • count.thin
  • region.zenith.count.thin
  • region.horizon.count.opaque
  • time_offset
  • alt
  • solar.altitude
  • lon
  • count.box
  • count.opaque
  • region.zenith.count.opaque
  • count.sky
  • region.horizon.count.thin
  • solar.azimuth
  • base_time
  • count.mask
  • region.sun.count.thin

twptsiskyimageC3.a1:
  • JPEG data stream - documentation not yet available

twptsicldmaskC3.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents

DQRID : D051114.1
Start DateStart TimeEnd DateEnd Time
11/14/2005045312/19/20050300
02/23/2013050004/24/20130319
Subject:
TWP/TSI/C3 - Missing data
DataStreams:twptsicldmaskC3.a1, twptsimovieC3.a1, twptsiskycoverC3.b1, twptsiskyimageC3.a1
Description:
Data are missing and unrecoverable.
Measurements:twptsimovieC3.a1:
  • MPEG data stream - documentation not yet available

twptsiskycoverC3.b1:
  • count.sub.proczen
  • region.zenith.count
  • count.sub.horz
  • count.unknown
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • Sunshine Meter(sunny)
  • region.sun.count
  • lat
  • Cloud amount, thin (percent)(percent.thin)
  • region.horizon.count
  • region.sun.count.opaque
  • count.thin
  • region.zenith.count.thin
  • region.horizon.count.opaque
  • time_offset
  • alt
  • solar.altitude
  • count.box
  • lon
  • count.opaque
  • region.zenith.count.opaque
  • count.sky
  • region.horizon.count.thin
  • solar.azimuth
  • base_time
  • count.mask
  • region.sun.count.thin

twptsiskyimageC3.a1:
  • JPEG data stream - documentation not yet available

twptsicldmaskC3.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents

DQRID : D060519.2
Start DateStart TimeEnd DateEnd Time
05/18/2006043508/02/20060230
Subject:
TWP/TSI/C3 - controller board failure
DataStreams:twptsiskycoverC3.b1, twptsicldmaskC3.a1, twptsimovieC3.a1, twptsiskyimageC3.a1
Description:
The mirror control board failed and was replaced with a spare. Several images were 
collected in the iterim that should be ignored. These images include periods when the sun was 
not masked by the shadowband, the camera lens was covered by red tape to protect the CCD 
from direct exposure to the sun and, the instrument was inside the shop for repair and 
testing.
Measurements:twptsimovieC3.a1:
  • MPEG data stream - documentation not yet available

twptsiskycoverC3.b1:
  • count.sub.proczen
  • region.zenith.count
  • count.sub.horz
  • count.unknown
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • Sunshine Meter(sunny)
  • region.sun.count
  • Cloud amount, thin (percent)(percent.thin)
  • lat
  • region.horizon.count
  • region.sun.count.opaque
  • count.thin
  • region.zenith.count.thin
  • region.horizon.count.opaque
  • time_offset
  • alt
  • solar.altitude
  • count.box
  • lon
  • count.opaque
  • region.zenith.count.opaque
  • count.sky
  • region.horizon.count.thin
  • solar.azimuth
  • base_time
  • count.mask
  • region.sun.count.thin

twptsiskyimageC3.a1:
  • JPEG data stream - documentation not yet available

twptsicldmaskC3.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents

DQRID : D080502.3
Start DateStart TimeEnd DateEnd Time
04/09/2006230004/11/20060600
Subject:
TWP/TSI/C3 - mirror continously rotating
DataStreams:twptsicldmaskC3.a1, twptsiskycoverC3.b1
Description:
The mirror/shadowband was rotating continously because of a serial communication problem 
with the control board. The problem was corrected when the Ethernet-to-serial adaptor was 
replaced.
Measurements:twptsiskycoverC3.b1:
  • Cloud amount, thin (percent)(percent.thin)
  • region.sun.count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • count.sky
  • count.thin
  • region.sun.count.thin
  • region.sun.count
  • count.opaque
  • count.mask

twptsicldmaskC3.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents

DQRID : D100108.1
Start DateStart TimeEnd DateEnd Time
01/05/2010053401/08/20100135
Subject:
TWP/TSI/C3 - Mirror continuously rotating
DataStreams:twptsicldmaskC3.a1, twptsiskycoverC3.b1
Description:
The mirror/shadowband was continuously rotating. Communication with the serial adaptor was 
lost because the battery had gone resistive and loading down the system. The battery was 
replaced and communication restored.
Measurements:twptsiskycoverC3.b1:
  • Cloud amount, thin (percent)(percent.thin)
  • region.horizon.count
  • region.sun.count.opaque
  • count.sub.proczen
  • count.thin
  • region.zenith.count.thin
  • region.horizon.count.opaque
  • region.zenith.count
  • count.sub.horz
  • count.box
  • region.zenith.count.opaque
  • count.opaque
  • count.unknown
  • count.sky
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.horizon.count.thin
  • sun.strength
  • region.sun.count.thin
  • region.sun.count
  • count.mask

twptsicldmaskC3.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents

DQRID : D100113.1
Start DateStart TimeEnd DateEnd Time
01/12/2010062001/13/20100650
Subject:
TWP/TSI/C3 - Maintenance/Control board update
DataStreams:twptsicldmaskC3.a1, twptsiskycoverC3.b1, twptsiskyimageC3.a1
Description:
The mirror did not turn and the shadowband did not mask the sun while the control 
interface board was being upgraded.
Measurements:twptsiskycoverC3.b1:
  • Cloud amount, thin (percent)(percent.thin)
  • region.horizon.count
  • region.sun.count.opaque
  • count.sub.proczen
  • count.thin
  • region.zenith.count.thin
  • region.horizon.count.opaque
  • region.zenith.count
  • count.sub.horz
  • count.box
  • region.zenith.count.opaque
  • count.opaque
  • count.unknown
  • count.sky
  • Cloud amount, opaque (percent)(percent.opaque)
  • region.horizon.count.thin
  • sun.strength
  • region.sun.count.thin
  • region.sun.count
  • count.mask

twptsiskyimageC3.a1:
  • JPEG data stream - documentation not yet available

twptsicldmaskC3.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents

DQRID : D111006.6
Start DateStart TimeEnd DateEnd Time
11/11/2010165010/20/20111800
Subject:
TWP/TSI/C1/C2/C3 - Ingest Problem
DataStreams:twptsiskycoverC1.b1, twptsiskycoverC2.b1, twptsiskycoverC3.b1
Description:
A minor error was made with diagnostic metadata attribute sunny_thresh when the TSI ingest 
was updated.
Measurements:twptsiskycoverC2.b1:
  • base_time

twptsiskycoverC3.b1:
  • base_time

twptsiskycoverC1.b1:
  • base_time


Back To Table of Contents

DQRID : D120314.1
Start DateStart TimeEnd DateEnd Time
02/26/2012235002/28/20122122
Subject:
TWP/TSI/C3 - Power supply failure
DataStreams:twptsicldmaskC3.a1, twptsimovieC3.a1, twptsiskycoverC3.b1, twptsiskyimageC3.a1
Description:
The power supply began to fail, causing all black or all white images and intermittent 
image collection. The power supply was replaced.
Measurements:twptsimovieC3.a1:
  • MPEG data stream - documentation not yet available

twptsiskycoverC3.b1:
  • count.sub.proczen
  • region.zenith.count
  • count.sub.horz
  • count.unknown
  • Cloud amount, opaque (percent)(percent.opaque)
  • sun.strength
  • region.sun.count
  • Sunshine Meter(sunny)
  • Cloud amount, thin (percent)(percent.thin)
  • region.horizon.count
  • region.sun.count.opaque
  • count.thin
  • region.zenith.count.thin
  • region.horizon.count.opaque
  • solar.altitude
  • count.box
  • count.opaque
  • region.zenith.count.opaque
  • count.sky
  • region.horizon.count.thin
  • solar.azimuth
  • count.mask
  • region.sun.count.thin

twptsiskyimageC3.a1:
  • JPEG data stream - documentation not yet available

twptsicldmaskC3.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents

DQRID : D130226.5
Start DateStart TimeEnd DateEnd Time
08/19/2010070610/05/20120345
Subject:
TWP/TSI/C3 - Water on lens
DataStreams:twptsiskycoverC3.b1
Description:
After a rain episode, drops of water collected on the lens window causing the cloud 
fraction values to be suspect. To prevent this, a drip edge was formed around the bottom of the 
enclosure with thick electrical or splicing tape.
Measurements:twptsiskycoverC3.b1:
  • Cloud amount, thin (percent)(percent.thin)
  • Cloud amount, opaque (percent)(percent.opaque)
  • count.sky
  • count.thin
  • region.zenith.count.thin
  • region.zenith.count
  • region.zenith.count.opaque
  • count.opaque


Back To Table of Contents

DQRID : D130415.4
Start DateStart TimeEnd DateEnd Time
08/27/2011220011/13/20110910
Subject:
TWP/TSI/C3 - Reprocess: Recalibration
DataStreams:twptsicldmaskC3.a1, twptsiskycoverC3.b1
Description:
The processed image and cloud fraction determination were incorrect because the 
thin/opaque threshold was set too high.
Measurements:twptsiskycoverC3.b1:
  • Cloud amount, thin (percent)(percent.thin)
  • region.sun.count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • count.thin
  • region.zenith.count.thin
  • region.horizon.count.opaque
  • region.horizon.count.thin
  • region.zenith.count.opaque
  • region.sun.count.thin
  • count.opaque
  • count.mask

twptsicldmaskC3.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents

DQRID : D130503.3
Start DateStart TimeEnd DateEnd Time
09/03/2012202812/16/20121010
Subject:
TWP/TSI/C3 - Reprocess: Recalibration
DataStreams:twptsicldmaskC3.a1, twptsiskycoverC3.b1
Description:
The processed image and cloud fraction determination were incorrect because the clear/thin 
threshold was set too low.
Measurements:twptsiskycoverC3.b1:
  • Cloud amount, thin (percent)(percent.thin)
  • region.sun.count.opaque
  • Cloud amount, opaque (percent)(percent.opaque)
  • count.thin
  • region.zenith.count.thin
  • region.horizon.count.opaque
  • region.horizon.count.thin
  • region.zenith.count.opaque
  • region.sun.count.thin
  • count.opaque
  • count.mask

twptsicldmaskC3.a1:
  • Cloud decision images, Total Sky Imager, PNG format(png)


Back To Table of Contents



END OF DATA