Data Quality Reports for Session: 130561 User: dmfoper Completed: 11/10/2010


TABLE OF CONTENTS

DQR IDSubjectData Streams Affected
D000111.4Reprocess:SGP BLC reprocessing statussgpblcC1.00, sgpblcC1.a1, sgpblcprofC1.a1
D000204.6SGP/BLC - Retraction of D000111.4 BLC offsetsgpblcC1.00, sgpblcC1.a1, sgpblcprofC1.a1
D011228.1SGP/BLC/C1 - overlapping data files on 941110 duplicate data recordssgpblcC1.a1
D040525.22SGP/BLC/C1 - Metadata errorssgpblcC1.a1
D060209.2SGP/RUC/X1 - Subsetting RUC-40sgpallruc40hybrX1.c1, sgpallruc40isobX1.c1
D060209.3SGP/RUC/X1 - Subsetting RUC-40sgpallruc40isobX1.c1


DQRID : D000111.4
Start DateStart TimeEnd DateEnd Time
04/01/1994000006/30/19992359
Subject:
Reprocess:SGP BLC reprocessing status
DataStreams:sgpblcC1.00, sgpblcC1.a1, sgpblcprofC1.a1
Description:
The BLC data was the subject of a reprocessing 
effort last summer in support of the ARSCL
effort.  As a result three distinct windows of
data with varying levels of processing have been
created.

1) 940401-961031 - not reprocessed.  This data
   has a 110m offset in the reported cloud base
   height (see P980831.1).  No sgpblcprofC1.a1
   data available.  Reprocessing required.

2) 961101-990630 - reprocessed.  The 110m offset
   was corrected in this data and the blcprof
   data were created.  This data still contains
   the defunct field 'operational_state' which
   was determined to be useless and was removed
   in later data.  This data will be reprocessed
   at a later date to remove the operational_state
   field to create a continuity with the current
   data.

3) 990701-present - reprocessed/processed without
   'operational_state' field.  Offset has been
   corrected or no longer exists.  The format of
   this data is the target for the previous two
   data windows.
Measurements:sgpblcprofC1.a1:
  • Cloud, base height, second lowest base detected with threshold algorithm(cloud2)
  • Cloud, base height, lowest cloud detected with threshold algorithm(cloud1)
  • Cloud, base height, third cloud detected by Klett algorithm(kcloud3)
  • Cloud, base height, second lowest base detected by Klett algorithm(kcloud2)
  • operational_state
  • Cloud, base height, lowest cloud detected by Klett algorithm(kcloud1)
  • Cloud, base height, third base detected with thrreshold algorithm(cloud3)

sgpblcC1.00:
  • Raw data stream - documentation not supported

sgpblcC1.a1:
  • operational_state
  • Cloud, base height, third base detected with thrreshold algorithm(cloud3)
  • Cloud, base height, second lowest base detected with threshold algorithm(cloud2)
  • Cloud, base height, lowest cloud detected with threshold algorithm(cloud1)
  • Cloud, base height, lowest cloud detected by Klett algorithm(kcloud1)
  • Cloud, base height, second lowest base detected by Klett algorithm(kcloud2)
  • Cloud, base height, third cloud detected by Klett algorithm(kcloud3)


Back To Table of Contents

DQRID : D000204.6
Start DateStart TimeEnd DateEnd Time
04/01/1994000002/03/20002359
Subject:
SGP/BLC - Retraction of D000111.4 BLC offset
DataStreams:sgpblcC1.00, sgpblcC1.a1, sgpblcprofC1.a1
Description:
D000111.4 reported on the reprocessing status of the SGP BLC
data and indicated which time periods had been reprocessed to
remove a 110m offset.

First error:  the offset was actually 122m, not 110m.
Second error: an error in the reprocessing algorithm
              resulted in the offset not being removed.

This DQR retracts D000111.4.  All BLC data processed to date
still have a 122m offset.  That is the cloud base height 
reported in the data stream is 122m too high.

Data processed after 20000204 with version 7.0 of the algorithm 
(recorded in the header of the data file) do not contain the 
offset.

The data processed through 20000204 will be reprocessed
when resources are available.
Measurements:sgpblcprofC1.a1:
  • Cloud, base height, second lowest base detected with threshold algorithm(cloud2)
  • Cloud, base height, lowest cloud detected with threshold algorithm(cloud1)
  • Cloud, base height, third cloud detected by Klett algorithm(kcloud3)
  • Cloud, base height, second lowest base detected by Klett algorithm(kcloud2)
  • Cloud, base height, lowest cloud detected by Klett algorithm(kcloud1)
  • Cloud, base height, third base detected with thrreshold algorithm(cloud3)

sgpblcC1.00:
  • Raw data stream - documentation not supported

sgpblcC1.a1:
  • Cloud, base height, third base detected with thrreshold algorithm(cloud3)
  • Cloud, base height, second lowest base detected with threshold algorithm(cloud2)
  • Cloud, base height, lowest cloud detected with threshold algorithm(cloud1)
  • Cloud, base height, lowest cloud detected by Klett algorithm(kcloud1)
  • Cloud, base height, second lowest base detected by Klett algorithm(kcloud2)
  • Cloud, base height, third cloud detected by Klett algorithm(kcloud3)


Back To Table of Contents

DQRID : D011228.1
Start DateStart TimeEnd DateEnd Time
11/10/1994000011/10/19942359
Subject:
SGP/BLC/C1 - overlapping data files on 941110 duplicate data records
DataStreams:sgpblcC1.a1
Description:
The BLC cdf data for this day is split across
several files.  Two of those files,
  sgpblcC1.a1.941110.120010.cdf.v0
  sgpblcC1.a1.941110.140010.cdf.v0
contain overlapping records.  Both files also
contain unique time series data not available
in other archived data files.
Measurements:sgpblcC1.a1:
  • threshold_mincloudsig
  • laser_energy
  • operational_state
  • lon
  • threshold_filter
  • Cloud, base height, lowest cloud detected by Klett algorithm(kcloud1)
  • Cloud, base height, second lowest base detected by Klett algorithm(kcloud2)
  • time_offset
  • Klett_squelch
  • receiver_temp
  • range_offset
  • status_flags
  • target_laser_temp
  • Cloud, base height, third base detected with thrreshold algorithm(cloud3)
  • Cloud, base height, second lowest base detected with threshold algorithm(cloud2)
  • Cloud, base height, lowest cloud detected with threshold algorithm(cloud1)
  • base_time
  • lat
  • actual_laser_temp
  • Cloud, base height, third cloud detected by Klett algorithm(kcloud3)
  • alt
  • apd_volts
  • Klett_window
  • Optical depth, visibility, from RUC model(visibility)
  • laser_volts
  • Klett_min_ext_coef
  • ambient_temp


Back To Table of Contents

DQRID : D040525.22
Start DateStart TimeEnd DateEnd Time
08/11/1994000005/23/20002359
Subject:
SGP/BLC/C1 - Metadata errors
DataStreams:sgpblcC1.a1
Description:
The latitude, longitude and altitude of the Belfort Laser Ceilometer
were incorrectly entered into the ARM database.  The correct 
location of the SGP.C1 BLC was:
     Lat: 36.606N
     Lon: 97.485W
     Alt:    316m
Measurements:sgpblcC1.a1:
  • alt
  • lon
  • lat


Back To Table of Contents

DQRID : D060209.2
Start DateStart TimeEnd DateEnd Time
12/05/1998000004/16/20022359
Subject:
SGP/RUC/X1 - Subsetting RUC-40
DataStreams:sgpallruc40hybrX1.c1, sgpallruc40isobX1.c1
Description:
Users who would like access to subsetted RUC-40 data products similar to those products 
currently available for RUC-20 can use NCO utilities to create subsets from the 
"sgpallruc40" data products.  Below is one method that can be used. This is also mentioned in the 
FAQ on the ARM RUC description page at: http://www.arm.gov/xds/static/ruc.stm
--------------------------------------------------------------

Question: How can I create subsetted RUC 40 data similar to the RUC 20 data currently 
available at the Archive?

Currently, the RUC 40 netCDF data available at the archive are the full area, hourly files 
(sgpallruc40isobX1.c1 and sgpallruc40hybrX1.c1). Using the netCDF Operator (NCO) 
utilities, it is easy to produce subsetted, daily files similar to the RUC 20 subsets available 
(sgpruc20hybrX1.c1 and sgpruc20isobX1.c1).

The NCO utilities can be found at http://nco.sourceforge.net/
Using the ncks (NCO "kitchen sink") command, you can subset the ruc data as follows:

ncks -d nx,, -d ny,,  

Note: xmin,xmax,ymin,ymax are index ranges.

For example to subset around the SGP site use the following index values
for latitudes 34.209 to 38.928 and longitudes -99.798 to -95.
xmin = 71
xmax = 82
ymin = 40
ymax = 53


ncks -d nx,71,82 -d ny,40,53 sgpallruc40isobX1.c1.20000314.130000.cdf 
sgpruc40isobX1.c1.subset.cdf

Here is a sample C-Shell script for subsetting the ruc40 and using the NCO command ncrcat 
to concatenate the hourly subsetted files into a ruc 40 subsetted daily file similar to 
the sgpruc20isobX1.c1 files.

#!/bin/csh
# This script subsets the RUC 40 isobaric files
# and then concatenates hourly files into 1 daily file
# usage: subset_ruc40.csh 
#   where yyyymmdd is the date of the files to subset
#   and concatenate. Ex. 20000314 (yyyy=2000,mm=03, dd=14)
# Example: subset_ruc40.csh 20000314
# xmin,xmax,ymin,ymax are indices for
# lat = 34.209, 38.928, lon = -99.798, -95
set xmin = 71
set xmax = 82
set ymin = 40
set ymax = 53
set date = $1
foreach file (sgpallruc40isob*$date*)
  ncks -d nx,${xmin},${xmax} -d ny,${ymin},${ymax} $file $file.sub
end
ncrcat -h sgpallruc40isob*$date*sub sgpruc40isobX1.c1.$date.000000.cdf
rm *.sub
exit

For more information on the NCO commands ncks and ncrcat see:
http://nco.sourceforge.net/nco.html#ncks-netCDF-Kitchen-Sink
http://nco.sourceforge.net/nco.html#ncrcat-netCDF-Record-Concatenator

Also other commands for subsetting and analysis of netCDF data can be found at 
http://www.arm.gov/data/tools.stm
Measurements:sgpallruc40isobX1.c1:
  • Rain, categorical, freezing, from RUC model(catfreezerain)
  • Temperature, dew point, at 2 m, from RUC model(tempdewpt2m)
  • Snow, depth, from RUC model(snowdepth)
  • Pressure, surface, rate of change over 3-hr, from RUC model(pressuretend)
  • snowdepthwatereq
  • altimeter
  • Pressure, at ground level, from RUC model(pressuresrf)
  • stormrelhelicity
  • rhfrz
  • Temperature, lifted index, from RUC model(indexlifted)
  • windvm
  • Cloud, height, base, from RUC model(heightcldbase)
  • Wind speed, W-toE component, at 10 meters, from RUC model(windu10m)
  • Wind speed, S-to-N component, on isobaric grid, from RUC model(windvp)
  • Temperature, potential, at 2m, from RUC model(temppot2m)
  • Snow, categorical, from RUC model(catsnow)
  • Moisture, soil, availability, from RUC model(moistsoilavail)
  • Temperature, atmospheric, at 2 m, from RUC model(temp2m)
  • temppottrop
  • pressurefrz
  • stormmotionu
  • Wind speed, vertical, in pressure coordinates, on isobaric grid, RUC model(velocitywp)
  • stormmotionv
  • heightgpfrztop
  • velocitywm
  • precipsubgridacc
  • tempdewptdep2m
  • Humidity, relative, at 2m, from RUC model(rh2m)
  • Rain, categorical, from RUC model(catrain)
  • Water vapor, precipitable, column-integrated on isobaric grid, from RUC model(pwv)
  • altitude
  • heightequillevel
  • pressurepgrid
  • Temperature, atmospheric, on isobaric grid, from RUC model(tempp)
  • tempm
  • latitude
  • Humidity, specific, at 2 m, from RUC model(sh2m)
  • windutrop
  • rhfrztop
  • Temperature, best lifted index, from RUC model(indexliftedbest)
  • pressurefrztop
  • Rain, rate, at surface, from RUC model(preciprate)
  • Pressure, associated geometric height, on isobaric grid, from RUC model(heightgpp)
  • forecast_period
  • Energy, potential, convective, available, from RUC model(cape)
  • base_time
  • precipresolvedacc
  • precipresolved3hr
  • tempeqpot
  • runoffsubsrf
  • Pressure, atmospheric, at tropopause, from RUC model(pressuretrop)
  • Cloud, height, top, from RUC model(heightcldtop)
  • windgustspeed
  • Energy, convective inhibition, from RUC model(cinhib)
  • precipsubgrid3hr
  • Snow, accumulated over 3-hr, from RUC model(snowaccum)
  • time_offset
  • heightpbl
  • Wind speed, W-to-E component, on isobaric grid, from RUC model(windup)
  • Ice, pellets, categorical, from RUC model(caticepellets)
  • runoffsrfacc
  • pressurewindmax
  • longitude
  • heightgpfrz
  • Optical depth, visibility, from RUC model(visibility)
  • Cloud, height, top, convective, from RUC model(heightcldtopconv)
  • windvtrop
  • windum
  • rhm
  • windvwindmax
  • Humidity, relative, on isobaric grid, from RUC model(rhp)
  • pressuremgrid
  • winduwindmax
  • Pressure, atmospheric, at mean sea level, from RUC model(pressuremsl)
  • heightsrf
  • Wind speed, S-to-N component, at 10 meters, from RUC model(windv10m)
  • pressuretempeqpotmax

sgpallruc40hybrX1.c1:
  • Rain, rate, at surface, from RUC model(preciprate)
  • condensewaterratesrf
  • Water vapor, mixing ratio, on hybrid-b grid, from RUC model(mxratiovapor)
  • forecast_period
  • Pressure, associated geometric height, on hybrid-b grid, from RUC model(heightgp)
  • Wind speed, vertical, in pressure coordinates, on hybrid-b grid, from RUC model(velocityw)
  • Pressure, atmospheric, at tropopause, from RUC model(pressuretrop)
  • Snow, mixing ratio, on hybrid-b grid, from RUC model(mxratiosnow)
  • precipresolved
  • latitude
  • Rain, mixing ratio, on hybrid-b grid, from RUC model(mxratiorain)
  • windvtrop
  • altitude
  • runoffsubsrf
  • Radiation, longwave, irradiance, net, at surface, from RUC model(fluxlwnetsrf)
  • windutrop
  • Moisture, soil, volumetric, at six sub-surface levels, from RUC model(moistsoilvolumesrfsubsrf)
  • runoffsrf
  • dropwaterratesrf
  • evapcanopysrf
  • Heat flux, latent, 1-hr avg, at surface, from RUC model(fluxlatentsrf)
  • Water vapor, surface evaporation, from bare soil, from RUC model(evapsoilsrf)
  • longitude
  • Energy, potential, convective, available, from RUC model(cape)
  • heightss
  • Water vapor, precipitable, column-integrated on isobaric grid, from RUC model(pwv)
  • Ice, number concentration, particles, on hybrid-b grid, from RUC model(ndensice)
  • Ice, cloud, mixing ratio, on hybrid-b grid, from RUC model(mxratioice)
  • Heat flux, sensible, 1-hr avg, at surface, from RUC model(fluxsensiblesrf)
  • Energy, convective inhibition, from RUC model(cinhib)
  • Temperature, potential, on hybrid-b grid, from RUC model(tempvirtpot)
  • precipsubgrid
  • Radiation, shortwave, irradiance, net, at surface, from RUC model(fluxswnetsrf)
  • watercanopy
  • Humidity, relative(rh)
  • Snow, accumulated over 3-hr, from RUC model(snowaccum)
  • Energy, kinetic, turbulent, on hybrid-b grid, from RUC model(tketurb)
  • Wind speed, S-to-N component, on hybrid-b grid, from RUC model(windv)
  • Wind speed, W-to-E component, on hybrid-b grid, from RUC model(windu)
  • temppottrop
  • Water vapor, evapotranspiration flux, near surface, from RUC model(fluxevaptranssrf)
  • Temperature, snow, at snow or top soil level, from RUC model(snowtemp)
  • Ice, graupel, on hybrid-b grid, from RUC model(mxratiograupel)
  • base_time
  • Moisture, soil, at six sub-surface levels, from RUC model(moistsoilcontentsrfsubsrf)
  • Water, cloud, mixing ratio, on hybrid-b grid, from RUC model(mxratioliquid)
  • time_offset
  • Temperature, air(temp)
  • Temperature, soil, at six sub-surface levels, from RUC model(tempsoilsrfsubsrf)
  • Pressure, atmospheric, at mean sea level, from RUC model(pressuremsl)
  • Snow, depth, from RUC model(snowdepth)
  • Barometric pressure(pressure)


Back To Table of Contents

DQRID : D060209.3
Start DateStart TimeEnd DateEnd Time
04/20/1998000004/16/20022359
Subject:
SGP/RUC/X1 - Subsetting RUC-40
DataStreams:sgpallruc40isobX1.c1
Description:
As per ECR-00405, some users would to have access to subsetted RUC-40 data products 
similar to those products currently available for RUC-20.
Measurements:sgpallruc40isobX1.c1:
  • pressurefrztop
  • Rain, categorical, freezing, from RUC model(catfreezerain)
  • Temperature, dew point, at 2 m, from RUC model(tempdewpt2m)
  • Snow, depth, from RUC model(snowdepth)
  • Rain, rate, at surface, from RUC model(preciprate)
  • Pressure, associated geometric height, on isobaric grid, from RUC model(heightgpp)
  • forecast_period
  • Pressure, surface, rate of change over 3-hr, from RUC model(pressuretend)
  • snowdepthwatereq
  • altimeter
  • Pressure, at ground level, from RUC model(pressuresrf)
  • stormrelhelicity
  • Energy, potential, convective, available, from RUC model(cape)
  • rhfrz
  • Temperature, lifted index, from RUC model(indexlifted)
  • base_time
  • windvm
  • Cloud, height, base, from RUC model(heightcldbase)
  • Wind speed, W-toE component, at 10 meters, from RUC model(windu10m)
  • Wind speed, S-to-N component, on isobaric grid, from RUC model(windvp)
  • Temperature, potential, at 2m, from RUC model(temppot2m)
  • Snow, categorical, from RUC model(catsnow)
  • precipresolvedacc
  • precipresolved3hr
  • tempeqpot
  • runoffsubsrf
  • Pressure, atmospheric, at tropopause, from RUC model(pressuretrop)
  • Moisture, soil, availability, from RUC model(moistsoilavail)
  • Temperature, atmospheric, at 2 m, from RUC model(temp2m)
  • temppottrop
  • pressurefrz
  • Cloud, height, top, from RUC model(heightcldtop)
  • stormmotionu
  • stormmotionv
  • Wind speed, vertical, in pressure coordinates, on isobaric grid, RUC model(velocitywp)
  • heightgpfrztop
  • windgustspeed
  • Energy, convective inhibition, from RUC model(cinhib)
  • velocitywm
  • precipsubgrid3hr
  • Snow, accumulated over 3-hr, from RUC model(snowaccum)
  • time_offset
  • heightpbl
  • precipsubgridacc
  • Ice, pellets, categorical, from RUC model(caticepellets)
  • Wind speed, W-to-E component, on isobaric grid, from RUC model(windup)
  • runoffsrfacc
  • tempdewptdep2m
  • pressurewindmax
  • longitude
  • heightgpfrz
  • Optical depth, visibility, from RUC model(visibility)
  • Humidity, relative, at 2m, from RUC model(rh2m)
  • Cloud, height, top, convective, from RUC model(heightcldtopconv)
  • Rain, categorical, from RUC model(catrain)
  • windvtrop
  • Water vapor, precipitable, column-integrated on isobaric grid, from RUC model(pwv)
  • windum
  • altitude
  • heightequillevel
  • rhm
  • windvwindmax
  • pressurepgrid
  • Temperature, atmospheric, on isobaric grid, from RUC model(tempp)
  • tempm
  • latitude
  • Humidity, relative, on isobaric grid, from RUC model(rhp)
  • pressuremgrid
  • winduwindmax
  • Pressure, atmospheric, at mean sea level, from RUC model(pressuremsl)
  • heightsrf
  • Humidity, specific, at 2 m, from RUC model(sh2m)
  • windutrop
  • rhfrztop
  • Wind speed, S-to-N component, at 10 meters, from RUC model(windv10m)
  • pressuretempeqpotmax
  • Temperature, best lifted index, from RUC model(indexliftedbest)


Back To Table of Contents



END OF DATA