SGP/ECOR/E10 - Timestamp problems and intermittent data gaps

The raw files produced by the instrument contained bad (uncorrectable) data.  Specifically 
the date of the data in the file is given a time that is ahead of the actual time the 
data was genertaed.  This was caught because the date in the file was ahead of the system 
time of the server processing the raw file.  The mentor indicated all such files were 
compeltely bad and unrecoverable so all files that failed to be ingested were not shipped to 
the archive, thus producing holes in the raw and processed datastreams.  Because the 
problem was discovered by comparing to system time at time of processing all files between 
these dates should be consider suspect.  Therefore the files that are on the system over 
these three days should be used cautiously

• AVHRR satellite images for Darwin from BOM (RAW)(raw)

• covariance wc(cvar_wc)
• skew_c
• rotated covariance wq(cvar_rot_wq)
• rotated covariance wt(cvar_rot_wt)
• covariance vw(cvar_vw)
• covariance vt(cvar_vt)
• covariance vq(cvar_vq)
• n_bad_irga_light
• rotated covariance wc(cvar_rot_wc)
• Corrected sensible heat flux(h)
• temp_irga
• n_bad_c
• alt
• covaraince wq(cvar_wq)
• covariance wt(cvar_wt)
• n_bad_q
• CO2 flux(fc)
• rotated variance u(var_rot_u)
• rotated variance v(var_rot_v)
• rotated variance w(var_rot_w)
• lon
• kurt_q
• rho
• kurt_u
• kurt_t
• n_bad_son_ic
• covariance qc(cvar_qc)
• n_bad_t
• n_bad_u
• kurt_w
• n_bad_v
• kurt_v
• n_bad_w
• phi
• mean_rot_v
• Mean horizontal wind speed(mean_rot_u)
• mean_rot_w
• lv
• k
• Water vapor mixing ratio observed by the Raman lidar(mr)
• real_rho
• base_time
• mean_cooler
• Mean CO2 density(mean_c)
• kurt_c
• variance of variable u(var_u)
• mean_v
• variance of variable v(var_v)
• mean_u
• variance of variable w(var_w)
• mean_w
• variance of variable q(var_q)
• Mean H2O density(mean_q)
• Mean sonic temperature (t), i.e. virtual temperature(mean_t)
• variance of variable t(var_t)
• lat
• elev
• Pressure, condensation, at altitude, RUC model output(cp)
• n_spk_c
• variance of variable c(var_c)
• n_spk_w
• n_spk_t
• n_spk_v
• n_spk_u
• standard deviation of wind elevation angle(std_elev)
• n_spk_q
• friction velocity(ustar)
• wind_spd
• rotated covariance uw(cvar_rot_uw)
• atm_pres
• n_good_c
• real_cp
• mean_spk_v
• n_bad_irga
• mean_spk_w
• rotated covariance ut(cvar_rot_ut)
• mean_spk_t
• mean_spk_u
• rotated covariance uv(cvar_rot_uv)
• covariance uc(cvar_uc)
• wind_dir
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• covariance uw(cvar_uw)
• rotated covariance uc(cvar_rot_uc)
• covariance uv(cvar_uv)
• time
• covariance ut(cvar_ut)
• mean_spk_c
• covaraince vc(cvar_vc)
• mean_spk_q
• time_offset
• Latent heat flux(lv_e)
• rotated covariance vw(cvar_rot_vw)
• covariance tc(cvar_tc)
• rotated covariance vt(cvar_rot_vt)
• rotated covariance vq(cvar_rot_vq)
• covariance tq(cvar_tq)
• real_lv
• n_good_q
• skew_v
• skew_w
• skew_t
• real_mr
• skew_u
• n_good_u
• n_good_t
• n_good_w
• standard deviation of wind direction(std_wind_dir)
• n_good_v
• rotated covariance vc(cvar_rot_vc)
• skew_q

SGP/ECOR/E10 - Sensor failure

Due to LI-7500 (H2O/CO2 infrared gas analyzer) sensor failure all humidity and CO2 data 
are incorrect for the period of Jul. 14, 2004 01:00 to Aug. 13, 2004 18:00.

• AVHRR satellite images for Darwin from BOM (RAW)(raw)

• covariance wc(cvar_wc)
• atm_pres
• mean_spk_v
• mean_spk_w
• skew_c
• mean_spk_t
• variance of variable q(var_q)
• rotated covariance wq(cvar_rot_wq)
• kurt_q
• mean_spk_u
• Mean H2O density(mean_q)
• rho
• covariance uc(cvar_uc)
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• covariance qc(cvar_qc)
• Pressure, condensation, at altitude, RUC model output(cp)
• covariance vq(cvar_vq)
• rotated covariance uc(cvar_rot_uc)
• mean_spk_c
• variance of variable c(var_c)
• rotated covariance wc(cvar_rot_wc)
• mean_spk_q
• covaraince vc(cvar_vc)
• Latent heat flux(lv_e)
• lv
• Water vapor mixing ratio observed by the Raman lidar(mr)
• temp_irga
• covariance tc(cvar_tc)
• rotated covariance vq(cvar_rot_vq)
• covariance tq(cvar_tq)
• covaraince wq(cvar_wq)
• mean_cooler
• rotated covariance vc(cvar_rot_vc)
• kurt_c
• Mean CO2 density(mean_c)
• skew_q

SGP/ECOR/E10 - Sensor failure

Due to sensor failure all the parameters measured by the Infrared Gas Analyzer (water 
vapor density, CO2 concentration, fluxes of latent heat and CO2, etc.) are incorrect for the 
period of 18:30 Oct. 22, 2004 to 22:00 Dec. 14, 2004. The data is irrevocably lost.

• AVHRR satellite images for Darwin from BOM (RAW)(raw)

• covariance wc(cvar_wc)
• real_cp
• n_good_c
• atm_pres
• n_bad_irga
• skew_c
• variance of variable q(var_q)
• rotated covariance wq(cvar_rot_wq)
• kurt_q
• Mean H2O density(mean_q)
• rho
• covariance uc(cvar_uc)
• covariance uq(cvar_uq)
• n_bad_son_ic
• rotated covariance uq(cvar_rot_uq)
• covariance qc(cvar_qc)
• Pressure, condensation, at altitude, RUC model output(cp)
• covariance vq(cvar_vq)
• n_bad_irga_light
• rotated covariance uc(cvar_rot_uc)
• n_spk_c
• mean_spk_c
• variance of variable c(var_c)
• rotated covariance wc(cvar_rot_wc)
• mean_spk_q
• covaraince vc(cvar_vc)
• Latent heat flux(lv_e)
• Water vapor mixing ratio observed by the Raman lidar(mr)
• temp_irga
• n_bad_c
• covariance tc(cvar_tc)
• real_rho
• rotated covariance vq(cvar_rot_vq)
• n_spk_q
• covariance tq(cvar_tq)
• real_lv
• n_good_q
• covaraince wq(cvar_wq)
• real_mr
• mean_cooler
• n_bad_q
• CO2 flux(fc)
• rotated covariance vc(cvar_rot_vc)
• kurt_c
• Mean CO2 density(mean_c)
• skew_q

SGP/ECOR/E10 - Reprocess: Incorrect H2O, CO2

Due to failure of analog output circuitry in the Infrared Gas Analyzer (IRGA), CO2 and 
water vapor parameters measured by the IRGA (water vapor density, CO2 concentration, fluxes 
of latent heat and CO2) were incorrectly recorded in sonic raw data files for the period 
of 22:30 Dec. 14, 2004 to 22:00 Jan. 11, 2005. The data could be recovered from IRGA raw 
serial files (00 level).

• AVHRR satellite images for Darwin from BOM (RAW)(raw)

• covariance wc(cvar_wc)
• real_cp
• n_good_c
• n_bad_irga
• skew_c
• variance of variable q(var_q)
• rotated covariance wq(cvar_rot_wq)
• kurt_q
• Mean H2O density(mean_q)
• rho
• covariance uc(cvar_uc)
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• covariance qc(cvar_qc)
• Pressure, condensation, at altitude, RUC model output(cp)
• covariance vq(cvar_vq)
• rotated covariance uc(cvar_rot_uc)
• n_spk_c
• mean_spk_c
• variance of variable c(var_c)
• rotated covariance wc(cvar_rot_wc)
• mean_spk_q
• covaraince vc(cvar_vc)
• Latent heat flux(lv_e)
• lv
• Water vapor mixing ratio observed by the Raman lidar(mr)
• n_bad_c
• covariance tc(cvar_tc)
• real_rho
• rotated covariance vq(cvar_rot_vq)
• n_spk_q
• covariance tq(cvar_tq)
• real_lv
• n_good_q
• covaraince wq(cvar_wq)
• real_mr
• n_bad_q
• CO2 flux(fc)
• rotated covariance vc(cvar_rot_vc)
• kurt_c
• Mean CO2 density(mean_c)
• skew_q

SGP/ECOR/E10 - Reprocess: Incorrectly flagged (marked as "bad") H2O/CO2 data

Due to system clock instability on ECOR computers their system time is adjusted 
approximately once per hour; sometimes this adjustment leads to backward time jumps over midnight, 
into the previous day. In this case all the data based on CO2/H2O measurements might be 
erroneously marked as bad.

• covariance wc(cvar_wc)
• real_cp
• n_good_c
• skew_c
• variance of variable q(var_q)
• rotated covariance wq(cvar_rot_wq)
• Mean H2O density(mean_q)
• covariance uc(cvar_uc)
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• covariance qc(cvar_qc)
• Pressure, condensation, at altitude, RUC model output(cp)
• covariance vq(cvar_vq)
• rotated covariance uc(cvar_rot_uc)
• n_spk_c
• mean_spk_c
• rotated covariance wc(cvar_rot_wc)
• variance of variable c(var_c)
• mean_spk_q
• covaraince vc(cvar_vc)
• Latent heat flux(lv_e)
• lv
• Water vapor mixing ratio observed by the Raman lidar(mr)
• n_bad_c
• covariance tc(cvar_tc)
• real_rho
• rotated covariance vq(cvar_rot_vq)
• n_spk_q
• covariance tq(cvar_tq)
• real_lv
• n_good_q
• covaraince wq(cvar_wq)
• real_mr
• n_bad_q
• CO2 flux(fc)
• rotated covariance vc(cvar_rot_vc)
• Mean CO2 density(mean_c)
• skew_q

SGP/ECOR/E10 - Missing data

Data are missing and unrecoverable.

• covariance wc(cvar_wc)
• skew_c
• rotated covariance wq(cvar_rot_wq)
• rotated covariance wt(cvar_rot_wt)
• covariance vw(cvar_vw)
• covariance vt(cvar_vt)
• covariance vq(cvar_vq)
• n_bad_irga_light
• rotated covariance wc(cvar_rot_wc)
• Corrected sensible heat flux(h)
• temp_irga
• n_bad_c
• alt
• covaraince wq(cvar_wq)
• covariance wt(cvar_wt)
• n_bad_q
• CO2 flux(fc)
• rotated variance u(var_rot_u)
• rotated variance v(var_rot_v)
• lon
• rotated variance w(var_rot_w)
• kurt_q
• rho
• kurt_u
• n_bad_son_ic
• kurt_t
• covariance qc(cvar_qc)
• n_bad_t
• n_bad_u
• n_bad_v
• kurt_w
• n_bad_w
• kurt_v
• phi
• mean_rot_v
• Mean horizontal wind speed(mean_rot_u)
• mean_rot_w
• lv
• Water vapor mixing ratio observed by the Raman lidar(mr)
• k
• real_rho
• base_time
• mean_cooler
• kurt_c
• Mean CO2 density(mean_c)
• mean_v
• variance of variable u(var_u)
• mean_u
• variance of variable v(var_v)
• variance of variable w(var_w)
• mean_w
• variance of variable q(var_q)
• Mean H2O density(mean_q)
• Mean sonic temperature (t), i.e. virtual temperature(mean_t)
• variance of variable t(var_t)
• lat
• elev
• Pressure, condensation, at altitude, RUC model output(cp)
• n_spk_c
• variance of variable c(var_c)
• n_spk_w
• n_spk_t
• n_spk_v
• n_spk_u
• standard deviation of wind elevation angle(std_elev)
• n_spk_q
• friction velocity(ustar)
• wind_spd
• n_good_c
• real_cp
• atm_pres
• rotated covariance uw(cvar_rot_uw)
• n_bad_irga
• mean_spk_v
• mean_spk_w
• mean_spk_t
• rotated covariance ut(cvar_rot_ut)
• mean_spk_u
• covariance uc(cvar_uc)
• rotated covariance uv(cvar_rot_uv)
• wind_dir
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• covariance uw(cvar_uw)
• covariance uv(cvar_uv)
• rotated covariance uc(cvar_rot_uc)
• time
• covariance ut(cvar_ut)
• mean_spk_c
• covaraince vc(cvar_vc)
• mean_spk_q
• Latent heat flux(lv_e)
• time_offset
• rotated covariance vw(cvar_rot_vw)
• covariance tc(cvar_tc)
• rotated covariance vt(cvar_rot_vt)
• rotated covariance vq(cvar_rot_vq)
• covariance tq(cvar_tq)
• real_lv
• n_good_q
• skew_v
• skew_w
• skew_t
• real_mr
• skew_u
• n_good_u
• n_good_t
• n_good_w
• standard deviation of wind direction(std_wind_dir)
• n_good_v
• rotated covariance vc(cvar_rot_vc)
• skew_q

SGP/ECOR/E10 - Reprocess: Wind Direction Incorrect

It was discovered that the E10 ECOR boom is aligned 17 degrees to the west of true north.  
Therefore, all wind direction data for the stated period is 17 degrees too high.  
Subtract 17 degrees from the wind direction to give the correct direction.

The E10 configuration file was modified to correct this problem.

• wind_dir

SGP/ECOR/E10 - LI-7500 Pressure and Temperature missing

The LI-7500 pressure and temperature were not recorded;
the serial datastream was not being captured by the ECOR.

• temp_irga
• atm_pres

SGP/ECOR/E10 - CO2 and Latent Heat Fluxes Incorrect

The CO2 and latent heat fluxes were incorrect because the sonic anemometer was not working 
properly.

• covariance wc(cvar_wc)
• covaraince wq(cvar_wq)
• variance of variable q(var_q)
• rotated covariance wq(cvar_rot_wq)
• Mean H2O density(mean_q)
• variance of variable c(var_c)
• rotated covariance wc(cvar_rot_wc)
• CO2 flux(fc)
• Mean CO2 density(mean_c)
• Latent heat flux(lv_e)

SGP/ECOR/E10 - Incorrect CO2 fluxes

The analog CO2 signal from the LI-7500 to the sonic anemometer became very noisy and 
incorrect CO2 fluxes resulted. Sonic anemometer was replaced.

• CO2 flux(fc)

SGP/ECOR/E10 - Pressure and Temperature Missing

The pressure and temperature from the LI-7500 were missing. Sensible and latent heat flux 
were not affected.

• temp_irga
• atm_pres