SGP/ECOR/E10 - Timestamp problems and intermittent data gaps

The raw files produced by the instrument contained bad (uncorrectable) data.  Specifically 
the date of the data in the file is given a time that is ahead of the actual time the 
data was genertaed.  This was caught because the date in the file was ahead of the system 
time of the server processing the raw file.  The mentor indicated all such files were 
compeltely bad and unrecoverable so all files that failed to be ingested were not shipped to 
the archive, thus producing holes in the raw and processed datastreams.  Because the 
problem was discovered by comparing to system time at time of processing all files between 
these dates should be consider suspect.  Therefore the files that are on the system over 
these three days should be used cautiously

• Raw data stream - documentation not supported(raw)

• covariance wc(cvar_wc)
• skewness of variable c(skew_c)
• rotated covariance wq(cvar_rot_wq)
• rotated covariance wt(cvar_rot_wt)
• vw covariance(cvar_vw)
• covariance vt(cvar_vt)
• covariance vq(cvar_vq)
• number of samples with IRGA optical path blocked flag(n_bad_irga_light)
• rotated covariance wc(cvar_rot_wc)
• h(h)
• average temperature (IGRA internal sensor)(temp_irga)
• number of bad or out of range c samples(n_bad_c)
• Dummy altitude for Zeb(alt)
• covariance wq(cvar_wq)
• wT covariance(cvar_wt)
• number of bad or out of range q samples(n_bad_q)
• CO2 flux(fc)
• variance of u(var_rot_u)
• variance of v(var_rot_v)
• lon(lon)
• variance of w(var_rot_w)
• kurtosis of variable q(kurt_q)
• Retrieved water vapor density profile(rho)
• kurtosis of variable u(kurt_u)
• number of samples with bad sonic status flag(n_bad_son_ic)
• kurtosis of variable t(kurt_t)
• covariance of qc(cvar_qc)
• number of bad or out of range t samples(n_bad_t)
• number of bad or out of range u samples(n_bad_u)
• kurtosis of variable w(kurt_w)
• number of bad or out of range v samples(n_bad_v)
• kurtosis of variable v(kurt_v)
• number of bad or out of range w samples(n_bad_w)
• Vertical angle of wind(phi)
• rotated mean v(mean_rot_v)
• mean horizontal wind speed(mean_rot_u)
• rotated mean w(mean_rot_w)
• latent heat of vaporization(lv)
• mixing ratio(mr)
• momentum flux (dynamic)(k)
• 0=real or 1=dummy value of rho(real_rho)
• base time(base_time)
• average voltage of IRGA cooler(mean_cooler)
• mean co2 concentration (c)(mean_c)
• kurtosis of variable c(kurt_c)
• Cross-boom wind velocity (v)(mean_v)
• variance of variable u(var_u)
• Down-boom wind velocity (u)(mean_u)
• variance of variable v(var_v)
• variance of variable w(var_w)
• Vertical wind velocity (w)(mean_w)
• variance of q(var_q)
• Water vapor density (q)(mean_q)
• Virtual temperature (T)(mean_t)
• variance of t(var_t)
• lat(lat)
• vertical (elevation) wind angle(elev)
• condensation pressure(cp)
• number of c samples removed due to spikes(n_spk_c)
• variance of c(var_c)
• number of w samples removed due to spikes(n_spk_w)
• number of t samples removed due to spikes(n_spk_t)
• number of v samples removed due to spikes(n_spk_v)
• number of u samples removed due to spikes(n_spk_u)
• standard deviation of wind elevation angle(std_elev)
• number of q samples removed due to spikes(n_spk_q)
• Friction velocity(ustar)
• vector averaged wind speed(wind_spd)
• rotated covariance uw(cvar_rot_uw)
• 0=real or 1=dummy value of cp(real_cp)
• average atmospheric pressure (IGRA internal sensor)(atm_pres)
• number of valid c samples(n_good_c)
• mean value of \spike\ v samples(mean_spk_v)
• number of samples with \IRGA hardware problem\ flag(n_bad_irga)
• mean value of \spike\ w samples(mean_spk_w)
• rotated covariance ut(cvar_rot_ut)
• mean value of out of range values and spikes of t -9999 if no spikes(mean_spk_t)
• mean value of \spike\ u samples(mean_spk_u)
• rotated covariance uv(cvar_rot_uv)
• covariance uc(cvar_uc)
• vector averaged wind direction(wind_dir)
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• uw covariance(cvar_uw)
• covariance uv(cvar_uv)
• rotated covariance uc(cvar_rot_uc)
• time(time)
• covariance ut(cvar_ut)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• covariance vc(cvar_vc)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• Time offset of tweaks from base_time(time_offset)
• latent heat flux(lv_e)
• rotated covariance vw(cvar_rot_vw)
• covariance of tc(cvar_tc)
• rotated covariance vt(cvar_rot_vt)
• rotated covariance vq(cvar_rot_vq)
• covariance of tq(cvar_tq)
• 0=real or 1=dummy value of lv(real_lv)
• skewness of variable v(skew_v)
• number of valid q samples(n_good_q)
• skewness of variable w(skew_w)
• skewness of variable t(skew_t)
• skewness of variable u(skew_u)
• 0=real or 1=dummy value of mr(real_mr)
• number of valid u samples(n_good_u)
• number of valid t samples(n_good_t)
• standard deviation of wind direction(std_wind_dir)
• number of valid w samples(n_good_w)
• number of valid v samples(n_good_v)
• rotated covariance vc(cvar_rot_vc)
• skewness of variable q(skew_q)

SGP/ECOR/E10 - Sensor failure

Due to LI-7500 (H2O/CO2 infrared gas analyzer) sensor failure all humidity and CO2 data 
are incorrect for the period of Jul. 14, 2004 01:00 to Aug. 13, 2004 18:00.

• Raw data stream - documentation not supported(raw)

• covariance wc(cvar_wc)
• average atmospheric pressure (IGRA internal sensor)(atm_pres)
• mean value of \spike\ v samples(mean_spk_v)
• mean value of \spike\ w samples(mean_spk_w)
• skewness of variable c(skew_c)
• rotated covariance wq(cvar_rot_wq)
• mean value of out of range values and spikes of t -9999 if no spikes(mean_spk_t)
• kurtosis of variable q(kurt_q)
• variance of q(var_q)
• mean value of \spike\ u samples(mean_spk_u)
• Water vapor density (q)(mean_q)
• Retrieved water vapor density profile(rho)
• covariance uc(cvar_uc)
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• covariance of qc(cvar_qc)
• condensation pressure(cp)
• covariance vq(cvar_vq)
• rotated covariance uc(cvar_rot_uc)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• rotated covariance wc(cvar_rot_wc)
• variance of c(var_c)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• covariance vc(cvar_vc)
• latent heat flux(lv_e)
• latent heat of vaporization(lv)
• mixing ratio(mr)
• average temperature (IGRA internal sensor)(temp_irga)
• covariance of tc(cvar_tc)
• rotated covariance vq(cvar_rot_vq)
• covariance of tq(cvar_tq)
• covariance wq(cvar_wq)
• average voltage of IRGA cooler(mean_cooler)
• rotated covariance vc(cvar_rot_vc)
• mean co2 concentration (c)(mean_c)
• kurtosis of variable c(kurt_c)
• skewness of variable q(skew_q)

SGP/ECOR/E10 - Sensor failure

Due to sensor failure all the parameters measured by the Infrared Gas Analyzer (water 
vapor density, CO2 concentration, fluxes of latent heat and CO2, etc.) are incorrect for the 
period of 18:30 Oct. 22, 2004 to 22:00 Dec. 14, 2004. The data is irrevocably lost.

• Raw data stream - documentation not supported(raw)

• covariance wc(cvar_wc)
• number of valid c samples(n_good_c)
• average atmospheric pressure (IGRA internal sensor)(atm_pres)
• 0=real or 1=dummy value of cp(real_cp)
• number of samples with \IRGA hardware problem\ flag(n_bad_irga)
• skewness of variable c(skew_c)
• rotated covariance wq(cvar_rot_wq)
• kurtosis of variable q(kurt_q)
• variance of q(var_q)
• Water vapor density (q)(mean_q)
• Retrieved water vapor density profile(rho)
• covariance uc(cvar_uc)
• covariance uq(cvar_uq)
• number of samples with bad sonic status flag(n_bad_son_ic)
• rotated covariance uq(cvar_rot_uq)
• covariance of qc(cvar_qc)
• condensation pressure(cp)
• covariance vq(cvar_vq)
• number of samples with IRGA optical path blocked flag(n_bad_irga_light)
• rotated covariance uc(cvar_rot_uc)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• number of c samples removed due to spikes(n_spk_c)
• rotated covariance wc(cvar_rot_wc)
• variance of c(var_c)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• covariance vc(cvar_vc)
• latent heat flux(lv_e)
• mixing ratio(mr)
• average temperature (IGRA internal sensor)(temp_irga)
• covariance of tc(cvar_tc)
• number of bad or out of range c samples(n_bad_c)
• 0=real or 1=dummy value of rho(real_rho)
• rotated covariance vq(cvar_rot_vq)
• number of q samples removed due to spikes(n_spk_q)
• covariance of tq(cvar_tq)
• 0=real or 1=dummy value of lv(real_lv)
• number of valid q samples(n_good_q)
• covariance wq(cvar_wq)
• 0=real or 1=dummy value of mr(real_mr)
• average voltage of IRGA cooler(mean_cooler)
• number of bad or out of range q samples(n_bad_q)
• CO2 flux(fc)
• rotated covariance vc(cvar_rot_vc)
• mean co2 concentration (c)(mean_c)
• kurtosis of variable c(kurt_c)
• skewness of variable q(skew_q)

SGP/ECOR/E10 - Reprocess: Incorrect H2O, CO2

Due to failure of analog output circuitry in the Infrared Gas Analyzer (IRGA), CO2 and 
water vapor parameters measured by the IRGA (water vapor density, CO2 concentration, fluxes 
of latent heat and CO2) were incorrectly recorded in sonic raw data files for the period 
of 22:30 Dec. 14, 2004 to 22:00 Jan. 11, 2005. The data could be recovered from IRGA raw 
serial files (00 level).

• Raw data stream - documentation not supported(raw)

• covariance wc(cvar_wc)
• number of valid c samples(n_good_c)
• 0=real or 1=dummy value of cp(real_cp)
• number of samples with \IRGA hardware problem\ flag(n_bad_irga)
• skewness of variable c(skew_c)
• rotated covariance wq(cvar_rot_wq)
• kurtosis of variable q(kurt_q)
• variance of q(var_q)
• Water vapor density (q)(mean_q)
• Retrieved water vapor density profile(rho)
• covariance uc(cvar_uc)
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• covariance of qc(cvar_qc)
• condensation pressure(cp)
• covariance vq(cvar_vq)
• rotated covariance uc(cvar_rot_uc)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• number of c samples removed due to spikes(n_spk_c)
• rotated covariance wc(cvar_rot_wc)
• variance of c(var_c)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• covariance vc(cvar_vc)
• latent heat flux(lv_e)
• latent heat of vaporization(lv)
• mixing ratio(mr)
• covariance of tc(cvar_tc)
• number of bad or out of range c samples(n_bad_c)
• 0=real or 1=dummy value of rho(real_rho)
• rotated covariance vq(cvar_rot_vq)
• number of q samples removed due to spikes(n_spk_q)
• covariance of tq(cvar_tq)
• 0=real or 1=dummy value of lv(real_lv)
• number of valid q samples(n_good_q)
• covariance wq(cvar_wq)
• 0=real or 1=dummy value of mr(real_mr)
• number of bad or out of range q samples(n_bad_q)
• CO2 flux(fc)
• rotated covariance vc(cvar_rot_vc)
• mean co2 concentration (c)(mean_c)
• kurtosis of variable c(kurt_c)
• skewness of variable q(skew_q)

SGP/ECOR/E10 - Reprocess: Incorrectly flagged (marked as "bad") H2O/CO2 data

Due to system clock instability on ECOR computers their system time is adjusted 
approximately once per hour; sometimes this adjustment leads to backward time jumps over midnight, 
into the previous day. In this case all the data based on CO2/H2O measurements might be 
erroneously marked as bad.

• covariance wc(cvar_wc)
• number of valid c samples(n_good_c)
• 0=real or 1=dummy value of cp(real_cp)
• skewness of variable c(skew_c)
• rotated covariance wq(cvar_rot_wq)
• variance of q(var_q)
• Water vapor density (q)(mean_q)
• covariance uc(cvar_uc)
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• covariance of qc(cvar_qc)
• condensation pressure(cp)
• covariance vq(cvar_vq)
• rotated covariance uc(cvar_rot_uc)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• number of c samples removed due to spikes(n_spk_c)
• rotated covariance wc(cvar_rot_wc)
• variance of c(var_c)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• covariance vc(cvar_vc)
• latent heat flux(lv_e)
• latent heat of vaporization(lv)
• mixing ratio(mr)
• covariance of tc(cvar_tc)
• number of bad or out of range c samples(n_bad_c)
• 0=real or 1=dummy value of rho(real_rho)
• rotated covariance vq(cvar_rot_vq)
• covariance of tq(cvar_tq)
• number of q samples removed due to spikes(n_spk_q)
• 0=real or 1=dummy value of lv(real_lv)
• number of valid q samples(n_good_q)
• covariance wq(cvar_wq)
• 0=real or 1=dummy value of mr(real_mr)
• number of bad or out of range q samples(n_bad_q)
• CO2 flux(fc)
• rotated covariance vc(cvar_rot_vc)
• mean co2 concentration (c)(mean_c)
• skewness of variable q(skew_q)

SGP/ECOR/E10 - Missing data

Data are missing and unrecoverable.

• covariance wc(cvar_wc)
• skewness of variable c(skew_c)
• rotated covariance wq(cvar_rot_wq)
• rotated covariance wt(cvar_rot_wt)
• vw covariance(cvar_vw)
• covariance vt(cvar_vt)
• covariance vq(cvar_vq)
• number of samples with IRGA optical path blocked flag(n_bad_irga_light)
• rotated covariance wc(cvar_rot_wc)
• h(h)
• average temperature (IGRA internal sensor)(temp_irga)
• number of bad or out of range c samples(n_bad_c)
• Dummy altitude for Zeb(alt)
• covariance wq(cvar_wq)
• wT covariance(cvar_wt)
• number of bad or out of range q samples(n_bad_q)
• CO2 flux(fc)
• variance of u(var_rot_u)
• variance of v(var_rot_v)
• lon(lon)
• variance of w(var_rot_w)
• kurtosis of variable q(kurt_q)
• Retrieved water vapor density profile(rho)
• kurtosis of variable u(kurt_u)
• number of samples with bad sonic status flag(n_bad_son_ic)
• kurtosis of variable t(kurt_t)
• covariance of qc(cvar_qc)
• number of bad or out of range t samples(n_bad_t)
• number of bad or out of range u samples(n_bad_u)
• kurtosis of variable w(kurt_w)
• number of bad or out of range v samples(n_bad_v)
• kurtosis of variable v(kurt_v)
• number of bad or out of range w samples(n_bad_w)
• Vertical angle of wind(phi)
• rotated mean v(mean_rot_v)
• mean horizontal wind speed(mean_rot_u)
• rotated mean w(mean_rot_w)
• latent heat of vaporization(lv)
• mixing ratio(mr)
• momentum flux (dynamic)(k)
• 0=real or 1=dummy value of rho(real_rho)
• base time(base_time)
• average voltage of IRGA cooler(mean_cooler)
• mean co2 concentration (c)(mean_c)
• kurtosis of variable c(kurt_c)
• Cross-boom wind velocity (v)(mean_v)
• variance of variable u(var_u)
• Down-boom wind velocity (u)(mean_u)
• variance of variable v(var_v)
• variance of variable w(var_w)
• Vertical wind velocity (w)(mean_w)
• variance of q(var_q)
• Water vapor density (q)(mean_q)
• Virtual temperature (T)(mean_t)
• variance of t(var_t)
• lat(lat)
• vertical (elevation) wind angle(elev)
• condensation pressure(cp)
• number of c samples removed due to spikes(n_spk_c)
• variance of c(var_c)
• number of w samples removed due to spikes(n_spk_w)
• number of t samples removed due to spikes(n_spk_t)
• number of v samples removed due to spikes(n_spk_v)
• number of u samples removed due to spikes(n_spk_u)
• standard deviation of wind elevation angle(std_elev)
• number of q samples removed due to spikes(n_spk_q)
• Friction velocity(ustar)
• vector averaged wind speed(wind_spd)
• rotated covariance uw(cvar_rot_uw)
• 0=real or 1=dummy value of cp(real_cp)
• average atmospheric pressure (IGRA internal sensor)(atm_pres)
• number of valid c samples(n_good_c)
• mean value of \spike\ v samples(mean_spk_v)
• number of samples with \IRGA hardware problem\ flag(n_bad_irga)
• mean value of \spike\ w samples(mean_spk_w)
• rotated covariance ut(cvar_rot_ut)
• mean value of out of range values and spikes of t -9999 if no spikes(mean_spk_t)
• mean value of \spike\ u samples(mean_spk_u)
• rotated covariance uv(cvar_rot_uv)
• covariance uc(cvar_uc)
• vector averaged wind direction(wind_dir)
• covariance uq(cvar_uq)
• rotated covariance uq(cvar_rot_uq)
• uw covariance(cvar_uw)
• covariance uv(cvar_uv)
• rotated covariance uc(cvar_rot_uc)
• time(time)
• covariance ut(cvar_ut)
• mean value of out of range values and spikes of c -9999 if no spikes(mean_spk_c)
• covariance vc(cvar_vc)
• mean value of out of range values and spikes of q -9999 if no spikes(mean_spk_q)
• Time offset of tweaks from base_time(time_offset)
• latent heat flux(lv_e)
• rotated covariance vw(cvar_rot_vw)
• covariance of tc(cvar_tc)
• rotated covariance vt(cvar_rot_vt)
• rotated covariance vq(cvar_rot_vq)
• covariance of tq(cvar_tq)
• 0=real or 1=dummy value of lv(real_lv)
• skewness of variable v(skew_v)
• number of valid q samples(n_good_q)
• skewness of variable w(skew_w)
• skewness of variable t(skew_t)
• skewness of variable u(skew_u)
• 0=real or 1=dummy value of mr(real_mr)
• number of valid u samples(n_good_u)
• number of valid t samples(n_good_t)
• standard deviation of wind direction(std_wind_dir)
• number of valid w samples(n_good_w)
• number of valid v samples(n_good_v)
• rotated covariance vc(cvar_rot_vc)
• skewness of variable q(skew_q)

SGP/ECOR/E10 - Reprocess: Wind Direction Incorrect

It was discovered that the E10 ECOR boom is aligned 17 degrees to the west of true north.  
Therefore, all wind direction data for the stated period is 17 degrees too high.  
Subtract 17 degrees from the wind direction to give the correct direction.

The E10 configuration file was modified to correct this problem.

• vector averaged wind direction(wind_dir)

SGP/ECOR/E10 - LI-7500 Pressure and Temperature missing

The LI-7500 pressure and temperature were not recorded;
the serial datastream was not being captured by the ECOR.

• average temperature (IGRA internal sensor)(temp_irga)
• average atmospheric pressure (IGRA internal sensor)(atm_pres)

SGP/ECOR/E10 - CO2 and Latent Heat Fluxes Incorrect

The CO2 and latent heat fluxes were incorrect because the sonic anemometer was not working 
properly.

• covariance wc(cvar_wc)
• covariance wq(cvar_wq)
• rotated covariance wq(cvar_rot_wq)
• variance of q(var_q)
• Water vapor density (q)(mean_q)
• rotated covariance wc(cvar_rot_wc)
• variance of c(var_c)
• CO2 flux(fc)
• mean co2 concentration (c)(mean_c)
• latent heat flux(lv_e)

SGP/ECOR/E10 - Incorrect CO2 fluxes

The analog CO2 signal from the LI-7500 to the sonic anemometer became very noisy and 
incorrect CO2 fluxes resulted. Sonic anemometer was replaced.

• CO2 flux(fc)