IHOP 2002 Daily Precipitation Composite

1.0 General Description

The IHOP 2002 Daily Precipitation Composite is one of several precipitation datasets provided for the International H2O Project 2002 (IHOP 2002). This precipitation composite is composed of data from several sources: Data from these sources were quality controlled and merged to form this precipitation composite. This composite contains data for the IHOP 2002 domain and time period (13 May 2002 through 25 June 2002). The IHOP 2002 domain is approximately 90W to 105W longitude and 32N to 42N latitude.

Section 2.0 contains a detailed description of the instrumentation, siting, and algorithms used by the source network to collect the data. Section 2.1 contains a detailed description of the format of the composite dataset. See Section 2.2 for information on data processing, and Section 3.0 below for the quality control processing performed by the University Corporation for Atmospheric Research/Joint Office for Science Support (UCAR/JOSS) on this dataset. Section 4.0 contains references.

2.0 Detailed Data Description

2.0.1 NCEP/EMC Daily Precipitation Algorithms

The Environmental Modeling Center (EMC), previously the Climate Prediction Center (CPC), is a component of the National Centers for Environmental Prediction (NCEP).

The NCEP/EMC daily precipitation dataset was formed by extracting data with NCEP/EMC element codes of PC and PP that fall on the hour. The NCEP/EMC observations of daily precipitation can include multiple measurements for a given day. When this occurs, the precipitation for that day is set to missing in this UCAR/JOSS IHOP 2002 Daily Precipitation Composite. The value reported for any daily observation represents data collected during the previous 24 hours. All raw precipitation data can be found on codiac in the GCIP/EOP Surface: Precipitation NCEP/EMC Gage Only Daily Dataset. NCEP/EMC excludes any precipitation value greater than 20 inches from the NCEP/EMC daily precipitation dataset. The information above was gathered from personal correspondence with NCEP/EMC during 1997 and 1998.

Data from cooperators networks such as NCEP/EMC has hundreds of reporting locations which change from incremental to accumulator and back to incremental. Others changed a couple of times and have now settled on accumulators.

Anyone using this data must be aware of the dynamic changes in the network of sites that are processed by HADS and be aware of the potential lag time from when a change is implemted to when NCEP/EMC becomes aware of the change. This is far, far from a stable environment.

To help users in identifying these changes, UCAR/JOSS checks the NCEP/EMC daily precipitation data for possible accumulated values and resets the UCAR/JOSS Quality Control flags for all "unchecked", "good", and "trace" accumulated precipitation values in the NCEP/EMC network to "questionable". For this purpose, UCAR/JOSS defines accumulated precipitation to be six identical, sequential daily precipitation values potentially followed by additional identical values or values that increase over time.

2.0.2 NWS Cooperative Observer (COOP) Daily Precipitation Algorithms

The NWS Cooperative Observer Daily Precipitation dataset was formed by extracting the daily incremental and accumulative precipitation values provided in the National Climatic Data Center (NCDC) TD 3200 dataset. Both incremental and accumulative values are included in this IHOP 2002 Daily Precipitation Composite. The incremental value reported for any daily observation represents data collected during the previous 24 hours. The accumulative value is a total of precipitation over one or more days when the observer made no measurements. The days on which no measurements were made in an accumulation period are represented with the missing value of -999.99, but flagged with a quality control flag "1" to differentiate them from non-accumulation period missing data. The day which has a data value of the accumulated total of precipitation during all of the accumulation days is flagged with a quality control flag "2". (For a description of the quality control flags, see section 3.0 below.) The TD3200 data contained sequences of missing days with no indication that they were part of an accumulation period, followed by a day with a value marked as an end accumulation total. Since there is no way to know when the accumulation period began in these instances, missing days in the TD3200 dataset that are not marked as being part of an accumulation period and which are followed by an end accumulation total, are recorded simply as missing days in this composite dataset, with a "7" quality control flag. For more information, see NCDC, 1991.

2.0.3 Daily Precipitation Extracted from IHOP 2002 Hourly Precipitation Composite

Each daily precipitation incremental value in this dataset was formed by summing the 24 hourly precipitation values extracted from each IHOP 2002 Hourly Precipitation Composite record. The hourly values are summed from hour 0100 through hour 2400 (0000 UTC next day). The value reported for any daily observation represents data collected during the previous 24 hours.

2.1 Detailed Format Description

The Daily Precipitation Composite contains six metadata parameters and four data parameters. The metadata parameters describe the station location and time at which the data were collected. The four data parameters repeat once for each day in the monthly record. Every record has 31 days reported, regardless of the actual number of days in the month. For months with less than 31 days, the extra days are reported as missing (i.e., '-999.99 7 M'). Each 24 hour precipitation value has an associated observation hour. The observation hour is the ending UTC hour for the 24 hour period for which the precipitation value is valid. Data values are valid for the 24 hours preceding the observation hour given for the day. A Quality Flag and a Quality Control (QC) Code are assigned to each data value during quality control processing. For a list of possible Quality Flag and QC Code values see the Quality Control section 3.0. The table below details each parameter.
     
     Parameters               Units
     ----------------------   -------------------------------------
     Date of Observation      UTC 
     Network Identifier       Abbreviation of platform name
     Station Identifier       Network Dependent
     Latitude                 Decimal degrees, South is negative
     Longitude                Decimal degrees, West is negative
     Station Occurrence       Unitless 
     Daily Precip Value       millimeters 
     Quality Flag             See list of Definitions 
     QC Code                  See list of Definitions 
     Observation hour         Beginning UTC hour for 24 hour period
                                   for which value is valid. 
                     

2.2 Data Remarks

Negative precipitation and values too large to be represented in the output format were changed to missing ('-999.99') and were assigned the 'C' QC code.

The NCDC Summary of Day Co-operative data have observation hours that vary by station. Data values are valid for the 24 hours preceding the observation hour given for the day.

UCAR/JOSS also checks the NCEP/EMC daily precipitation data for possible accumulated values and resets the UCAR/JOSS Quality Control flags for all "unchecked", "good", and "trace" accumulated precipitation values in the NCEP/EMC network to "questionable".

3.0 Quality Control Processing

This precipitation composite is composed of data from several sources Each of these datasets was independently Quality Controlled.

Gross limit checks were used to determine the quality of the data in this composite. Data values less than 101.6 millimeters (4 inches) were flagged as good. Any data value greater than or equal to 101.6 millimeters but less than 127 millimeters (5 inches) was flagged as questionable. Any data value greater than or equal to 127 millimeters was flagged as unlikely. Several questionable and unlikely data values were also manually inspected. After inspection, the quality control code and flag may have been manually updated to better reflect the likelihood of the actual occurrence of the precipitation value based on an isohyet analysis. UCAR/JOSS also checks the NCEP/EMC daily precipitation data for possible accumulated values and resets the UCAR/JOSS Quality Control flags for all "unchecked", "good", and "trace" accumulated precipitation values in the NCEP/EMC network to "questionable". For this purpose, UCAR/JOSS defines accumulated precipitation to be six identical, sequential daily precipitation values potentially followed by additional identical values or values that increase over time. Data were never modified, unless the precipitation value was negative or too large to be represented in the output format. In these cases the data value was flagged with a QC code of 'C' and changed to a missing value (i.e., '-999.99'). Table 1 and 2 list the quality control flags and codes plus their meanings. After the datasets were merged to form the IHOP 2002 Daily Precipitation Composite, a statistics program was executed to ensure that the quality of the individual datasets had been retained.

     
     Table 1
     
     Quality Control Flag          Description
     ---------------------------   ---------------------------------------------
     0                             No qualifier required 
     1                             Accumulation period
     2                             End of Accumulation period
     3                             Deleted value. Original data was unreadable.
     4                             Trace of precipitation.
     5                             Probable amount as a result of melting frozen
                                   precipitation.
     6                             Suspect amount relative to time or period of
                                   occurrence.
     7                             Missing value
     
     Table 2
     
     QC Code             Description
     -----------------   ------------------------------------------
     U                   Unchecked
     G                   Good
     M                   Normally recorded but missing
     D                   Questionable
     B                   Unlikely
     N                   Not available or Not observed. 
     X                   Glitch
     E                   Estimated
     C                   Reported value exceeds output format field
                         size or was negative precipitation.
     T                   Trace
     I                   Derived parameter can not be computed due
                         to insufficient data.

4.0 References

National Climatic Data Center, 1991: Surface Land Daily Cooperative; Summary of the Day TD 3200. National Climatic Data Center, Asheville, NC, 25 pp.