Meteor DVS Data Quality Control Report



David F. Zierden and Shawn R. Smith






World Ocean Circulation Experiment (WOCE)




Surface Meteorological Data Assembly Center

Center for Ocean Atmospheric Prediction Studies

Florida State University


August 20, 2001


Report WOCEMET 97-19




Version 3.0

Addendum:

Member's of the WOCE Hydrographic Project Office (WHPO) and WOCEMET met at the 13th Data Products Committee (DPC) meeting in College Station, TX to discuss reconciliation of the WOCE cruise line designators. This was done in anticipation of the future release of version 3 of the WOCE global data set, and resulted in changes to several WOCE cruise line designations.

On December 21, 2000, WOCEMET changed the WOCE designator for the cruise AR_07E/05 to the updated form, A__01_/00.

The WOCE designator, IR_03_/03, has been added to the ISS02_/07 cruise.

The WOCE designator, IR_03N/02, has been added to the ISS02_/09 cruise

On August 20, 2001 WOCEMET combined the WOCE designators AR_15_/02 and AR_15_/03 to be referenced as AR_15_/02. The quality control information for this data has been left in this report for the user, but please note that the lines previously known as AR_15_/02 and AR_15_/03 are now combined together under AR_15_/02.



1. Introduction:

This report summarizes the quality of surface meteorological data collected by the Meteor (identifier: DBBH) DVS system during WOCE cruises in 1990 through 1995. The data were provided to the Florida State University Data Assembly Center (DAC) on CD-rom by Khosro Motamedi at the Bundesamt für Seeschiffahrt und Hydrographie, Germany. They were converted to standard DAC netCDF format and then processed using an automated data screening program which adds quality control flags to the data, highlighting potential problems. Finally, the Data Quality Evaluator reviewed all the data and the preprocessor flags. Flags were added, modified, and deleted according to the judgement of the Data Quality Evaluator and other DAC personnel. An in depth description of the WOCE quality control procedures can be found in Smith et al. (1996). The data quality control report summarizes all flags for the Meteor DVS data and provides reasons for the assigned flags.



2. Data Available:

The Meteor DVS data included observations recorded every 50 to 60 seconds on all of the WOCE cruises. The DAC rounded the time stamps to the nearest minute, resulting in duplicate times on rare occasions. Two different sets of navigation data were provided to the DAC, one from the inertial navigation system (INS) and the other from the TRANSIT satellite system (SATNAV). As a result, two independent sets of platform course and platform speed data were available from the navigation data. All meteorological data, except for radiation and pressure measurements, were taken with two independent sensors, one mounted on the port side and the other on the starboard side of the vessel. Below is a list of the variables for which values were collected and the instrument system that made the measurements.

TIMETime
LATLatitude (INS)
LONLongitude (INS)
LAT2Latitude (SATNAV)
LON2Longitude (SATNAV)
PL_CRS2Platform Course (SATNAV)
PL_HDPlatform Heading (gyrocompass)
PL_CRSPlatform Course (INS)
PL_SPDPlatform Speed (INS)
PL_SPD2Platform Speed (SATNAV)
PL_SPD3Platform Speed (EMlog)
PL_WDIRPlatform (ship) Relative Wind Direction (port)
PL_WSPDPlatform (ship) Relative Wind Speed (port)
PL_WDIR2Platform (ship) Relative Wind Direction (stbd)
PL_WSPD2Platform (ship) Relative Wind Speed (stbd)
DIREarth Relative Wind Direction (port)
SPDEarth Relative Wind Speed (port)
DIR2Earth Relative Wind Direction (stbd)
SPD2Earth Relative Wind Speed (stbd)
TSSea Temperature (port)
TS2Sea Temperature (stbd)
PAtmospheric Pressure
TAir Temperature (port)
T2Air Temperature (stbd)
TDDewpoint Temperature (port)
TD2Dewpoint Temperature (stbd)
RHRelative Humidity (port)
RH2Relative Humidity (stbd)
RADShort Wave (Solar) Radiation
RAD2Ultraviolet Radiation

The quality controlled data set does not necessarily include all of these variables in every WOCE cruise. If the values for a variable were missing or highly suspect for an entire cruise, that variable was removed from the final quality controlled data set. The yearly summaries provide information about exactly which variables were not included for each cruise.



3. Overall Quality:

The quality of the Meteor DVS data is excellent for many of the variables. On the other hand, the variables T, T2, TD, TD2, RH, and RH2 have a major problem related to the placement of the instruments resulting in extensive flagging of these variables. Both instrument sets measuring temperature and moisture variables are located on the superstructure in front of and above the exhaust stack of the ship. Consequently, measurements of temperature, dewpoint temperature, and relative humidity are greatly influenced by the ship's exhaust whenever the ship-relative wind direction was in the vicinity of 180 degrees (blowing from stern to bow). In addition, the radiation data are highly suspect for many of the cruises. The satellite navigation data are also unreliable. The major problems present throughout the six years of data are discussed in detail in section 4. Sections 5 through 9 contain yearly summaries detailing the distribution of flags and minor problems specific to each year of data.



4. Major Problems:

4.1 Exhaust Problem

As stated earlier, the research vessel's exhaust creates a problem with the measurement of air temperature and the quantities used to calculate dewpoint temperature and relative humidity. The instruments that sample these meteorological variables are placed on the tower at a height above the top of the exhaust stack, which is located behind the tower (see Figure 1). Consequently, any ship relative wind blowing from the stern towards the bow (in the vicinity of 180 degrees) carries the rising exhaust to the instruments. Because the exhaust is warm and moist, the measured temperature and dewpoint temperature suddenly rises one to five degrees C when the exhaust hits the instruments. After a change in ship-relative wind direction, the exhaust cleares from the instruments and temperature and dewpoint return to normal. The data are affected for only a few minutes when the ship-relative wind direction is changing rapidly ( i.e., caused by the turning of the research vessel). At other times the data are affected for much longer periods, in some cases up to several hours, if a constant light wind from the stern keeps the exhaust around the instruments. Relative humidity measurements are also influenced by this problem, although the response to trends in the temperature and dewpoint temperature are not uniform.

Figure 1: Research Vessel Meteor



The analyst attempted to flag all exhaust events with a "K". Differences in response time and exposure of the instruments resulted in varying times and amounts of flagging among the six different variables. In addition, the exhaust problem was not always discernable from normal background noise and some events may not have been flagged completely in all of the variables. The user may wish to apply an automated filter based on ship-relative wind direction, but such a task was beyond the scope of DAC quality control procedures. Figure 2 shows a typical plot of T, TD, RH, and PL_WDIR and the flagging of these variables.

4.2 Temperature

In addition to the exhaust problem, temperature data were also sensitive to radiational heating. Inadequate ventilation of the instrument and direct sunlight sometimes combined to force

Figure 2: Flagging of the Exhaust Problem



unrealistically high temperature readings from the instrument least exposed to the wind. Although this problem could be differentiated from the exhaust problem by checking the platform relative wind direction, it was flagged similarly with the "K" flag. Relative humidity measurements were also affected by this ventilation problem and were flagged with the "K".

4.3 Earth Relative Winds

The earth-relative winds were fairly reliable and showed very little influence of the ship's movement in the time series plots. Some flow distortion did occur, specifically when the ship relative winds were from 100 degrees or 260 degrees. The flow distortion was characterized by sudden changes in earth-relative wind direction of 10 to 20 degrees and drops in earth relative wind speed of 1 to 3 m/s. The most likely cause of the flow distortion was the tower, partially blocking the flow to the port instruments when the ship-relative winds were from 100 degrees. Likewise, a ship relative-wind direction of 260 degrees caused the starboard instruments to be blocked. This problem was not flagged, but should be considered by the user of the data. The impact of flow distortion is dependent on the averaging period used (Smith et al. 1998). The WMO recommends combining the data from the two instrument sets, always using measurements from the one more freely exposed to the wind (WMO 1983).

4.4 Latitude and Longitude

Two separate sets of latitude and longitude data were collected using SATNAV (LAT2 and LON2) and INS (LAT and LON) navigation systems. The SATNAV data were collected using the older and less reliable TRANSIT satellites. When no signals were available, the system changed over to using dead reckoning. The INS is a fully integrated system that makes use of GPS data from the Trimble 4000 AX. The INS is a state of the art navigation system and quality control has proven the data very reliable. Both sets of navigation data were visually quality controlled, but were not preprocessed to check for unrealistic ship movement or positions over land. The visual quality control process identified erroneous data, which may have resulted in an "L" flag from the preprocessor for position over land, and flagged them instead with a "J" for bad data or a "K" for caution. Again, the INS data was found to be of very high quality and should be preferred by the user for most position information. The SATNAV data should only be used when the INS data is flagged or missing.

Other quality controlled data sets released by the DAC consist of only data which are identified with a valid TIME, LAT, and LON stamp. The Meteor quality controlled data contains some records with missing LAT or LON data; however, LAT2 and LON2 will be available for records to identify the ship's position. The inverse, missing LAT2 and LON2 with available LAT and LON may also occur Data are only excluded if no position information is available from either the INS or the SATNAV systems. The quality controlled data contains no records which are missing data from both the INS and SATNAV systems.

Periods occurred where the SATNAV values for latitude and longitude would differ significantly from the INS values. These periods lasted from less than one day to over one month. During these times the values for latitude and longitude would either continue to drift further apart or remain different by a constant amount. The SATNAV data were determined to be in error by comparison to independent platform heading data and because the SATNAV data often yielded positions over land. LAT2 and LON2 were assigned the "J" flag during these periods. During some of these episodes PL_CRS2 and PL_SPD2, calculated from the SATNAV data, also proved to be erroneous when compared to independent variables (PL_HD, PL_CRS, PL_SPD, and PL_SPD3) and were flagged. At other times PL_CRS2 and PL_SPD2 seemed to agree well with the independent variables even though the satellite navigation was in error. No flags were assigned to PL_CRS and PL_SPD in this case until the DAC can learn more about the exact nature of satellite navigation problem. LAT and LON should be used exclusively when the SATNAV data is flagged with a "J", while PL_CRS and PL_SPD should also be preferred during these periods, even if PL_CRS2 and PL_SPD2 are not flagged.

4.5 Moisture discontinuities

Discontinuities occurred in the plots of dewpoint and relative humidity where the local average would suddenly change dramatically, as seen in figure 3. An adjustment of the instruments may have caused the some of the discontinuities, as the port and starboard measurements would differ by a constant amount before the change and agree more closely afterwards. The "H" flag was placed at the points of discontinuity, but it is left for the user to determine which set of data is more accurate.


Figure 3: Moisture discontinuity


4.6 Climatology

The prescreener compared the values of pressure, sea temperature, air temperature, relative humidity, and wind speed to a climatology (da Silva et al., 1994) and assigned the "G" flag for values outside of four standard deviations from the mean. These "G" flags often occurred where there were other problems in the data, in which case they were overwritten with more appropriate
flag by the analyst. Other times the values flagged with the "G" represented realistic values. These flags were left unaltered, calling attention to relatively extreme events.

4.7 PL_SPD3

The PL_SPD3 variable exhibited an increased number of negative spikes beginning in 1992. These spikes occurred when the ship was underway with a speed greater than 2 m/s. Most spikes were flagged individually with the "S" flag. Some blocks of data had too many spikes to flag individually. The entire blocks were assigned the "K" flag and should be used with caution. As an alternative, the user may want to filter these data.

4.8 Time Duplication

The Meteor data were typically gathered with a frequency between 50 to 60 seconds. The DAC only stores data every minute, requiring the time to be rounded to the nearest minute. In a few cases the rounding produced two different data records with the same time stamp. The TIME variable for these records were each assigned the "T" flag by the preprocessor for time duplication. Other records that received the "T" flags had the same time stamp and exactly equal values for all variables. These exact duplicates were removed from the quality controlled data set.

4.9 Spikes

Isolated positive and negative spikes occurred in most of the variables throughout the data. Spikes are relatively common occurrence in automated data, caused by such factors as electrical interference and ship accelerations. These individual points were assigned the "S" flag.




5. 1990 Flag Summary

The 1990 Meteor data contains values from two cruises covering seven WOCE hydrographic lines. Details of each cruise including start and end dates, number of records, number of values, number of flags, percentage flagged, and variables not included with the quality controlled data are listed in Table 5.1. A total of 2,243,108 values were evaluated with 63,074 flags added by the preprocessor and Data Quality Evaluator for a total of 2.81 percent of the values being flagged. Table 5.2 details the distribution of flags among the different variables.

Table 5.1:
Statistical Cruise Information

CTCDatesNumber of RecordsNumber of ValuesNumber of FlagsPercentage FlaggedVariables not included
 A__21_/00
SR_02_/02
S__01_/00
S__04A/01
01/23/90 - 03/07/9043,8351,227,38040,7143.32PL_CRS2, PL_SPD2
AR_04E/01
AR_04W/01
AR_15_/01
10/01/90 - 10/27/9036,2761,015,72822,3602.2PL_CRS2, PL_SPD2


Description of Problems:

5.1 Truncation of PL_CRS, PL_SPD

All PL_CRS2 and PL_SPD2 data are excluded from the quality controlled data because of a likely truncation error. DAC personnel have confirmed the data were truncated on the CD-rom's that were provided by the Bundesamt für Seechiffahrt und Hydrographie. Values were missing for any PL_CRS over 99.9 degrees and any PL_SPD over 5.1 m/s (9.9 kts). Future recovery of the data is unlikely.

Table 5.2: Number of Flags and Percentage Flagged for Each Variable


VariableBDGJKSTTotal Number of flagsPercentage of Variable Flagged
TIME      440.00*
LAT   654 1 6550.82
LON   22   220.03
LAT21  1170   11711.46
LON2   1170   11701.46
PL_HD     1 10.00*
PL_CRS     1 10.00*
PL_SPD3    2 50.01
PL_SPD3   34 1 350.04
PL_WDIR   125 1 1260.16
PL_WSPD   154 2 1560.19
PL_WDIR2   123 1 1240.16
PL_WSPD2   140 2 1420.18
DIR   556 9 5650.71
SPD  146540 14 7000.87
DIR2   550 10 5600.70
SPD2  56526 15 5970.75
TS  2002144 2 21482.68
TS2  2008143 4 21552.68
P   143   1430.18
T 16 153918115 936511.69
T2  2761397822413 991012.38
TD 16 15329017 30773.84
TD2   805869410 950911.87
RH   15384241 857810.71
RH2   13961045912 1186714.81
RAD2  122   1240.15
RAD2   164   1640.20
Total Number of Flags
6

32

4488

10537

47883

124

4

63074

Percentage of All Values Flagged
0.00*

0.00*

0.20

0.47

2.14

0.01

0.00*

2.81



* less than 0.01 percent flagged

5.2 Suspicious Data

Isolated short periods of suspiciously low values appeared in the variables T, T2, TD, TD2, RH, and RH2. These periods were one to 15 minutes in duration and the values were up to two degrees (10% for relative humidity) lower than surrounding values in an otherwise smooth time series. No corresponding changes in wind or radiation measurements were found to verify these sudden drops as realistic. All values during these periods were assigned the "K" flag.

5.3 Erroneous Data

Problems occurred on 1/26/90 and 2/18/90 where all wind and meteorological data were a constant, unrealistic value for hundreds of records in a row (i.e., TS, T, TD of 40.0 C). All of these values were assigned the "J" flag. On 3/03/90 through 3/05/90 the plots for T2, TD2, and RH2 had periods where the data was very erratic, with many erroneous values (i.e., T2 of -30 C). These periods were also flagged with a "J".

5.4 LAT and LON

During the first one third of 1/23/90 LAT was recorded as exactly zero while LON was missing. These LAT values were flagged with a "J". The ship was docked in port at this time and later values of LAT and LON should yield the correct position. Both LAT and LON were exactly zero for 22 minutes on 01/03/90. These values were also flagged with a "J".

5.5 LAT2 and LON2

For several hours on 1/23/90 LAT2 and LON2 were extremely erratic with large discontinuities. All values during this period received the "J" flag and should be not be used.

5.6 Miscellaneous Flags

T and TD each received 16 "D" flags from the prescreener for failing the T > TD test. Isolated "B" flags were assigned to LAT3, PL_SPD2, and RAD by the prescreener.



6. 1991 Flag Summary

The 1991 Meteor data contain values from five cruises covering seven WOCE hydrographic lines. Details of each cruise including start and end dates, number of records, number of values, number of flags, percentage flagged, and variables not included in the quality controlled data are listed in Table 6.1. A total of 3,095,189 values were evaluated with 62,794 flags added by the preprocessor and Data Quality Evaluator for a total of 2.03 percent of the values being flagged. Table 6.2 details the distribution of flags among the different variables.

Table 6.1: Statistical Cruise Information

CTCDatesNumber of RecordsNumber of ValuesNumber of FlagsPercentage FlaggedVariables not Included
 AR_15_/02 12/30/90 - 01/16/9124,956698,76811,9931.72PL_CRS2, PL_SPD2
AR_15_/031/18/91 - 2/07/9128,167788,6767,3060.93PL_CRS2, PL_SPD2
A__09_/002/10/91 - 3/23/9137,2441,042,83219,2701.85PL_CRS2, PL_SPD2
AR_04E/02
AR_04W/02
AR_15_/04
5/23/91 - 6/02/9112,677316,9259,9643.14PL_CRS2, PL_SPD2, T, TD, RH
A__01E/009/18/91 - 9/25/919,385247,98814,2615.75LAT2, LON2, PL_CRS2, PL_SPD2


Description of Problems:

6.1 Truncation of PL_CRS2, PL_SPD2

All PL_CRS2 and PL_SPD2 data are excluded from the quality controlled data because of a likely truncation error. DAC personnel have confirmed the data were truncated on the CD-rom's that were provided by the Bundesamt für Seeschiffahrt und Hydrographie. Values were missing for any PL_CRS over 99.9 degrees and any PL_SPD over 5.1 m/s (9.9 kts). Future recovery of the data is unlikely.

Table 6.2: Number of Flags and Percentage flagged for Each Variable


VariableBGHIJKSTTotal Number of flagsPercentage of Variable Flagged
TIME       880.00*
LAT    134203  3370.30
LON    60196  2560.23
LAT2    4771 9 47804.64
LON2    4420   44204.29
PL_HD         0.00*
PL_CRS    34196  2300.20
PL_SPD    341963 2330.21
PL_SPD3         0.00*
PL_WDIR    281   2810.25
PL_WSPD    924   9240.82
PL_WDIR2         0.00*
PL_WSPD2         0.00*
DIR    1026 1 10270.91
SPD 182  1028 1 12111.08
DIR2    36 1 370.03
SPD2 104  36 1 1410.13
TS 154 1    1550.14
TS2 140 1    1410.13
P         0.00*
T    13241167913 1301613.05
T2     77054 77096.86
TD  8 86145664 54395.45
TD2  10  14017 14181.26
RH  8 21821199814 1420214.24
RH2  10  68088 68266.07
RAD3       30.00*
RAD2         0.00*
Total Number of Flags
3

580

36

2

17151

44948

66

8

62794

Percentage of All Values Flagged
0.00*

0.02

0.00*

0.00*

0.55

1.45

0.00*

0.00*

2.03
 

* less than 0.01 percent flagged


6.2 Missing Variables

The satellite navigation data are missing on cruise A__01E/02. PL_CRS and PL_SPD, which are calculated from the satellite navigation data, are also missing.

6.3 Erroneous Values

On cruise AR_04E/02 the port variables T, TD, and RH each reported a constant, unrealistic value for the entire cruise (T = 40 C, TD = 273.15 C, RH = 0). These variables contain no useful information on this cruise and were not included in the quality controlled data set.

6.4 Latitude and Longitude

For several hours on 3/13/91 LAT and LON were erratic with large discontinuities. All values in this period received the "K" flag and should be used with caution. PL_CRS and PL_SPD were also assigned the "K" flag at this time, since they are calculated using LAT and LON. The same problem occurred on 9/21/91, but the platform course and speed data calculated from these variables were unrealistic (PL_SPD greater than 40 m/s), suggesting the INS navigation data was erroneous. All INS data and the derivative variables, including earth relative winds, were flagged with the "J" flag during this period. Other isolated periods occurred where one or both of the INS navigation variables had zero values for many records in a row. The zero values were flagged with a "J".

On 5/23/91 the satellite navigation data began to differ over two tenths of a degree from the INS data. The problem was corrected on 5/27/91 and the two navigation data sets agreed well for the remainder of the cruise. This discrepancy was likely caused by an unconfirmed malfunction of the satellite navigation system (section 4.4 ) and LAT2 and LON2 were flagged with the "J" flag. LAT and LON should be used during this period.

6.5 Suspicious Data

Isolated short periods of suspiciously low values appeared in the variables T, T2, TD, TD2, RH, and RH2. These periods were 1 to 15 minutes in duration and the values were up to two degrees (10% for relative humidity) lower than surrounding values in an otherwise smooth time series. No corresponding changes in wind or radiation measurements were found to verify these sudden drops as realistic. All values during these periods were assigned the "K" flag.

6.6 Moisture Variables


On 9/18/91 and 9/19/91 port dewpoint temperatures were 7 degrees C greater than the starboard readings before an adjustment of the port instrument brought them within one degree of each other. The discontinuities were flagged with an "H" and all preceding port values were flagged with the "J" flag. Port relative humidity followed the same trend and was flagged similarly.

6.7 Interesting Feature

On 1/31/91 the sea temperature measurements from both instruments began to rise and fluctuate rapidly 1 to 2 degrees C. This trend began at the same time the research vessel moved over the relatively shallow water of the Rio Grande Plateau and continued through the end of the cruise. No similar behavior was observed in any of the other variables that might suggest an electronic or mechanical problem. The beginning of the trend was flagged with an "I" for both TS and TS2 and possible physical causes should be investigated before using the data between the "I" flag and the end of the cruise.



7. 1992-1993 Flag Summary

The 1992-1993 Meteor data contains values from six cruises covering four WOCE hydrographic lines. Details of each cruise including start and end dates, number of records, number of values, number of flags, percentage flagged, and variables not included in the quality controlled data are listed in Table 7.1. A total of 3,229,410 values were evaluated with 255,711 flags added by the preprocessor and Data Quality Evaluator for a total of 7.92 percent of the values being flagged. Table 7.2 details the distribution of flags among the different variables.

Table 7.1:
Statistical Cruise Information

CTCDatesNumber of RecordsNumber of ValuesNumber of FlagsPercentage FlaggedVariables not Included
 AR_04E/04
AR_04W/04
AR_15_/06
10/23/92 - 11/15/9234,367893,54238,9294.36LAT2, LON2, PL_CRS2, PL_SPD2
AR_15_/0711/18/92 - 11/30/9218,687560,61028,8615.15None
AR_15_/0812/02/92 - 12/22/9214,687440,61059,69913.55None
A__10_/0012/27/92 - 1/31/9347,6661,334,648128,2229.61RAD, RAD2


Description of Problems:

7.1 Radiation Data

Beginning 12/16/92 all RAD and RAD2 data were erroneous. RAD values were constant at -200 W/m2 while RAD2 values were -20 W/m2. For this reason RAD and RAD2 were not included in the quality controlled data set on cruise A__10_/00. The erroneous values were flagged with a "J" on cruise AR_15_/08. On the other cruises RAD and RAD2 received "B" flags from the prescreener for slightly negative values. These negative values were recorded during nightime

Table 7.2: Number of Flags and Percentage flagged for Each Variable


VariableBDGHJKSTTotal Number of flagsPercentage of Variable Flagged
TIME       660.01
LAT    1791 6 17971.56
LON    101 5 1060.09
LAT2    4894 2 48966.04
LON2    4895   48956.04
PL_CRS2    3446   34464.25
PL_HD    128   1280.11
PL_CRS    60 5 650.06
PL_SPD    60 7 670.06
PL_SPD2      4 40.00*
PL_SPD3     684258 9420.82
PL_WDIR        00.00
PL_WSPD        00.00
PL_WDIR2        00.00
PL_WSPD2        00.00
DIR    2135573258 5946851.53
SPD    20505668729 5876650.92
DIR2    784 10 7940.69
SPD2  310 611 19 9400.81
TS  124 611 1 7360.64
TS2  130 611 1 7420.64
P    5987 48 60355.23
T 270   156581 1592913.80
T2 265   11602  1186710.28
TD 266 2 2888  31562.73
TD2 78 6 2441  25252.19
RH   2 14888  1488212.90
RH2   41612102  1212210.50
RAD29218   9060   3828056.51
RAD24088   9031   1311919.37
Total Number of Flags
33306

879

564

14

46271

174267

404

6

255711

Percentage of All Values Flagged
1.03

0.03

0.02

0.00*

1.43

5.40

0.01

0.00*

7.92
 

* less than 0.01 percent flagged

hours, when short wave and ultrviolet radiation should be near zero, but never negative. The daytime values were realistic and the "B" flags on some nightime values should not present a problem for the user.

7.2 Missing SATNAV Data


The SATNAV variables LAT2 and LON2 along with PL_CRS2 and PL_SPD2 were missing on cruise AR_04E/04 and were not included in the quality controlled data for that cruise.

7.3 Port Earth Relative Winds

The port earth-relative winds on cruises AR_15_/08 and A__10_/00 were calculated incorrectly. Earth-relative winds should be calculated using the platform-relative winds, platform heading, platform speed over the ground, and platform course. Unrealistically erratic values of DIR at low ship speeds are evidence that the port earth-relative winds on these two cruises were computed without the use of platform heading. All values of DIR and SPD were flagged with a "K" during these cruises. The user is advised to use the starboard winds and avoid the port wind data. However, the differences between the incorrect port-earth relative wind data and the true earth relative winds should be small at ship speeds over 2.5 m/s. More details on the problems associated with earth-relative winds from automated systems can be found in Smith et al. (1998).

7.4 LAT and LON

LAT and LON received "J" flags for erroneous zero values. The zero values were more prevalent in LAT than in LON.

7.5 LAT2 and LON2

On three occasions the SATNAV data differed from the INS data as described in section 4.4 and were flagged with the "J" flag. Much of the PL_CRS2 data was also incorrect during these periods and were also flagged with a "J".

7.6 Dewpoint Greater than Air Temperature

The preprocessor performs a check to ensure that dewpoint is not greater than the air temperature. When the dewpoint exceeds the air temperature both variables are flagged with a "D" flag. An increased number of "D" flags were assigned beginning in 1992, primarily because of the problems with the moisture variables discussed in section 4.5. The "D" flag should discourage the use of the dewpoint values, but the air temperature values are still accurate. The analyst would have applied a "J" or "K" flag if a problem had been apparent in the air temperature data.

7.7 Pressure

Values of atmospheric pressure had a tendency to "flatline", or stay at exactly the same value for many records in a row, during cruise AR_04E/04. All values during these episodes were flagged with a "J".



8. 1994 Flag Summary

The 1994 Meteor data contains values from four cruises covering seven WOCE hydrographic lines. Details of each cruise including start and end dates, number of records, number of values, number of flags, percentage flagged, and variables not included in the quality controlled data are listed in Table 8.1. A total of 4,936,075 values were evaluated with 339,255 flags added by the preprocessor and Data Quality Evaluator for a total of 6.87 percent of the values being flagged. Table 8.2 details the distribution of flags among the different variables.

Table 8.1: Statistical Cruise Information

CTCDatesNumber of RecordsNumber of ValuesNumber of FlagsPercentage FlaggedVariables not Included
 AR_04E/06
AR_04W/06
AR_15_/11
2/19/94 - 3/12/9429,980899,40056,8856.32None
A__08_/00
AR_15_/14
3/26/94 - 6/01/9484,5652,536,950146,8055.79None
A__02_/0210/21/94 - 11/12/9431,334783,35051,9046.63LAT2, LON2, PL_CRS2, PL_SPD2, RAD2
AR_07E/0511/16/94 - 12/22/9428,655716,37583,66111.68LAT2, LON2, PL_CRS2, PL_SPD2, RAD2



Description of Problems:

8.1 Radiation Data

The RAD values on cruises A__02_/02 and AR_07E/05 appeared to be an order of magnitude too low. The time series plots had the correct shape and response to cloud cover, but only achieved

Table 8.2: Number of Flags and Percentage flagged for Each Variable


VariableBDGHJKSTTotal Number of flagsPercentage of Variable Flagged
TIME       880.00*
LAT    39   390.02
LAT2    28351 1 2835224.75
LON2    27667   2766724.15
PL_CRS2    18100   1810015.80
PL_HD        00.00
PL_CRS        00.00
PL_SPD1     7 80.00*
PL_SPD2      1 10.00*
PL_SPD3     3169843 40122.30
PL_WDIR    3900 185 40852.34
PL_WSPD1    117131 2490.14
PL_WDIR2    1132 84 12160.70
PL_WSPD210     156 1660.10
DIR    3897 89 39862.28
SPD1 228 3899 148 42762.45
DIR2    1131 8 11390.65
SPD25 241 1143 8 13970.80
TS  136     1360.08
TS2  121   2 1230.07
P      154 1540.09
T 4919   68583 117806.75
T2 960   91031 100645.77
TD 531 61972311794 2144312.29
TD2 277 125908405523 102755.89
RH   42022851164 2535214.53
RH2   812167869322 2089011.97
RAD107275   75154312 12278370.35
RAD221521     33 2155418.82
Total Number of Flags
128814

6687

726

30

147360

53721

1909

8

339255

Percentage of All Values Flagged
2.61

0.14

0.01

0.00*

2.99

1.09

0.04

0.00*

6.87
 

* less than 0.01 percent flagged

maximum values of near 100 W/m2. Climatology showed the correct maximum should be near 1,000 W/m2. Because of this problem RAD was flagged with a "K" if no other problems occurred. The user may wish to rescale these values by a factor of 10. On all cruises RAD received "B" flags from the prescreener for negative values. These negative values were recorded during nightime hours, when short wave radiation should be near zero, but never negative. The "B" flags should not present a problem for the user, since they do not occur during daytime hours. Also, the variable RAD2 did not contain any useful values for the AR_07E/05 and A__02_/02 cruises and was not included in the quality controlled data.

8.2 Missing SATNAV Data

The SATNAV variables LAT2 and LON2 along with PL_CRS2 and PL_SPD2 were missing on cruise AR_07E/05 and were not included in the quality controlled data for that cruise.

8.3 Erroneous SATNAV Data

The SATNAV LAT2 and LON2 were in error from 3/06/94 through 3/12/94 and again from 3/29/94 through 4/10/94. All values of LAT2 and LON2 were flagged with a "J" during these periods, consistent with the discussion of SATNAV problems presented in section 4.4. The problem with the SATNAV data was also evident in PL_CRS2 from 3/29/94 through 4/10/94, as it differed from PL_HD by a constant 60 degrees. For this reason PL_CRS2 was also flagged with a "J" during this period.

8.4 Moisture Problems

The moisture discontinuities discussed in section 4.5 were a prominent problem in 1994. Discontinuities occurred seven different times on either the port or starboard moisture variables, and the corresponding dewpoint and relative humidity was often unrealistically high in the vicinity of the jump. If the relative humidities were consistently over 100 percent, both dewpoint and relative humidity were flagged with a "J". Where the moisture variables were deemed suspect by comparison to the values from the other side of the ship, but the relative humidity was not consistently over 100 percent, the dewpoint and relative humidity were flagged with a "K". After a jump which occurred on 11/18/94 the port variables TD and RH reported excessively high values, with RH often over 100 percent. These variables were flagged with a "J" for the remainder of the cruise.

8.5 Dewpoint Greater than Air Temperature

The preprocessor performs a check to ensure that dewpoint is not greater than the air temperature. When the dewpoint exceeds the air temperature, both variables are flagged with a "D" flag. An increased number of "D" flags were assigned in 1994, primarily because of the problems with the moisture variables. Many of the "D" flags in the dewpoints were changed to a "K" or "J" as described above. However, the "D" flags remain in the temperature variables if no other problem is apparent. The "D" flag should discourage the use of the dewpoint values, but not temperature values.

8.6 Wind Variables

Two different problems were present in the wind data in 1994. The first was present in PL_WDIR from 10/28/94 through 10/31/94. A majority of PL_WDIR values were recorded as exactly 1 degree, and the other values were suspect. The analyst determined that it would be too difficult to extract any reliable data, so all values of PL_WDIR were flagged with a "J" during this period. DIR and SPD are calculated using PL_WDIR and were likewise flagged with a "J". The second problem involved the occurrence of periodic spikes in one or more of the wind variables. These spikes repeated every 10 to 15 minutes and were present for an entire day at a time. The periodic nature of these spikes suggest that electrical interference may be the cause. The analyst was able to flag the spikes individually with the "S" flag.



9. 1995 Flag Summary

The 1995 Meteor data contains data from three cruises covering five WOCE hydrographic lines. Details of each cruise including start and end dates, number of records, number of values, number of flags, percentage flagged, and variables not included in the quality controlled data are listed in Table 9.1. A total of 2,890,366 values were evaluated with 261,427 flags added by the preprocessor and Data Quality Evaluator for a total of 9.04 percent of the values being flagged. Table 9.2 details the distribution of flags among the different variables.

Table 9.1: Statistical Cruise Information

CTCDatesNumber of RecordsNumber of ValuesNumber of FlagsPercentage FlaggedVariables not Included
 IR_01W/02
IR_03N/01 ISS02_/04
4/14/95 - 4/26/9517,360503,44020,4124.05RAD2
ISS02_/076/13/95 - 7/11/9538,7541,123,86092,7388.25RAD2
ISS02_/098/17/95 - 9/19/9543,5541,263,066148,27711.74RAD2


Description of Problems:

9.1 Radiation Data

The RAD values on cruises and IR_01W/02 appeared to be an order of magnitude too low. The time series plots had the correct shape and response to cloud cover, but only achieved maximum values of near 100 W/m2. Climatology showed the correct maximum should be near 1,000 W/m2. Because of this problem RAD was flagged with a "K" if no other problems occurred. The user may wish to rescale these values by a factor of 10. On all cruises RAD received "B" flags from the prescreener for slightly negative values. These negative values were recorded during nightime hours, when short wave radiation should be near zero, but never negative. The "B" flags should

Table 9.2: Number of Flags and Percentage flagged for Each Variable

VariableBDGJKSTTotal Number of flagsPercentage of Variable Flagged
TIME      220.00*
LAT   126   1260.13
LON   941   9410.94
LAT2   53276   5327653.44
LON2   53267   5326753.44
PL_CRS2   12311   1231112.35
PL_HD       00.00
PL_CRS   99   990.10
PL_SPD   133 17 1500.15
PL_SPD2   123111642 1236912.41
PL_SPD3    7622497 81198.15
PL_WDIR       00.00
PL_WSPD       00.00
PL_WDIR2       00.00
PL_WSPD2   717   7170.72
DIR   902318 1310.13
SPD   45 6 510.05
DIR2   80610814 9280.93
SPD2   768 5 7730.78
TS  469 224 4950.50
TS2  406 1084 5180.52
P     159 1590.16
T 258414 920115 98889.92
T2 19476 12404  1289912.94
TD    3913  39133.93
TD2 8  8582  85908.62
RH   2497972  82218.25
RH2    14808  1480814.86
RAD49923   8753  5867658.87
Total Number of Flags
49923

285

1765

135139

73532

781

2

261427

Percentage of All Values Flagged
1.73

0.01

0.06

4.68

2.54

0.03

0.00*

9.04
 

* less than 0.01 percent flagged

not present a problem for the user, since they did not occur during daytime hours. Also, the variable RAD2 did not contain any useful values for any of the 1995 cruises and was not included with the quality controlled data.

9.2 LAT and LON


LAT and LON had short periods when their values were incorrectly recorded as exactly zero. These values were flagged with the "J" flag. On 6/22/95 LAT and LON departed from the true position by up to 20 degrees for over one hour. LAT, LON, along with PL_CRS and PL_SPD were all assigned the "J" flag during this period.

9.3 Problems Affecting Earth Relative Winds


On 6/13/95 PL_SPD registered unrealistic values over 20 m/s for nearly an hour. Both sets of earth relative wind speed and earth relative wind direction were also erroneous, as they were calculated using PL_SPD. All of these variable were flagged with a "J" during this period. On 7/09/95 PL_WSPD2 had values of exactly zero while PL_WSPD showed wind speeds of 8 -10 m/s. PL_WSPD2, DIR2, and SPD2 were all flagged with a "J".

9.4 PL_SPD3

The spike problem affecting PL_SPD3 mentioned in section 4.7 was especially prevalent in 1995, resulting in 7,622 "K" flags and 497 "S" flags.

9.5 Special Note

The problem with the satellite navigation data is especially prevalent in the 1995 cruises. These data were in error from 6/22/95 through 7/09/95 and from 8/31/95 through 9/19/95, resulting in over 40 percent of the variables LAT2 and LON2 being flagged. The analyst recommends using the INS navigation data for the most accurate position information.



10. Final Comments:


Much of the Meteor DVS data is of excellent quality and should be very reliable for the user, with only a few exceptions. Quality control has proven the SATNAV navigation data unreliable with over 20 percent of the data flagged. Use of the more accurate INS navigation data is highly recommended. T, T2, TD, TD2, RH, and RH2 were all adversely affected by the exhaust problem and approximately ten percent of these values were flagged. Short wave and ultraviolet radiation measurements were reliable when available and scaled correctly. Wind data were of very high quality except for port values on cruises AR_15_/08 and A__10_/00. Very accurate wind measurements can be obtained by using data from the most exposed side of the ship. Atmospheric pressure and sea temperature data are also of outstanding quality and should present no problems for the user.



References:

da Silva, A. M., C. C. Young and S. Levitus, 1994: Atlas of Surface Marine Data 1994, Volume 1: Algorithms and Procedures. NOAA Atlas Series. NESDIS 6, U. S. Department of Commerce, NOAA, NESDIS, Washington, DC.

Smith, S. R., C. Harvey, and D. M. Legler, 1996: Handbook of Quality Control Procedures and Methods for Surface Meteorology Data. WOCE Report No. 141/96, Report WOCEMET 96-1, Center for Ocean Atmospheric Prediction Studies, Florida State University, Tallahassee, FL 32301

Smith, S. R., M. A. Bourassa, and R. J. Sharp, 1997: Establishing More Truth in True Winds. J. Atmos. Ocean. Technol., Submitted.

WMO World Meteorological Organization, 1983: Guide to Meteorological Instruments and Methods of Observation. Secretariat of the World Meteorological Organization, Geneva, Switzerland