NOAA Global Historical Climatology Network Daily (GHCN-D)

GHCN-Daily is a dataset that contains daily observations over global land areas. It contains station-based measurements from land-based stations worldwide, about two thirds of which are for precipitation measurements only (Menne et al., 2012). GHCN-Daily is a composite of climate records from numerous sources that were merged together and subjected to a common suite of quality assurance reviews (Durre et al., 2010). The archive includes the following meteorological elements:

In this archive, the period of record station files are parsed into yearly files that contain all available GHCN-Daily station data for that year plus a time of observation field (where available—primarily for U.S. Cooperative Observers). The observation times for U.S. Cooperative Observer data come from the station history archived in NCDC’s Historical Observing Metadata Repository (HOMR). The files are updated daily on AWS to be in sync with updates to the GHCN-Daily dataset at NOAA.

This document refers to two other files, ghcnd-stations.txt and ghcnd-inventory.txt, which are also stored in the noaa-ghcn-pds S3 bucket. You can get these files here:

Accessing GHCN-D Data on AWS

The GHCH-D data are stored in the noaa-ghcn-pds bucket:

http://noaa-ghcn-pds.s3.amazonaws.com/

The directory is structured by year from 1763 to present, with each file named after the respective year. The data are available in CSV file format and as .csv.gzip files, so any particular year will be named yyyy.csv and yyyy.csv.gz. For example to access the gziped version of the data for 1788 append 1788.csv.gz to the bucket URL:

http://noaa-ghcn-pds.s3.amazonaws.com/csv.gz/1788.csv.gz

The uncompressed versions of the files can be accessed by using a slightly different URL and a filename ending with CSV. For example to access the uncompressed data for 1788 append 1788.csv to the bucket URL:

http://noaa-ghcn-pds.s3.amazonaws.com/csv/1788.csv

If you use the AWS Command Line Interface, you can access the bucket with this command:

aws s3 ls noaa-ghcn-pds

The data set is updated daily.

Summary of the Day Format

The yearly files are formatted so that every observation is represented by a single row with the following fields:

The fields are comma delimited and each row represents one station-day.

ELEMENT Summary

The five core elements are:

Please see the Full Explanation of Elements section below for a full description.

M-FLAG

MFLAG is the measurement flag. There are ten possible values:

Q-FLAG

Q-FLAG is the measurement quality flag. There are fourteen possible values:

S-FLAG

S-FLAG is the source flag for the observation. There are twenty nine possible values (including blank, upper and lower case letters):

When data are available for the same time from more than one source, the highest priority source is chosen according to the following priority order (from highest to lowest): - Z,R,0,6,C,X,W,K,7,F,B,M,r,E,z,u,b,s,a,G,Q,I,A,N,T,U,H,S

Full Explanation of the Elements Variable

As mentioned above the five core elements are:

The other elements are:

FORMAT OF “ghcnd-stations.txt” file

There are over 106200 stations listed in a seperate file. Found here:

http://noaa-ghcn-pds.s3.amazonaws.com/ghcnd-stations.txt

The table below describes the structure of each row of ghcnd-stations.txt

Variable Columns Type Example
ID 1-11 Character EI000003980
LATITUDE 13-20 Real 55.3717
LONGITUDE 22-30 Real -7.3400
ELEVATION 32-37 Real 21.0
STATE 39-40 Character
NAME 42-71 Character MALIN HEAD
GSN FLAG 73-75 Character GSN
HCN/CRN FLAG 77-79 Character
WMO ID 81-85 Character 03980

These variables have the following definitions:

Lookup Table of Country Codes

The table of the country is derived from the ghcnd-countries.txt file available at the link below:

http://noaa-ghcn-pds.s3.amazonaws.com/ghcnd-countries.txt

The state codes are used in the station identification number. In the table below CODE is the FIPS country code of the country where the station is located.

Code Country
AC Antigua and Barbuda
AE United Arab Emirates
AF Afghanistan
AG Algeria
AJ Azerbaijan
AL Albania
AM Armenia
AO Angola
AQ American Samoa [United States]
AR Argentina
AS Australia
AU Austria
AY Antarctica
BA Bahrain
BB Barbados
BC Botswana
BD Bermuda [United Kingdom]
BE Belgium
BF Bahamas, The
BG Bangladesh
BH Belize
BK Bosnia and Herzegovina
BL Bolivia
BM Burma
BN Benin
BO Belarus
BP Solomon Islands
BR Brazil
BU Bulgaria
BX Brunei
BY Burundi
CA Canada
CB Cambodia
CD Chad
CE Sri Lanka
CF Congo (Brazzaville)
CG Congo (Kinshasa)
CH China
CI Chile
CJ Cayman Islands [United Kingdom]
CK Cocos (Keeling) Islands [Australia]
CM Cameroon
CO Colombia
CQ Northern Mariana Islands [United States]
CS Costa Rica
CT Central African Republic
CU Cuba
CV Cape Verde
CW Cook Islands [New Zealand]
CY Cyprus
DA Denmark
DO Dominica
DR Dominican Republic
EC Ecuador
EG Egypt
EI Ireland
EK Equatorial Guinea
EN Estonia
ER Eritrea
ES El Salvador
ET Ethiopia
EU Europa Island [France]
EZ Czech Republic
FG French Guiana [France]
FI Finland
FJ Fiji
FK Falkland Islands (Islas Malvinas) [United Kingdom]
FM Federated States of Micronesia
FP French Polynesia
FR France
FS French Southern and Antarctic Lands [France]
GA Gambia, The
GB Gabon
GG Georgia
GH Ghana
GI Gibraltar [United Kingdom]
GL Greenland [Denmark]
GM Germany
GP Guadeloupe [France]
GQ Guam [United States]
GR Greece
GT Guatemala
GV Guinea
GY Guyana
HO Honduras
HR Croatia
HU Hungary
IC Iceland
ID Indonesia
IN India
IO British Indian Ocean Territory [United Kingdom]
IR Iran
IS Israel
IT Italy
IV Cote D’Ivoire
IZ Iraq
JA Japan
JM Jamaica
JN Jan Mayen [Norway]
JO Jordan
JQ Johnston Atoll [United States]
JU Juan De Nova Island [France]
KE Kenya
KG Kyrgzstan
KN Korea, South
KR Kiribati
S Korea,South
K Christmas Island [Australia]
KU Kuwait
KZ Kazakhstan
LA Laos
LE Lebanon
LG Latvia
LH Lithuania
LI Liberia
LO Slovakia
LQ Palmyra Atoll [United States]
LT Lesotho
LU Luxembourg
LY Libya
MA Madagascar
MB Martinique [France]
MC Macau S.A.R
MD Moldova
MF Mayotte [France]
MG Mongolia
MI Malawi
MJ Montenegro
MK Macedonia
ML Mali
MO Morocco
MP Mauritius
MQ Midway Islands [United States]
MR Mauritania
MT Malta
MU Oman
MV Maldives
MX Mexico
MY Malaysia
MZ Mozambique
NC New Caledonia [France]
NE Niue [New Zealand]
NF Norfolk Island [Australia]
NG Niger
NH Vanuatu
NI Nigeria
NL Netherlands
NO Norway
NP Nepal
NS Suriname
NT Netherlands Antilles [Netherlands]
NU Nicaragua
NZ New Zealand
PA Paraguay
PC Pitcairn Islands [United Kingdom]
PE Peru
PK Pakistan
PL Poland
PM Panama
PO Portugal
PP Papua New Guinea
PS Palau
PU Guinea-Bissau
QA Qatar
RE Reunion [France]
RI Serbia
RM Marshall Islands
RO Romania
RP Philippines
RQ Puerto Rico [United States]
RS Russia
RW Rwanda
SA Saudi Arabia
SB Saint Pierre and Miquelon [France]
SE Seychelles
SF South Africa
SG Senegal
SH Saint Helena [United Kingdom]
SI Slovenia
SL Sierra Leone
SN Singapore
SP Spain
ST Saint Lucia
SU Sudan
SV Svalbard [Norway]
SW Sweden
SX South Georgia and the South Sandwich Islands [United Kingdom]
SY Syria
SZ Switzerland
TD Trinidad and Tobago
TE Tromelin Island [France]
TH Thailand
TI Tajikistan
TL Tokelau [New Zealand]
TN Tonga
TO Togo
TS Tunisia
TU Turkey
TV Tuvalu
TX Turkmenistan
TZ Tanzania
UG Uganda
UK United Kingdom
UP Ukraine
US United States
UV Burkina Faso
UY Uruguay
UZ Uzbekistan
VE Venezuela
VM Vietnam
VQ Virgin Islands [United States]
WA Namibia
WF Wallis and Futuna [France]
WI Western Sahara
WQ Wake Island [United States]
WZ Swaziland
ZA Zambia
ZI Zimbabwe

Look Up Table of State Codes

The table of the state codes below is a derived from the ghcnd-states.txt file which is available at the link below

http://noaa-ghcn-pds.s3.amazonaws.com/ghcnd-states.txt

The state codes are used in the station identification number, the table below CODE = is the POSTAL code of the U.S. state/territory or Canadian province where the station is located.

Code State
AB ALBERTA
AB ALBERTA
AK ALASKA
AL ALABAMA
AR ARKANSAS
AS AMERICAN SAMOA
AZ ARIZONA
BC BRITISH COLUMBIA
CA CALIFORNIA
CO COLORADO
CT CONNECTICUT
DC DISTRICT OF COLUMBIA
DE DELAWARE
FL FLORIDA
FM MICRONESIA
GA GEORGIA
GU GUAM
HI HAWAII
IA IOWA
ID IDAHO
IL ILLINOIS
IN INDIANA
KS KANSAS
KY KENTUCKY
LA LOUISIANA
MA MASSACHUSETTS
MB MANITOBA
MD MARYLAND
ME MAINE
MH MARSHALL ISLANDS
MI MICHIGAN
MN MINNESOTA
MO MISSOURI
MP NORTHERN MARIANA ISLANDS
MS MISSISSIPPI
MT MONTANA
NB NEW BRUNSWICK
NC NORTH CAROLINA
ND NORTH DAKOTA
NE NEBRASKA
NH NEW HAMPSHIRE
NJ NEW JERSEY
NL NEWFOUNDLAND AND LABRADOR
NM NEW MEXICO
NS NOVA SCOTIA
NT NORTHWEST TERRITORIES
NU NUNAVUT
NV NEVADA
NY NEW YORK
OH OHIO
OK OKLAHOMA
ON ONTARIO
OR OREGON
PA PENNSYLVANIA
PE PRINCE EDWARD ISLAND
PI PACIFIC ISLANDS
PR PUERTO RICO
PW PALAU
QC QUEBEC
RI RHODE ISLAND
SC SOUTH CAROLINA
SD SOUTH DAKOTA
SK SASKATCHEWAN
TN TENNESSEE
TX TEXAS
UM U.S. MINOR OUTLYING ISLANDS
UT UTAH
VA VIRGINIA
VI VIRGIN ISLANDS
VT VERMONT
WA WASHINGTON
WI WISCONSIN
WV WEST VIRGINIA
WY WYOMING
YT YUKON TERRITORY

FORMAT OF “ghcnd-inventory.txt”

This is a file listing the periods of record for each station and element. The file is located here:

http://noaa-ghcn-pds.s3.amazonaws.com/ghcnd-inventory.txt

The file structure is described in the table below.

Variable Columns Type
ID 1-11 CHARACTER
LATITUDE 13-20 REAL
LONGITUDE 22-30 REAL
ELEMENT 32-35 CHARACTER
FIRSTYEAR 37-40 INTEGER
LASTYEAR 42-45 INTEGER

Contact

For questions regarding data content or quality, go here. For any questions regarding data delivery not associated with this platform or any general questions regarding the NOAA Big Data Project, email noaa.bdp@noaa.gov.

HOW TO CITE:

Note that the GHCN-Daily dataset itself has a DOI (Digital Object Identifier) so it may be relevant to cite both the methods/overview journal article as well as the specific version of the dataset used.

The journal article describing GHCN-Daily is:

Menne, M.J., I. Durre, R.S. Vose, B.E. Gleason, and T.G. Houston, 2012: An overview of the Global Historical Climatology Network-Daily Database. Journal of Atmospheric and Oceanic Technology, 29, 897-910, doi:10.1175/JTECH-D-11-00103.1

To acknowledge the specific version of the dataset used, please cite:

Menne, M.J., I. Durre, B. Korzeniewski, S. McNeal, K. Thomas, X. Yin, S. Anthony, R. Ray, R.S. Vose, B.E.Gleason, and T.G. Houston, 2012: Global Historical Climatology Network - Daily (GHCN-Daily), Version 3. [indicate subset used following decimal, e.g. Version 3.25]. NOAA National Centers for Environmental Information. http://doi.org/10.7289/V5D21VHZ [access date]

REFERENCES

Durre, I., M. J. Menne, B. E. Gleason, T. G. Houston, and R. S. Vose (2010), Comprehensive automated quality assurance of daily surface observations, J. Appl. Meteorol. Climatol., 49, 1615–1633, doi:10.1175/2010JAMC2375.1

Klein Tank, A.M.G. and Coauthors, 2002. Daily dataset of 20th-century surface air temperature and precipitation series for the European Climate Assessment. Int. J. of Climatol., 22, 1441-1453. Data and metadata available at http://eca.knmi.nl

Menne, M.J., I. Durre, R.S. Vose, B.E. Gleason, and T.G. Houston, 2012: An overview of the Global Historical Climatology Network-Daily Database. Journal of Atmospheric and Oceanic Technology, 29, 897-910, doi.10.1175/JTECH-D-11-00103.1