SNAP documentation
KOPRI
Om has decided to take this over, which is why these notes are incomplete.
The KOPRI files can be found below /group_workspaces/jasmin/snap/kopri/phase1/. In here there are currently 15 directories, all named used dates in the form YYYYMMDD. These include the 5 Northern starting dates (23 & 28 Dec, 2, 7 & 12 Jan). And for each of these dates, one directory a day before and one directory a day after.
And in each directory there's two types of files
- surface variable in the fgb*.nc files (lat=94, lon=192)
- variables on pressure level in the pgb* files (lat=73, lon=144)
Putting the data into one file
For each experiment the data is put into one file with the script /home/users/stringer/snap/bin/conformKopri.scr, whose only argument is the directory with the data, e.g.
./conformKopri.scr /group_workspaces/jasmin/snap/kopri/phase1/20130103to create kopri20130103.nc. This script uses the NCO tools to do the following
- Loop across each hour
- Copy the fgb* files into work directory, /home/users/stringer/snap/data
- Some files have the extension _ave6h to the variable names, some don't. So all the _ave6h extensions are removed
- Copies the pgb* files into work directory
- The first pgb* file is missing the VAR_154_2_ISBL variable. I've written the /home/users/stringer/snap/code/insertFillValue.cpp code to help create /home/users/stringer/snap/fillData/VAR_154_2_ISBL.nc, which is one entry of VAR_154_2_ISBL containing only the _FillValue. This is added to the first pgb* file, so that every pgb* file has the VAR_154_2_ISBL variable
- Later almost all the variables will have the time dimension added to them. However, we don't want the time dimension adding to lv_DBLY2_l0 and lv_DBLY2_l1 - so these are pulled into their own files (the fbg*noTime_tmp.nc files).
- The no time variables lv_DBLY2_l0 and lv_DBLY2_l1 are removed from the fgb* files.
- fgbYYYYMMDD_tmp.nc and pgbYYYYMMDD_tmp.nc are put together into pgbYYYYMMDD_tmp.nc.
- The time is determined from the forcecast_time attribute, and added to pgbYYYYMMDD_tmp.nc as both a value and dimension for all the variables in here (although it's not done for variables with names matching the dimension names).
- Add in lv_DBLY2_l0 and lv_DBLY2_l1 to pgbYYYYMMDD_tmp.nc.
- Put all the pgbYYYYMMDD_tmp.nc files into one file, kopr_YYYYMMDD_01.nc, where the date now comes from the directory name, which is the start date. At this stage all other files are deleted.
- Remove the forecast_time and forecast_time_units attributes from this file as they only refer to the first time - and we know have lots of times.
- Add the time attributes
- Rename the variables according to the table below.
Renaming variables
Where possible the variable names should be consistent with the names used in ERA-Interim data.
Old variable name | Old long_name | New variable name | New long_name |
---|---|---|---|
PRES_2_SFC | Pressure | SP | Surface pressure |
PRES_2_MSL | Pressure | MSL | Mean sea-level pressure |
HGT_2_SFC | Geopotential height | ERAI has geopotential but not geopotential height? | |
HGT_2_ISBL | Geopotential height | ERAI has geopotential but not geopotential height? | |
TMP_2_ISBL | Temp. | ||
U_GRD_2_ISBL | u wind | ||
V_GRD_2_ISBL | v wind | ||
V_VEL_2_ISBL | Pressure vertical velocity | ?? | |
ABS_V_2_ISBL | Absolute vorticity | ||
SPFH_2_ISBL | Specific humidity | ||
RH_2_ISBL | Relative humidity | ||
P_WAT_2_EATM | Precipitable water | ||
MIXHT_2_EATM | Mixed layer depth | ||
TTHDP_2_EATM | Transient thermocline depth | ||
MTHD_2_EATM | Main thermocline depth | ||
C_WAT_2_EATM | Cloud water | ||
VAR_77_2_EATM | Unknown Variable Name | ||
lv_ISBL2 | isobaric level | ||
lat_2 | latitude | latitude | latitude |
lon_2 | longitude | longitude | longitude |
VAR_154_2_ISBL | Unknown Variable Name | ||
ALBDO_98_SFC | Albedo | ||
BRTMP_98_SFC | Brightness temperature | ||
ICE_C_98_SFC | Ice concentration (ice=1;no ice=0) | ||
LAND_98_SFC | Land-sea mask (land=1;sea=0) | ||
LHTFL_98_SFC | Latent heat flux | ||
PRATE_98_SFC | Precipitation rate | ||
PRES_98_HCBL | Pressure | ?? | |
PRES_98_HCTL | Pressure | ?? | |
PRES_98_LCBL | Pressure | ?? | |
PRES_98_LCTL | Pressure | ?? | |
PRES_98_MCBL | Pressure | ?? | |
PRES_98_MCTL | Pressure | ?? | |
PRES_98_SFC | Pressure | ?? | |
P_WAT_98_EATM | Precipitable water | ||
SFC_R_98_SFC | Surface roughness | ||
SHTFL_98_SFC | Sensible heat flux | ||
SPF_H_98_HTGL | Specific humidity | ||
SRWEQ_98_SFC | Snowfall rate water equivalent. | ||
TMP_98_DBLY | Temperature | ||
TMP_98_HCTL | Temperature | ||
TMP_98_HTGL | Temperature | ||
TMP_98_LCTL | Temperature | ||
TMP_98_MCTL | Temperature | ||
TMP_98_SFC | Temperature | ||
T_CDC_98_EATM | Total cloud cover | ||
T_CDC_98_HCY | Total cloud cover | ||
T_CDC_98_LCY | Total cloud cover | ||
T_CDC_98_MCY | Total cloud cover | ||
T_MAX_98_HTGL | Maximum temperature | ||
T_MIN_98_HTGL | Minimum temperature | ||
U_FLX_98_SFC | Momentum flux, u component | ||
U_GRD_98_HTGL | u-component of wind | ||
VAR_144_98_DBLY | Unknown Variable Name | ||
VAR_145_98_SFC | Unknown Variable Name | ||
VAR_146_98_SFC | Unknown Variable Name | ||
VAR_147_98_SFC | Unknown Variable Name | ||
VAR_148_98_SFC | Unknown Variable Name | ||
VAR_155_98_SFC | Unknown Variable Name | ||
VAR_170_98_SFC | Unknown Variable Name | ||
VAR_171_98_SFC | Unknown Variable Name | ||
VAR_180_98_SFC | Unknown Variable Name | ||
VAR_190_98_SFC | Unknown Variable Name | ||
VAR_202_98_EATM | Unknown Variable Name | ||
VAR_203_98_EATM | Unknown Variable Name | ||
VAR_204_98_NTAT | Unknown Variable Name | ||
VAR_204_98_SFC | Unknown Variable Name | ||
VAR_205_98_SFC | Unknown Variable Name | ||
VAR_211_98_NTAT | Unknown Variable Name | ||
VAR_211_98_SFC | Unknown Variable Name | ||
VAR_212_98_NTAT | Unknown Variable Name | ||
VAR_212_98_SFC | Unknown Variable Name | ||
VAR_214_98_SFC | Unknown Variable Name | ||
VAR_221_98_SFC | Unknown Variable Name | ||
VAR_223_98_SFC | Unknown Variable Name | ||
VAR_225_98_SFC | Unknown Variable Name | ||
VAR_226_98_SFC | Unknown Variable Name | ||
VAR_229_98_SFC | Unknown Variable Name | ||
VAR_230_98_SFC | Unknown Variable Name | ||
VAR_234_98_SFC | Unknown Variable Name | ||
VAR_236_98_SFC | Unknown Variable Name | ||
VEG_98_SFC | Vegetation | ||
V_FLX_98_SFC | Momentum flux, v component | ||
V_GRD_98_HTGL | v-component of wind | ||
WATR_98_SFC | Water runoff | ||
WEASD_98_SFC | Water equivalent of accum. snow depth | ||
lv_DBLY2_l0 | layer between two depths below land surface | ||
lv_DBLY2_l1 | layer between two depths below land surface |