# EURECOM AML 2022:: Challenge 1 — Data

来源：https://www.kaggle.com/competitions/eurecom-aml-2022-challenge-1/data

本地 Meta Kaggle 快照；不是本次实时页面。

# Dataset Description

The data consists of pairs of meteorological features and target values at a particular
latitude/longitude and time. The target value is air temperature measurements at 2 metres above the
ground. The feature vectors include both weather-related features such as sun evaluation at
the current location, climate values of temperature, pressure and topography, and meteorological
parameters on different pressure and surface levels from weather forecast model predictions. Weather
forecast model predictions are values produced by the following weather forecast models: Global
Forecast System (GFS), Global Deterministic Forecast System from the Canadian Meteorological
Center (CMC), and the Weather Research and Forecasting (WRF) Model. Each model returns
the following predicted values: wind, humidity, pressure, clouds, precipitation, dew point, snow
depth, air and soil temperature characteristics. Where applicable, the predictions are given at different
isobaric levels from 50 hPa (≈ 20 km above ground) to the ground level. 
Altogether, there are 111 features in total. It is important to note that the features are
highly heterogeneous, i.e., they are of different types and scales. 

## Files

*   **train.csv** - the training set
*   **test_feat.csv** - the features for the test set
*   **example_preds.csv** - a sample submission file in the correct format

## Columns

* `fact_time`: time, unix timestamp
* `fact_latitude`: geographical latitude, degrees
* `fact_longitude`: geographical longitude, degrees
* `topography_bathymetry
* `sun_elevation
* `climate_temperature`: climate temperature, C
* `climate_pressure`: climate pressure, mmHg
* `cmc_0_0_6_2`: dew point temp at 2m, K
* `cmc_0_0_7_1000`: dew point depression at 1000 hPa isobaric level, K
* `cmc_0_0_7_2`:  dew point depression at 2m, K
* `cmc_0_0_7_500`: dew point depression at 500 hPa isobaric level, K
* `cmc_0_0_7_700`: dew point depression at 700 hPa isobaric level, K
* `cmc_0_0_7_850`: dew point depression at 850 hPa isobaric level, K
* `cmc_0_0_7_925`: dew point depression at 925 hPa isobaric level, K
* `cmc_0_1_0_0`:  absolute humidity from 0 to 1
* `cmc_0_1_11_0`: snow depth, m
* `cmc_0_1_65_0`: rain accumulated, mm
* `cmc_0_1_66_0`: snow accumulated, mm 
* `cmc_0_1_67_0`: iced rain accumulated, mm
* `cmc_0_1_68_0`: iced graupel accumulated, mm
* `cmc_0_1_7_0`:  instant precipitation intensity, mm/h
* `cmc_0_2_2_10`: wind U component at 10m, m/s
* `cmc_0_2_2_500`: wind U component at 500 hPa isobaric level, m/s
* `cmc_0_2_2_700`: wind U component at 700 hPa isobaric level, m/s
* `cmc_0_2_2_850`: wind U component at 850 hPa isobaric level, m/s
* `cmc_0_2_2_925`: wind U component at 925 hPa isobaric level, m/s
* `cmc_0_2_2_1000`: wind U component at 1000 hPa isobaric level, m/s
* `cmc_0_2_3_10`: wind V component at 10m, m/s
* `cmc_0_2_3_500`: wind V component at 500 hPa isobaric level, m/s
* `cmc_0_2_3_700`: wind V component at 700 hPa isobaric level, m/s
* `cmc_0_2_3_850`: wind V component at 850 hPa isobaric level, m/s
* `cmc_0_2_3_925`: wind V component at 925 hPa isobaric level, m/s
* `cmc_0_2_3_1000`: wind V component at 1000 hPa isobaric level, m/s
* `cmc_0_3_0_0`:  surface pressure, Pa
* `cmc_0_3_0_0_next`:  next horizon surface pressure, Pa
* `cmc_0_3_1_0`: sea level pressure, Pa
* `cmc_0_3_5_500`: geopotential height at 500 hPa isobaric level, gpm
* `cmc_0_3_5_700`: geopotential height at 700 hPa isobaric level, gpm
* `cmc_0_3_5_850`: geopotential height at 850 hPa isobaric level, gpm
* `cmc_0_3_5_925`: geopotential height at 925 hPa isobaric level, gpm
* `cmc_0_3_5_1000`: geopotential height at 1000 hPa isobaric level, gpm
* `cmc_0_6_1_0`: cloudiness, % from 0 to 100
* `cmc_available`: is there any data from cmc
* `cmc_horizon_h`:  cmc horizon, h
* `cmc_precipitations`: avg precipitations rate between adjacent horizons, mm/h
* `cmc_timedelta_s`: difference between cmc and forecast time, s
* `gfs_2m_dewpoint`: dew point temperature at 2m, C
* `gfs_a_vorticity`: absolute vorticity at height 1000 hPa, 1/s
* `gfs_available`: is there any data from gfs
* `gfs_cloudness`: sum of 3 level cloudiness, from 0 to 3
* `gfs_clouds_sea`:  cloud mixing ratio at level 1000 hPa, 
* `gfs_horizon_h`:  gfs horizon, h
* `gfs_humidity`: relative humidity at 2m, %
* `gfs_precipitable_water`:  total precipitable water, kg/m^2
* `gfs_precipitations`: avg precipitations rate between adjacent horizons, mm/h
* `gfs_pressure`: surface pressure, mmHg
* `gfs_r_velocity`:  vertical velocity at 1000 hPa, Pa/s
* `gfs_soil_temperature`:  soil temperature at 0.0-0.1 m, C
* `gfs_soil_temperature_available`: is there gfs soil temp data
* `gfs_temperature_5000`: temperature at vertical level at 50 hPa, C
* `gfs_temperature_7000`: temperature at vertical level at 70 hPa, C
* `gfs_temperature_1000`: temperature at vertical level at 100 hPa, C
* `gfs_temperature_1500`: temperature at vertical level at 150 hPa, C
* `gfs_temperature_2000`: temperature at vertical level at 200 hPa, C
* `gfs_temperature_2500`: temperature at vertical level at 250 hPa, C
* `gfs_temperature_3000`: temperature at vertical level at 300 hPa, C
* `gfs_temperature_3500`: temperature at vertical level at 350 hPa, C
* `gfs_temperature_4000`: temperature at vertical level at 400 hPa, C
* `gfs_temperature_4500`: temperature at vertical level at 450 hPa, C
* `gfs_temperature_5000`: temperature at vertical level at 500 hPa, C
* `gfs_temperature_5500`: temperature at vertical level at 550 hPa, C
* `gfs_temperature_6000`: temperature at vertical level at 600 hPa, C
* `gfs_temperature_6500`: temperature at vertical level at 650 hPa, C
* `gfs_temperature_7000`: temperature at vertical level at 700 hPa, C
* `gfs_temperature_7500`: temperature at vertical level at 750 hPa, C
* `gfs_temperature_8000`: temperature at vertical level at 800 hPa, C
* `gfs_temperature_8500`: temperature at vertical level at 850 hPa, C
* `gfs_temperature_9000`: temperature at vertical level at 900 hPa, C
* `gfs_temperature_9250`: temperature at vertical level at 925 hPa, C
* `gfs_temperature_9500`: temperature at vertical level at 950 hPa, C
* `gfs_temperature_9750`: temperature at vertical level at 975 hPa, C
* `gfs_timedelta_s`: difference between gfs and forecast time, s
* `gfs_total_clouds_cover_high`: cloud coverage (between horizons, divisible by 6) at high level, %
* `gfs_total_clouds_cover_low`:  cloud coverage (between horizons, divisible by 6) at low level, %
* `gfs_total_clouds_cover_middle`:  cloud coverage (between horizons, divisible by 6) at middle level, %
* `gfs_u_wind`:  10 meter U wind component, m/s
* `gfs_v_wind`:  10 meter V wind component, m/s
* `gfs_wind_speed`: wind velocity, sqrt(gfs_u_wind^2 + gfs_v_wind^2), m/s
* `wrf_available`: s there any data from wrf
* `wrf_t2_next`:  next horizon temperature at 2m, K
* `wrf_psfc`: pressure, Pa
* `wrf_rh2`: relative humidity at 2m, from 0 to 1
* `wrf_wind_u`: wind U component, m/s
* `wrf_wind_v`: wind V component, m/s
* `wrf_rain`: avg rain rate between two horizons, mm/h
* `wrf_snow`: avg snow rate between two horizons, mm/h
* `wrf_graupel`: avg graupel rate between two horizons, mm/h
* `wrf_t2_interpolated`: wrf_t2_interpolated between horizons, K
* `wrf_t2_grad`: difference between temperatures at 2m on adjacent horizons, K
* `cmc_0_1_65_0_grad`: rain accumulated from cmc gentime difference between adjacent horizons, mm
* `cmc_0_1_65_0_next`: rain accumulated from cmc gentime for next horizon, mm
* `cmc_0_1_66_0_grad`: snow accumulated from cmc gentime difference between adjacent horizons, mm
* `cmc_0_1_66_0_next`: snow accumulated from cmc gentime for next horizon, mm
* `cmc_0_1_67_0_grad`: ice rain accumulated from cmc gentime difference between adjacent horizons, mm
* `cmc_0_1_67_0_next`: ice rain accumulated from cmc gentime for next horizon, mm
* `cmc_0_1_68_0_grad`: iced graupel accumulated from cmc gentime difference between adjacent horizons, mm
* `cmc_0_1_68_0_next`: iced graupel accumulated from cmc gentime for next horizon, mm
* `gfs_2m_dewpoint_grad`: dew point temperature at 2m difference between horizons, C
* `gfs_2m_dewpoint_next`: dew point temperature on next horizon, C
* `gfs_total_clouds_cover_low_grad`: difference between low level cloud coverage on adjacent horizons, %
* `gfs_total_clouds_cover_low_next`:  next horizon cloud coverage (between horizons, divisible by 6) at low level, %
* `fact_temperature`: temperature, C [targets]


## Copyright 
This data is created starting from the available dataset used for the **Shift Competition**, held during the [NeurIPS conference 2021](https://neurips.cc/Conferences/2021/CompetitionTrack).
The original Shifts Weather Prediction Dataset is released under CC BY NC SA 4.0 license. This dataset was constructed by combining features from publicly available weather prediction services and models. Specifically, we combined data from NOAA/NWS servers, data generated by the WRF model from NCAR/UCAR, and data from the Meteorological Service of Canada. Ground station readings were taken from [NOAA](https://www.weather.gov/disclaimer). 
The data was further cleaned and subsampled to meet the requirements of the AML challenge.