{
  "id": 191217,
  "title": "Useful external datasets for CDP competition",
  "url": "/competitions/cdp-unlocking-climate-solutions/discussion/191217",
  "author_name": "",
  "post_date": "2020-10-15T09:06:16.117586Z",
  "votes": 9,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Datasets I found useful so far: </p>\n<p>1 - <a href=\"https://www.kaggle.com/fkosmowski/ambient-air-quality-database/\" target=\"_blank\">Air Pollution (WHO)</a><br>\nDataset covers 4498 cities and 108 countries, many of them also present in the CDP datasets. Air quality is measured with annual mean concentrations particulate matter (PM10 or PM2.5) concentrations from 2008 to 2017. Data descriptor notebook <a href=\"https://www.kaggle.com/fkosmowski/data-descriptor-notebook\" target=\"_blank\">here</a>.</p>\n<p>2 - <a href=\"https://www.kaggle.com/fkosmowski/covid19-community-mobility-reports\" target=\"_blank\">COVID-19 Community Mobility Reports (Google)</a><br>\nThe pandemic context brings new challenges to cities. This fantastic resource was created by Google with aggregated, anonymized sets of data from users who have turned on the Location History setting on Android. It captures the changes in mobility between baseline values (median value from the 5‑week period Jan 3 – Feb 6, 2020) at weekly intervals data from February to October 2020. Data include changes in mobility related to workplace, residential, transit hubs, parks, retail and grocery. It covers 593 cities in 43 countries. Kernel is <a href=\"https://www.kaggle.com/fkosmowski/google\" target=\"_blank\">here</a></p>\n<p>3 - <a href=\"https://www.kaggle.com/fkosmowski/country-income-and-inequalities\" target=\"_blank\">Income Group and Inequalities (World Bank)</a><br>\nThe World Bank classifies the world's economies into four income groups — high, upper-middle, lower-middle, and low. The dataset contain the 2020 classification on 264 countries. Gini index which measures inequalities is also available from 2011 to 2020 for a set of countries. Starter notebook <a href=\"https://www.kaggle.com/fkosmowski/data-descriptor-wb\" target=\"_blank\">here</a></p>\n<p>4 - <a href=\"https://www.kaggle.com/fkosmowski/city-access-to-basic-services\" target=\"_blank\">Access to Basic Services (UN Habitat)</a>  <br>\nContains three datasets: a) % of population with access to public transports, b) % access to basic services and c) % population living in slums from 1990 to 2018. Covers 1216 cities from 115 countries. Starter <a href=\"https://www.kaggle.com/fkosmowski/starter\" target=\"_blank\">notebook</a></p>\n<p>5 - <a href=\"https://www.kaggle.com/fkosmowski/cdp-ease-of-doing-business/settings\" target=\"_blank\">Ease of Doing Business (World Bank)</a><br>\nEase of doing business is an index published by the World Bank. It is an aggregate figure of a country scores on 10 topics and Economies are ranked from 1–190. Dataset contains 213 countries and span the different metrics used to construct the index for 2018, 2019 and 2020. Electricity reliability, outage durations, cost are particularly interesting for the CDP challenge (linkages with energy, transport, etc). Starter notebook <a href=\"https://www.kaggle.com/fkosmowski/starter-easedoingbusiness\" target=\"_blank\">here</a></p>\n<p>6 - <a href=\"https://www.kaggle.com/fkosmowski/cdp-complementary-datasets/settings\" target=\"_blank\">GHG emissions (CDP)</a><br>\nDataset from CDP but not included initially. Annual city-wide emissions for 44 cities. Includes GHG emission with information about how cities measured emissions, as well as why emissions rose/fell since prior reporting period</p>",
  "messages": [
    {
      "id": "1050310",
      "postDate": "10/15/2020 09:06:16",
      "content": "<p>Datasets I found useful so far: </p>\n<p>1 - <a href=\"https://www.kaggle.com/fkosmowski/ambient-air-quality-database/\" target=\"_blank\">Air Pollution (WHO)</a><br>\nDataset covers 4498 cities and 108 countries, many of them also present in the CDP datasets. Air quality is measured with annual mean concentrations particulate matter (PM10 or PM2.5) concentrations from 2008 to 2017. Data descriptor notebook <a href=\"https://www.kaggle.com/fkosmowski/data-descriptor-notebook\" target=\"_blank\">here</a>.</p>\n<p>2 - <a href=\"https://www.kaggle.com/fkosmowski/covid19-community-mobility-reports\" target=\"_blank\">COVID-19 Community Mobility Reports (Google)</a><br>\nThe pandemic context brings new challenges to cities. This fantastic resource was created by Google with aggregated, anonymized sets of data from users who have turned on the Location History setting on Android. It captures the changes in mobility between baseline values (median value from the 5‑week period Jan 3 – Feb 6, 2020) at weekly intervals data from February to October 2020. Data include changes in mobility related to workplace, residential, transit hubs, parks, retail and grocery. It covers 593 cities in 43 countries. Kernel is <a href=\"https://www.kaggle.com/fkosmowski/google\" target=\"_blank\">here</a></p>\n<p>3 - <a href=\"https://www.kaggle.com/fkosmowski/country-income-and-inequalities\" target=\"_blank\">Income Group and Inequalities (World Bank)</a><br>\nThe World Bank classifies the world's economies into four income groups — high, upper-middle, lower-middle, and low. The dataset contain the 2020 classification on 264 countries. Gini index which measures inequalities is also available from 2011 to 2020 for a set of countries. Starter notebook <a href=\"https://www.kaggle.com/fkosmowski/data-descriptor-wb\" target=\"_blank\">here</a></p>\n<p>4 - <a href=\"https://www.kaggle.com/fkosmowski/city-access-to-basic-services\" target=\"_blank\">Access to Basic Services (UN Habitat)</a>  <br>\nContains three datasets: a) % of population with access to public transports, b) % access to basic services and c) % population living in slums from 1990 to 2018. Covers 1216 cities from 115 countries. Starter <a href=\"https://www.kaggle.com/fkosmowski/starter\" target=\"_blank\">notebook</a></p>\n<p>5 - <a href=\"https://www.kaggle.com/fkosmowski/cdp-ease-of-doing-business/settings\" target=\"_blank\">Ease of Doing Business (World Bank)</a><br>\nEase of doing business is an index published by the World Bank. It is an aggregate figure of a country scores on 10 topics and Economies are ranked from 1–190. Dataset contains 213 countries and span the different metrics used to construct the index for 2018, 2019 and 2020. Electricity reliability, outage durations, cost are particularly interesting for the CDP challenge (linkages with energy, transport, etc). Starter notebook <a href=\"https://www.kaggle.com/fkosmowski/starter-easedoingbusiness\" target=\"_blank\">here</a></p>\n<p>6 - <a href=\"https://www.kaggle.com/fkosmowski/cdp-complementary-datasets/settings\" target=\"_blank\">GHG emissions (CDP)</a><br>\nDataset from CDP but not included initially. Annual city-wide emissions for 44 cities. Includes GHG emission with information about how cities measured emissions, as well as why emissions rose/fell since prior reporting period</p>",
      "rawMarkdown": "Datasets I found useful so far: \n\n1 - [Air Pollution (WHO)](https://www.kaggle.com/fkosmowski/ambient-air-quality-database/)\nDataset covers 4498 cities and 108 countries, many of them also present in the CDP datasets. Air quality is measured with annual mean concentrations particulate matter (PM10 or PM2.5) concentrations from 2008 to 2017. Data descriptor notebook [here](https://www.kaggle.com/fkosmowski/data-descriptor-notebook).\n\n2 - [COVID-19 Community Mobility Reports (Google)](https://www.kaggle.com/fkosmowski/covid19-community-mobility-reports)\nThe pandemic context brings new challenges to cities. This fantastic resource was created by Google with aggregated, anonymized sets of data from users who have turned on the Location History setting on Android. It captures the changes in mobility between baseline values (median value from the 5‑week period Jan 3 – Feb 6, 2020) at weekly intervals data from February to October 2020. Data include changes in mobility related to workplace, residential, transit hubs, parks, retail and grocery. It covers 593 cities in 43 countries. Kernel is [here](https://www.kaggle.com/fkosmowski/google)\n\n3 - [Income Group and Inequalities (World Bank)](https://www.kaggle.com/fkosmowski/country-income-and-inequalities)\nThe World Bank classifies the world's economies into four income groups — high, upper-middle, lower-middle, and low. The dataset contain the 2020 classification on 264 countries. Gini index which measures inequalities is also available from 2011 to 2020 for a set of countries. Starter notebook [here](https://www.kaggle.com/fkosmowski/data-descriptor-wb)\n\n4 - [Access to Basic Services (UN Habitat)](https://www.kaggle.com/fkosmowski/city-access-to-basic-services)  \nContains three datasets: a) % of population with access to public transports, b) % access to basic services and c) % population living in slums from 1990 to 2018. Covers 1216 cities from 115 countries. Starter [notebook](https://www.kaggle.com/fkosmowski/starter)\n\n5 - [Ease of Doing Business (World Bank)](https://www.kaggle.com/fkosmowski/cdp-ease-of-doing-business/settings)\nEase of doing business is an index published by the World Bank. It is an aggregate figure of a country scores on 10 topics and Economies are ranked from 1–190. Dataset contains 213 countries and span the different metrics used to construct the index for 2018, 2019 and 2020. Electricity reliability, outage durations, cost are particularly interesting for the CDP challenge (linkages with energy, transport, etc). Starter notebook [here](https://www.kaggle.com/fkosmowski/starter-easedoingbusiness)\n\n6 - [GHG emissions (CDP)](https://www.kaggle.com/fkosmowski/cdp-complementary-datasets/settings)\nDataset from CDP but not included initially. Annual city-wide emissions for 44 cities. Includes GHG emission with information about how cities measured emissions, as well as why emissions rose/fell since prior reporting period",
      "votes": null
    },
    {
      "id": "1053342",
      "postDate": "10/18/2020 21:34:07",
      "content": "<p>The last link doesn't work.</p>",
      "rawMarkdown": "The last link doesn't work.",
      "votes": null
    },
    {
      "id": "1053603",
      "postDate": "10/19/2020 06:53:38",
      "content": "<p>Fixed! Thanks</p>",
      "rawMarkdown": "Fixed! Thanks",
      "votes": null
    },
    {
      "id": "1059245",
      "postDate": "10/24/2020 20:11:55",
      "content": "<p>Updated with starter notebooks and reasons why these are interesting for the competition</p>",
      "rawMarkdown": "Updated with starter notebooks and reasons why these are interesting for the competition",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1053342,
      "author_name": "princi",
      "author_url": "",
      "post_date": "10/18/2020 21:34:07",
      "content": "<p>The last link doesn't work.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1053603,
          "author_name": "fkosmowski",
          "author_url": "",
          "post_date": "10/19/2020 06:53:38",
          "content": "<p>Fixed! Thanks</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1059245,
      "author_name": "fkosmowski",
      "author_url": "",
      "post_date": "10/24/2020 20:11:55",
      "content": "<p>Updated with starter notebooks and reasons why these are interesting for the competition</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1050310": "Datasets I found useful so far: \n\n1 - [Air Pollution (WHO)](https://www.kaggle.com/fkosmowski/ambient-air-quality-database/)\nDataset covers 4498 cities and 108 countries, many of them also present in the CDP datasets. Air quality is measured with annual mean concentrations particulate matter (PM10 or PM2.5) concentrations from 2008 to 2017. Data descriptor notebook [here](https://www.kaggle.com/fkosmowski/data-descriptor-notebook).\n\n2 - [COVID-19 Community Mobility Reports (Google)](https://www.kaggle.com/fkosmowski/covid19-community-mobility-reports)\nThe pandemic context brings new challenges to cities. This fantastic resource was created by Google with aggregated, anonymized sets of data from users who have turned on the Location History setting on Android. It captures the changes in mobility between baseline values (median value from the 5‑week period Jan 3 – Feb 6, 2020) at weekly intervals data from February to October 2020. Data include changes in mobility related to workplace, residential, transit hubs, parks, retail and grocery. It covers 593 cities in 43 countries. Kernel is [here](https://www.kaggle.com/fkosmowski/google)\n\n3 - [Income Group and Inequalities (World Bank)](https://www.kaggle.com/fkosmowski/country-income-and-inequalities)\nThe World Bank classifies the world's economies into four income groups — high, upper-middle, lower-middle, and low. The dataset contain the 2020 classification on 264 countries. Gini index which measures inequalities is also available from 2011 to 2020 for a set of countries. Starter notebook [here](https://www.kaggle.com/fkosmowski/data-descriptor-wb)\n\n4 - [Access to Basic Services (UN Habitat)](https://www.kaggle.com/fkosmowski/city-access-to-basic-services)  \nContains three datasets: a) % of population with access to public transports, b) % access to basic services and c) % population living in slums from 1990 to 2018. Covers 1216 cities from 115 countries. Starter [notebook](https://www.kaggle.com/fkosmowski/starter)\n\n5 - [Ease of Doing Business (World Bank)](https://www.kaggle.com/fkosmowski/cdp-ease-of-doing-business/settings)\nEase of doing business is an index published by the World Bank. It is an aggregate figure of a country scores on 10 topics and Economies are ranked from 1–190. Dataset contains 213 countries and span the different metrics used to construct the index for 2018, 2019 and 2020. Electricity reliability, outage durations, cost are particularly interesting for the CDP challenge (linkages with energy, transport, etc). Starter notebook [here](https://www.kaggle.com/fkosmowski/starter-easedoingbusiness)\n\n6 - [GHG emissions (CDP)](https://www.kaggle.com/fkosmowski/cdp-complementary-datasets/settings)\nDataset from CDP but not included initially. Annual city-wide emissions for 44 cities. Includes GHG emission with information about how cities measured emissions, as well as why emissions rose/fell since prior reporting period",
    "1053342": "The last link doesn't work.",
    "1053603": "Fixed! Thanks",
    "1059245": "Updated with starter notebooks and reasons why these are interesting for the competition"
  },
  "source": "meta"
}