{
  "id": 239127,
  "title": "Regarding Labelling",
  "url": "/competitions/coleridgeinitiative-show-us-the-data/discussion/239127",
  "author_name": "",
  "post_date": "2021-05-14T20:57:16.917280700Z",
  "votes": null,
  "comment_count": 10,
  "views": 0,
  "content": "<p>id_ = 'a4589c97-6678-443f-9715-d9281ea13561'<br>\nsection_title = 'Data'<br>\nFirst few lines:<br>\nThe data used in this research were obtained from Nielsen Inc.'s retail scanner data set for January 1, 2007, through December 31, 2012; USDA Economic Research Service rural-urban continuum codes; and the U.S. Census Bureau's American Community Survey for [2008] [2009] [2010] [2011] [2012] .</p>\n<p>cleaned_label = \"rural urban continuum codes\"</p>\n<p>Possible labels = \"Nielsen Inc.'s retail scanner data set\", \"rural-urban continuum codes\", \"U.S. Census Bureau's American Community Survey\"</p>\n<p>Why is \"rural urban continuum codes\" the only correct label? Not the other two??</p>",
  "messages": [
    {
      "id": "1307995",
      "postDate": "05/14/2021 20:57:16",
      "content": "<p>id_ = 'a4589c97-6678-443f-9715-d9281ea13561'<br>\nsection_title = 'Data'<br>\nFirst few lines:<br>\nThe data used in this research were obtained from Nielsen Inc.'s retail scanner data set for January 1, 2007, through December 31, 2012; USDA Economic Research Service rural-urban continuum codes; and the U.S. Census Bureau's American Community Survey for [2008] [2009] [2010] [2011] [2012] .</p>\n<p>cleaned_label = \"rural urban continuum codes\"</p>\n<p>Possible labels = \"Nielsen Inc.'s retail scanner data set\", \"rural-urban continuum codes\", \"U.S. Census Bureau's American Community Survey\"</p>\n<p>Why is \"rural urban continuum codes\" the only correct label? Not the other two??</p>",
      "rawMarkdown": "id_ = 'a4589c97-6678-443f-9715-d9281ea13561'\nsection_title = 'Data'\nFirst few lines:\nThe data used in this research were obtained from Nielsen Inc.'s retail scanner data set for January 1, 2007, through December 31, 2012; USDA Economic Research Service rural-urban continuum codes; and the U.S. Census Bureau's American Community Survey for [2008] [2009] [2010] [2011] [2012] .\n\ncleaned_label = \"rural urban continuum codes\"\n\nPossible labels = \"Nielsen Inc.'s retail scanner data set\", \"rural-urban continuum codes\", \"U.S. Census Bureau's American Community Survey\"\n\nWhy is \"rural urban continuum codes\" the only correct label? Not the other two??",
      "votes": null
    },
    {
      "id": "1308018",
      "postDate": "05/14/2021 21:56:56",
      "content": "<p>Because the train labels are incomplete. This is intentional.</p>",
      "rawMarkdown": "Because the train labels are incomplete. This is intentional.",
      "votes": null
    },
    {
      "id": "1308384",
      "postDate": "05/15/2021 06:54:39",
      "content": "<p>I do not think that Nielsen Inc.'s retail scanner data set is a gov't dataset though</p>",
      "rawMarkdown": "I do not think that Nielsen Inc.'s retail scanner data set is a gov't dataset though",
      "votes": null
    },
    {
      "id": "1308769",
      "postDate": "05/15/2021 12:51:58",
      "content": "<p><a href=\"https://www.kaggle.com/mlconsult\" target=\"_blank\">@mlconsult</a> Why do think it has to be a <em>gov't</em> dataset?</p>",
      "rawMarkdown": "mlconsult Why do think it has to be a *gov't* dataset?",
      "votes": null
    },
    {
      "id": "1312610",
      "postDate": "05/18/2021 06:32:27",
      "content": "<p>\"This competition challenges data scientists to show how publicly funded data are used to serve science and society. \"</p>\n<p>\"If successful, you'll help support evidence in government data. Automated NLP approaches will enable government agencies and researchers to quickly find the information they need. The approach will be used to develop data usage scorecards to better enable agencies to show how their data are used and bring down a critical barrier to the access and use of public data. \"</p>",
      "rawMarkdown": "\"This competition challenges data scientists to show how publicly funded data are used to serve science and society. \"\n\n\"If successful, you'll help support evidence in government data. Automated NLP approaches will enable government agencies and researchers to quickly find the information they need. The approach will be used to develop data usage scorecards to better enable agencies to show how their data are used and bring down a critical barrier to the access and use of public data. \"",
      "votes": null
    },
    {
      "id": "1312808",
      "postDate": "05/18/2021 08:59:16",
      "content": "<p>Yes, I see your point, the description invites this conclusion.</p>\n<p>But you could also just interpret this as the general description of the aim/purpose of the competition and the concrete task may be to identify any dataset:</p>\n<blockquote>\n  <p>The objective of the competition is to identify the mention of datasets within scientific publications. Your predictions will be short excerpts from the publications that appear to note a dataset. </p>\n</blockquote>",
      "rawMarkdown": "Yes, I see your point, the description invites this conclusion.\n\nBut you could also just interpret this as the general description of the aim/purpose of the competition and the concrete task may be to identify any dataset:\n\n> The objective of the competition is to identify the mention of datasets within scientific publications. Your predictions will be short excerpts from the publications that appear to note a dataset.",
      "votes": null
    },
    {
      "id": "1312820",
      "postDate": "05/18/2021 09:08:57",
      "content": "<p>To add: Not all datasets labelled in the training data are gov't data: </p>\n<blockquote>\n  <p>Our World In Data is a project of the Global Change Data Lab, a registered charity in England and Wales</p>\n</blockquote>\n<p><a href=\"https://ourworldindata.org/about\" target=\"_blank\">https://ourworldindata.org/about</a></p>",
      "rawMarkdown": "To add: Not all datasets labelled in the training data are gov't data: \n\n> Our World In Data is a project of the Global Change Data Lab, a registered charity in England and Wales\n\nhttps://ourworldindata.org/about",
      "votes": null
    },
    {
      "id": "1313073",
      "postDate": "05/18/2021 11:51:38",
      "content": "<p>To your point all data Gov't datasets labelled either - maybe to cause noise.</p>\n<p>Disagree as to WOD - NOAA does keep an original version of the WOD through NCEI.</p>\n<p>\"Original versions of the 20,000+ datasets in the WOD are available through the NCEI archives.\"</p>\n<p><a href=\"https://www.ncei.noaa.gov/products/world-ocean-database\" target=\"_blank\">https://www.ncei.noaa.gov/products/world-ocean-database</a></p>\n<p>It appears that Our World in Data is not US Gov't, but there may be some funding as US funds foreign research.</p>",
      "rawMarkdown": "To your point all data Gov't datasets labelled either - maybe to cause noise.\n\nDisagree as to WOD - NOAA does keep an original version of the WOD through NCEI.\n\n\"Original versions of the 20,000+ datasets in the WOD are available through the NCEI archives.\"\n\nhttps://www.ncei.noaa.gov/products/world-ocean-database\n\nIt appears that Our World in Data is not US Gov't, but there may be some funding as US funds foreign research.",
      "votes": null
    },
    {
      "id": "1313100",
      "postDate": "05/18/2021 12:05:07",
      "content": "<p>It may not be US goverments but is government datasets would appear - \"Beyond the prizes, your work will help governments do their job better. Governments the world over are being force to modernize their data management practices and be more open and transparent in how data are used. You can help build scientific basis for evidence based decision making.\"</p>",
      "rawMarkdown": "It may not be US goverments but is government datasets would appear - \"Beyond the prizes, your work will help governments do their job better. Governments the world over are being force to modernize their data management practices and be more open and transparent in how data are used. You can help build scientific basis for evidence based decision making.\"",
      "votes": null
    },
    {
      "id": "1313396",
      "postDate": "05/18/2021 14:40:00",
      "content": "<p>You have some points here. Still I find it a bit overambitious to ask our models to distinguish between gov't and non-gov't datasets!? I at least need to google in many cases to find out :-)</p>",
      "rawMarkdown": "You have some points here. Still I find it a bit overambitious to ask our models to distinguish between gov't and non-gov't datasets!? I at least need to google in many cases to find out :-)",
      "votes": null
    },
    {
      "id": "1313412",
      "postDate": "05/18/2021 14:48:41",
      "content": "<p>agree - I have been doing a lot of googling</p>",
      "rawMarkdown": "agree - I have been doing a lot of googling",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1308018,
      "author_name": "pablocarb",
      "author_url": "",
      "post_date": "05/14/2021 21:56:56",
      "content": "<p>Because the train labels are incomplete. This is intentional.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1308384,
      "author_name": "mlconsult",
      "author_url": "",
      "post_date": "05/15/2021 06:54:39",
      "content": "<p>I do not think that Nielsen Inc.'s retail scanner data set is a gov't dataset though</p>",
      "votes": null,
      "replies": [
        {
          "id": 1308769,
          "author_name": "hannes82",
          "author_url": "",
          "post_date": "05/15/2021 12:51:58",
          "content": "<p><a href=\"https://www.kaggle.com/mlconsult\" target=\"_blank\">@mlconsult</a> Why do think it has to be a <em>gov't</em> dataset?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1312610,
          "author_name": "mlconsult",
          "author_url": "",
          "post_date": "05/18/2021 06:32:27",
          "content": "<p>\"This competition challenges data scientists to show how publicly funded data are used to serve science and society. \"</p>\n<p>\"If successful, you'll help support evidence in government data. Automated NLP approaches will enable government agencies and researchers to quickly find the information they need. The approach will be used to develop data usage scorecards to better enable agencies to show how their data are used and bring down a critical barrier to the access and use of public data. \"</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1312808,
          "author_name": "hannes82",
          "author_url": "",
          "post_date": "05/18/2021 08:59:16",
          "content": "<p>Yes, I see your point, the description invites this conclusion.</p>\n<p>But you could also just interpret this as the general description of the aim/purpose of the competition and the concrete task may be to identify any dataset:</p>\n<blockquote>\n  <p>The objective of the competition is to identify the mention of datasets within scientific publications. Your predictions will be short excerpts from the publications that appear to note a dataset. </p>\n</blockquote>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1312820,
          "author_name": "hannes82",
          "author_url": "",
          "post_date": "05/18/2021 09:08:57",
          "content": "<p>To add: Not all datasets labelled in the training data are gov't data: </p>\n<blockquote>\n  <p>Our World In Data is a project of the Global Change Data Lab, a registered charity in England and Wales</p>\n</blockquote>\n<p><a href=\"https://ourworldindata.org/about\" target=\"_blank\">https://ourworldindata.org/about</a></p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1313073,
          "author_name": "mlconsult",
          "author_url": "",
          "post_date": "05/18/2021 11:51:38",
          "content": "<p>To your point all data Gov't datasets labelled either - maybe to cause noise.</p>\n<p>Disagree as to WOD - NOAA does keep an original version of the WOD through NCEI.</p>\n<p>\"Original versions of the 20,000+ datasets in the WOD are available through the NCEI archives.\"</p>\n<p><a href=\"https://www.ncei.noaa.gov/products/world-ocean-database\" target=\"_blank\">https://www.ncei.noaa.gov/products/world-ocean-database</a></p>\n<p>It appears that Our World in Data is not US Gov't, but there may be some funding as US funds foreign research.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1313100,
          "author_name": "mlconsult",
          "author_url": "",
          "post_date": "05/18/2021 12:05:07",
          "content": "<p>It may not be US goverments but is government datasets would appear - \"Beyond the prizes, your work will help governments do their job better. Governments the world over are being force to modernize their data management practices and be more open and transparent in how data are used. You can help build scientific basis for evidence based decision making.\"</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1313396,
          "author_name": "hannes82",
          "author_url": "",
          "post_date": "05/18/2021 14:40:00",
          "content": "<p>You have some points here. Still I find it a bit overambitious to ask our models to distinguish between gov't and non-gov't datasets!? I at least need to google in many cases to find out :-)</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1313412,
          "author_name": "mlconsult",
          "author_url": "",
          "post_date": "05/18/2021 14:48:41",
          "content": "<p>agree - I have been doing a lot of googling</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1307995": "id_ = 'a4589c97-6678-443f-9715-d9281ea13561'\nsection_title = 'Data'\nFirst few lines:\nThe data used in this research were obtained from Nielsen Inc.'s retail scanner data set for January 1, 2007, through December 31, 2012; USDA Economic Research Service rural-urban continuum codes; and the U.S. Census Bureau's American Community Survey for [2008] [2009] [2010] [2011] [2012] .\n\ncleaned_label = \"rural urban continuum codes\"\n\nPossible labels = \"Nielsen Inc.'s retail scanner data set\", \"rural-urban continuum codes\", \"U.S. Census Bureau's American Community Survey\"\n\nWhy is \"rural urban continuum codes\" the only correct label? Not the other two??",
    "1308018": "Because the train labels are incomplete. This is intentional.",
    "1308384": "I do not think that Nielsen Inc.'s retail scanner data set is a gov't dataset though",
    "1308769": "mlconsult Why do think it has to be a *gov't* dataset?",
    "1312610": "\"This competition challenges data scientists to show how publicly funded data are used to serve science and society. \"\n\n\"If successful, you'll help support evidence in government data. Automated NLP approaches will enable government agencies and researchers to quickly find the information they need. The approach will be used to develop data usage scorecards to better enable agencies to show how their data are used and bring down a critical barrier to the access and use of public data. \"",
    "1312808": "Yes, I see your point, the description invites this conclusion.\n\nBut you could also just interpret this as the general description of the aim/purpose of the competition and the concrete task may be to identify any dataset:\n\n> The objective of the competition is to identify the mention of datasets within scientific publications. Your predictions will be short excerpts from the publications that appear to note a dataset.",
    "1312820": "To add: Not all datasets labelled in the training data are gov't data: \n\n> Our World In Data is a project of the Global Change Data Lab, a registered charity in England and Wales\n\nhttps://ourworldindata.org/about",
    "1313073": "To your point all data Gov't datasets labelled either - maybe to cause noise.\n\nDisagree as to WOD - NOAA does keep an original version of the WOD through NCEI.\n\n\"Original versions of the 20,000+ datasets in the WOD are available through the NCEI archives.\"\n\nhttps://www.ncei.noaa.gov/products/world-ocean-database\n\nIt appears that Our World in Data is not US Gov't, but there may be some funding as US funds foreign research.",
    "1313100": "It may not be US goverments but is government datasets would appear - \"Beyond the prizes, your work will help governments do their job better. Governments the world over are being force to modernize their data management practices and be more open and transparent in how data are used. You can help build scientific basis for evidence based decision making.\"",
    "1313396": "You have some points here. Still I find it a bit overambitious to ask our models to distinguish between gov't and non-gov't datasets!? I at least need to google in many cases to find out :-)",
    "1313412": "agree - I have been doing a lot of googling"
  },
  "source": "meta"
}