{
  "id": 235516,
  "title": "can't see the datasets for the trees",
  "url": "/competitions/coleridgeinitiative-show-us-the-data/discussion/235516",
  "author_name": "Ken Miller",
  "post_date": "2021-04-30T00:17:20.730000",
  "votes": 2,
  "comment_count": 0,
  "views": 0,
  "content": "<p>I was doing some testing on the 4 sample submission documents and came up with these datsets.  Some are not government datasets and some are not datasets at all, but many are the real thing and a lot of them do not appear in the training sets.</p>\n<p>My testing did not find all the ones that I found with string matching, but I think there is a whole wide world of datasets out there that string matching will never detect.  Problem still remains the ground truth of what a dataset mention is and who decides what the ground truth is.</p>\n<p>The preceding numbers are simply the word count for that row.</p>\n<p>2100032a-7c33-4bff-97ef-690822c43466<br>\n7 data from at least one neuropsychological measure<br>\n4 genome wide snp microarrays<br>\n5 1000 genomes project reference panels<br>\n8 ping study the alzheimer s disease neuroimaging initiative</p>\n<p>2f392438-e215-4169-bebf-21ac4ff253e1<br>\n11 pirls indicators one presenting data using the pirls international performance benchmarks<br>\n5 nces common core of data<br>\n6 timss 2007 fourth grade mathematics assessment<br>\n7 2006 progress in international reading literacy study<br>\n8 2007 trends in international mathematics and science study<br>\n9 2007 oecd indicators of national education systems ines survey<br>\n4 oecd national accounts database<br>\n9 international standard classification of education major field of study<br>\n6 timss 2007 eighth grade mathematics assessment<br>\n6 timss 2007 fourth grade science assessment<br>\n4 timss 2007 science assessment<br>\n6 timss 2007 eighth grade science assessment<br>\n5 program for international student assessment</p>\n<p>3f316b38-1a24-45a9-8d8c-4e05a42257c6<br>\n5 sea level affecting marshes model<br>\n5 remotely sensed airborne elevation data<br>\n4 historical shoreline change assessment<br>\n11 national geodetic survey remote sensing division collected quality level 2 lidar<br>\n4 storm surge vulnerability assessment<br>\n5 the nc coastal erosion study<br>\n4 the coastal erosion study<br>\n4 nc floodplain mapping program</p>\n<p>8e6996b4-ca08-4c0b-bed2-aaf07a4c6a60     <br>\n4 a shopper intercept survey<br>\n4 homescan and ces datasets<br>\n5 iri consumer network panel data<br>\n4 rural urban continuum codes<br>\n5 data manipulation the primary survey<br>\n9 national health and nutrition examination survey national food survey</p>",
  "messages": [
    {
      "id": 1288379,
      "postDate": "2021-04-30T00:17:20.730Z",
      "content": "<p>I was doing some testing on the 4 sample submission documents and came up with these datsets.  Some are not government datasets and some are not datasets at all, but many are the real thing and a lot of them do not appear in the training sets.</p>\n<p>My testing did not find all the ones that I found with string matching, but I think there is a whole wide world of datasets out there that string matching will never detect.  Problem still remains the ground truth of what a dataset mention is and who decides what the ground truth is.</p>\n<p>The preceding numbers are simply the word count for that row.</p>\n<p>2100032a-7c33-4bff-97ef-690822c43466<br>\n7 data from at least one neuropsychological measure<br>\n4 genome wide snp microarrays<br>\n5 1000 genomes project reference panels<br>\n8 ping study the alzheimer s disease neuroimaging initiative</p>\n<p>2f392438-e215-4169-bebf-21ac4ff253e1<br>\n11 pirls indicators one presenting data using the pirls international performance benchmarks<br>\n5 nces common core of data<br>\n6 timss 2007 fourth grade mathematics assessment<br>\n7 2006 progress in international reading literacy study<br>\n8 2007 trends in international mathematics and science study<br>\n9 2007 oecd indicators of national education systems ines survey<br>\n4 oecd national accounts database<br>\n9 international standard classification of education major field of study<br>\n6 timss 2007 eighth grade mathematics assessment<br>\n6 timss 2007 fourth grade science assessment<br>\n4 timss 2007 science assessment<br>\n6 timss 2007 eighth grade science assessment<br>\n5 program for international student assessment</p>\n<p>3f316b38-1a24-45a9-8d8c-4e05a42257c6<br>\n5 sea level affecting marshes model<br>\n5 remotely sensed airborne elevation data<br>\n4 historical shoreline change assessment<br>\n11 national geodetic survey remote sensing division collected quality level 2 lidar<br>\n4 storm surge vulnerability assessment<br>\n5 the nc coastal erosion study<br>\n4 the coastal erosion study<br>\n4 nc floodplain mapping program</p>\n<p>8e6996b4-ca08-4c0b-bed2-aaf07a4c6a60     <br>\n4 a shopper intercept survey<br>\n4 homescan and ces datasets<br>\n5 iri consumer network panel data<br>\n4 rural urban continuum codes<br>\n5 data manipulation the primary survey<br>\n9 national health and nutrition examination survey national food survey</p>",
      "rawMarkdown": "I was doing some testing on the 4 sample submission documents and came up with these datsets.  Some are not government datasets and some are not datasets at all, but many are the real thing and a lot of them do not appear in the training sets.\n\nMy testing did not find all the ones that I found with string matching, but I think there is a whole wide world of datasets out there that string matching will never detect.  Problem still remains the ground truth of what a dataset mention is and who decides what the ground truth is.\n\nThe preceding numbers are simply the word count for that row.\n\n2100032a-7c33-4bff-97ef-690822c43466\n7 data from at least one neuropsychological measure\n4 genome wide snp microarrays\n5 1000 genomes project reference panels\n8 ping study the alzheimer s disease neuroimaging initiative\n\n2f392438-e215-4169-bebf-21ac4ff253e1\n11 pirls indicators one presenting data using the pirls international performance benchmarks\n5 nces common core of data\n6 timss 2007 fourth grade mathematics assessment\n7 2006 progress in international reading literacy study\n8 2007 trends in international mathematics and science study\n9 2007 oecd indicators of national education systems ines survey\n4 oecd national accounts database\n9 international standard classification of education major field of study\n6 timss 2007 eighth grade mathematics assessment\n6 timss 2007 fourth grade science assessment\n4 timss 2007 science assessment\n6 timss 2007 eighth grade science assessment\n5 program for international student assessment\n\n3f316b38-1a24-45a9-8d8c-4e05a42257c6\n5 sea level affecting marshes model\n5 remotely sensed airborne elevation data\n4 historical shoreline change assessment\n11 national geodetic survey remote sensing division collected quality level 2 lidar\n4 storm surge vulnerability assessment\n5 the nc coastal erosion study\n4 the coastal erosion study\n4 nc floodplain mapping program\n\n8e6996b4-ca08-4c0b-bed2-aaf07a4c6a60 \t\n4 a shopper intercept survey\n4 homescan and ces datasets\n5 iri consumer network panel data\n4 rural urban continuum codes\n5 data manipulation the primary survey\n9 national health and nutrition examination survey national food survey",
      "votes": 2
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "1288379": "I was doing some testing on the 4 sample submission documents and came up with these datsets.  Some are not government datasets and some are not datasets at all, but many are the real thing and a lot of them do not appear in the training sets.\n\nMy testing did not find all the ones that I found with string matching, but I think there is a whole wide world of datasets out there that string matching will never detect.  Problem still remains the ground truth of what a dataset mention is and who decides what the ground truth is.\n\nThe preceding numbers are simply the word count for that row.\n\n2100032a-7c33-4bff-97ef-690822c43466\n7 data from at least one neuropsychological measure\n4 genome wide snp microarrays\n5 1000 genomes project reference panels\n8 ping study the alzheimer s disease neuroimaging initiative\n\n2f392438-e215-4169-bebf-21ac4ff253e1\n11 pirls indicators one presenting data using the pirls international performance benchmarks\n5 nces common core of data\n6 timss 2007 fourth grade mathematics assessment\n7 2006 progress in international reading literacy study\n8 2007 trends in international mathematics and science study\n9 2007 oecd indicators of national education systems ines survey\n4 oecd national accounts database\n9 international standard classification of education major field of study\n6 timss 2007 eighth grade mathematics assessment\n6 timss 2007 fourth grade science assessment\n4 timss 2007 science assessment\n6 timss 2007 eighth grade science assessment\n5 program for international student assessment\n\n3f316b38-1a24-45a9-8d8c-4e05a42257c6\n5 sea level affecting marshes model\n5 remotely sensed airborne elevation data\n4 historical shoreline change assessment\n11 national geodetic survey remote sensing division collected quality level 2 lidar\n4 storm surge vulnerability assessment\n5 the nc coastal erosion study\n4 the coastal erosion study\n4 nc floodplain mapping program\n\n8e6996b4-ca08-4c0b-bed2-aaf07a4c6a60 \t\n4 a shopper intercept survey\n4 homescan and ces datasets\n5 iri consumer network panel data\n4 rural urban continuum codes\n5 data manipulation the primary survey\n9 national health and nutrition examination survey national food survey"
  }
}