{
  "id": 6914,
  "title": "True test set solutions posted by mistake?",
  "url": "/competitions/galaxy-zoo-the-galaxy-challenge/discussion/6914",
  "author_name": "João Simões Pedro",
  "post_date": "2014-01-23T17:07:55.443000",
  "votes": 0,
  "comment_count": 11,
  "views": 1901,
  "content": "<p>Hi there,</p>\n<p>I have just noticed that the names on image files from the training set do not match galaxy ID on the training set solutions.</p>\n<p>Actually there is no single match.</p>\n<p>Additionally there are 61578 images on the training set and 79975 Galaxy IDs on the training solutions. </p>\n<p>Just by chance, I suppose the test set is exactly 79975 pictures long.</p>\n<p>ups...</p>\n<p>&nbsp;</p>\n<p>&nbsp;</p>",
  "messages": [
    {
      "id": 37831,
      "postDate": "2014-01-23T19:09:01.587Z",
      "content": "<p>OK, good. I was definitely panicking there. I've re-uploaded training_solutions_rev1 to the Data page. I compared this to the central pixel benchmark, and they are different. Really not sure how these managed to get switched.</p>"
    },
    {
      "id": 37828,
      "postDate": "2014-01-23T18:49:49.223Z",
      "content": "<p>Problem solved.</p>\n<p>It is the central-pixel benchmark.</p>\n<p>&nbsp;</p>\n<p>Somehow I download a zip folder named:</p>\n<p>training_solutions_rev1.zip</p>\n<p>that contained a file named:</p>\n<p>training_solutions_rev1.csv</p>\n<p>&nbsp;</p>\n<p>That contained the benchmark solutions.</p>\n<p>&nbsp;</p>\n<p>&nbsp;</p>\n<p>&nbsp;</p>\n<p>&nbsp;</p>"
    },
    {
      "id": 37826,
      "postDate": "2014-01-23T18:37:09.073Z",
      "content": "<p>Hey, I don't intend to compete, but just looking at that file I think that's the central pixel benchmark because of the low amount of features that benchmark uses so a lot of predictions are the same.</p>\n<p>&nbsp;</p>\n<p>EDIT: Ok, deeper look, pretty sure it's the central pixel benchmark. Maybe something happened when you were playing with the files.</p>"
    },
    {
      "id": 37825,
      "postDate": "2014-01-23T18:35:33.470Z",
      "content": "<p>Joao, I deleted your post with the attachment in case there is this error. Investigating now.</p>"
    },
    {
      "id": 37824,
      "postDate": "2014-01-23T18:34:31.123Z",
      "content": "<p>Downloaded on Monday 15:45 GMT.</p>\n<p>Just noticed when I was getting bad (really bad) results from an algorithm. Then I noticed Galaxy IDs and file names did not match.</p>"
    },
    {
      "id": 37823,
      "postDate": "2014-01-23T18:30:28.377Z",
      "content": "<p>Looking into this now - please sit tight, everyone.&nbsp;</p>"
    },
    {
      "id": 37822,
      "postDate": "2014-01-23T18:26:28.637Z",
      "content": "<p>Jo&#227;o - don't post the file! &nbsp;If it's actually the test solutions, then having that publicly available would ruin the competition.</p>\n<p>&nbsp;</p>\n<p>I suggest waiting to hear back from the admins before you do anything with it.</p>\n<p>&nbsp;</p>"
    },
    {
      "id": 37820,
      "postDate": "2014-01-23T18:18:36.243Z",
      "content": "<p>Yes, Jo&#227;o, post your file please. Or you can try to submit it as a solution and see if it works.</p>"
    },
    {
      "id": 37818,
      "postDate": "2014-01-23T18:08:46.927Z",
      "content": "<p>No, my files goes from 100018 to 999996.<br><br><br>Check if you can get this file by re-downloading training_solutions_rev1.csv from the data page.</p>\n<p>I will post my file if required</p>"
    },
    {
      "id": 37811,
      "postDate": "2014-01-23T17:07:55.443Z",
      "content": "<p>Hi there,</p>\n<p>I have just noticed that the names on image files from the training set do not match galaxy ID on the training set solutions.</p>\n<p>Actually there is no single match.</p>\n<p>Additionally there are 61578 images on the training set and 79975 Galaxy IDs on the training solutions. </p>\n<p>Just by chance, I suppose the test set is exactly 79975 pictures long.</p>\n<p>ups...</p>\n<p>&nbsp;</p>\n<p>&nbsp;</p>"
    },
    {
      "id": 37819,
      "postDate": "2014-01-23T18:13:16.733Z",
      "rawMarkdown": "",
      "isDeleted": true
    },
    {
      "id": 37815,
      "postDate": "2014-01-23T17:48:51.417Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 37831,
      "author_name": "joycenv",
      "author_url": "",
      "post_date": "2014-01-23T19:09:01.587000",
      "content": "<p>OK, good. I was definitely panicking there. I've re-uploaded training_solutions_rev1 to the Data page. I compared this to the central pixel benchmark, and they are different. Really not sure how these managed to get switched.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 37828,
      "author_name": "João Simões Pedro",
      "author_url": "",
      "post_date": "2014-01-23T18:49:49.223000",
      "content": "<p>Problem solved.</p>\n<p>It is the central-pixel benchmark.</p>\n<p>&nbsp;</p>\n<p>Somehow I download a zip folder named:</p>\n<p>training_solutions_rev1.zip</p>\n<p>that contained a file named:</p>\n<p>training_solutions_rev1.csv</p>\n<p>&nbsp;</p>\n<p>That contained the benchmark solutions.</p>\n<p>&nbsp;</p>\n<p>&nbsp;</p>\n<p>&nbsp;</p>\n<p>&nbsp;</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 37826,
      "author_name": "Wen (Duffman)",
      "author_url": "",
      "post_date": "2014-01-23T18:37:09.073000",
      "content": "<p>Hey, I don't intend to compete, but just looking at that file I think that's the central pixel benchmark because of the low amount of features that benchmark uses so a lot of predictions are the same.</p>\n<p>&nbsp;</p>\n<p>EDIT: Ok, deeper look, pretty sure it's the central pixel benchmark. Maybe something happened when you were playing with the files.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 37825,
      "author_name": "joycenv",
      "author_url": "",
      "post_date": "2014-01-23T18:35:33.470000",
      "content": "<p>Joao, I deleted your post with the attachment in case there is this error. Investigating now.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 37824,
      "author_name": "João Simões Pedro",
      "author_url": "",
      "post_date": "2014-01-23T18:34:31.123000",
      "content": "<p>Downloaded on Monday 15:45 GMT.</p>\n<p>Just noticed when I was getting bad (really bad) results from an algorithm. Then I noticed Galaxy IDs and file names did not match.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 37823,
      "author_name": "Kyle Willett",
      "author_url": "",
      "post_date": "2014-01-23T18:30:28.377000",
      "content": "<p>Looking into this now - please sit tight, everyone.&nbsp;</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 37822,
      "author_name": "Ryan Keisler",
      "author_url": "",
      "post_date": "2014-01-23T18:26:28.637000",
      "content": "<p>Jo&#227;o - don't post the file! &nbsp;If it's actually the test solutions, then having that publicly available would ruin the competition.</p>\n<p>&nbsp;</p>\n<p>I suggest waiting to hear back from the admins before you do anything with it.</p>\n<p>&nbsp;</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 37820,
      "author_name": "redstr",
      "author_url": "",
      "post_date": "2014-01-23T18:18:36.243000",
      "content": "<p>Yes, Jo&#227;o, post your file please. Or you can try to submit it as a solution and see if it works.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 37818,
      "author_name": "João Simões Pedro",
      "author_url": "",
      "post_date": "2014-01-23T18:08:46.927000",
      "content": "<p>No, my files goes from 100018 to 999996.<br><br><br>Check if you can get this file by re-downloading training_solutions_rev1.csv from the data page.</p>\n<p>I will post my file if required</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 37819,
      "author_name": "",
      "author_url": "",
      "post_date": "2014-01-23T18:13:16.733000",
      "content": "",
      "votes": 0,
      "replies": []
    },
    {
      "id": 37815,
      "author_name": "",
      "author_url": "",
      "post_date": "2014-01-23T17:48:51.417000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "37831": "",
    "37828": "",
    "37826": "",
    "37825": "",
    "37824": "",
    "37823": "",
    "37822": "",
    "37820": "",
    "37818": "",
    "37811": "",
    "37819": "",
    "37815": ""
  }
}