{
  "id": 252654,
  "title": "Randomness in Eval?",
  "url": "/competitions/bigdata2021-rl-recsys/discussion/252654",
  "author_name": "",
  "post_date": "2021-07-13T10:11:13.503156200Z",
  "votes": 1,
  "comment_count": 1,
  "views": 0,
  "content": "<p>I have two questions:<br>\n1) Is there any randomness in the evaluation system of Track I or Track II? (e.g. The RL agent used in evaluation)<br>\n2) Is changing items' orders in each bundle (e.g. change '1 2 3, 4 5 6, 7 8 9' to '3 2 1, 5 4 6, 7, 9, 8') affecting the results?</p>",
  "messages": [
    {
      "id": "1386184",
      "postDate": "07/13/2021 10:11:13",
      "content": "<p>I have two questions:<br>\n1) Is there any randomness in the evaluation system of Track I or Track II? (e.g. The RL agent used in evaluation)<br>\n2) Is changing items' orders in each bundle (e.g. change '1 2 3, 4 5 6, 7 8 9' to '3 2 1, 5 4 6, 7, 9, 8') affecting the results?</p>",
      "rawMarkdown": "I have two questions:\n1) Is there any randomness in the evaluation system of Track I or Track II? (e.g. The RL agent used in evaluation)\n2) Is changing items' orders in each bundle (e.g. change '1 2 3, 4 5 6, 7 8 9' to '3 2 1, 5 4 6, 7, 9, 8') affecting the results?",
      "votes": null
    },
    {
      "id": "1387597",
      "postDate": "07/14/2021 09:47:17",
      "content": "<ol>\n<li>No randomness.<br>\n2.Good question. The effect of different items' orders within the same layer is very limited.</li>\n</ol>",
      "rawMarkdown": "1. No randomness.\n2.Good question. The effect of different items' orders within the same layer is very limited.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1387597,
      "author_name": "sword10086",
      "author_url": "",
      "post_date": "07/14/2021 09:47:17",
      "content": "<ol>\n<li>No randomness.<br>\n2.Good question. The effect of different items' orders within the same layer is very limited.</li>\n</ol>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1386184": "I have two questions:\n1) Is there any randomness in the evaluation system of Track I or Track II? (e.g. The RL agent used in evaluation)\n2) Is changing items' orders in each bundle (e.g. change '1 2 3, 4 5 6, 7 8 9' to '3 2 1, 5 4 6, 7, 9, 8') affecting the results?",
    "1387597": "1. No randomness.\n2.Good question. The effect of different items' orders within the same layer is very limited."
  },
  "source": "meta"
}