{
  "id": 451403,
  "title": "Filter non wear device",
  "url": "/competitions/child-mind-institute-detect-sleep-states/discussion/451403",
  "author_name": "",
  "post_date": "2023-10-28T15:16:38.450290Z",
  "votes": 7,
  "comment_count": 1,
  "views": 0,
  "content": "<p>Hi all,</p>\n<p>I have trying to find a filter to remove region that the device is not being used in the series, a lot of articles filter it by rolling standard deviation, i made this <a href=\"https://www.kaggle.com/code/renatoreggiani/zzzs-viz-for-not-wear-events/notebook?scriptVersionId=148354374\" target=\"_blank\">notebook</a> to see that pattern in data, after some test I made a combination of metric the filter this. When the metric is less than 21 i decide to remove this part.</p>\n<p>Series with some null Events:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3081183%2Fd5c41e57674d0750c3a0b9c944c43d57%2FCapturar.JPG?generation=1698506187366053&amp;alt=media\" alt=\"\"> </p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3081183%2Fe243101c19148463ed6a3ff4852de672%2FCapturar.JPG?generation=1698506415699292&amp;alt=media\" alt=\"\"></p>\n<p>Obs: The filter is a bit conservative and does not remove it every time the device is not being used, but it is useful when the device is not used for several days in a row</p>",
  "messages": [
    {
      "id": "2502934",
      "postDate": "10/28/2023 15:16:38",
      "content": "<p>Hi all,</p>\n<p>I have trying to find a filter to remove region that the device is not being used in the series, a lot of articles filter it by rolling standard deviation, i made this <a href=\"https://www.kaggle.com/code/renatoreggiani/zzzs-viz-for-not-wear-events/notebook?scriptVersionId=148354374\" target=\"_blank\">notebook</a> to see that pattern in data, after some test I made a combination of metric the filter this. When the metric is less than 21 i decide to remove this part.</p>\n<p>Series with some null Events:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3081183%2Fd5c41e57674d0750c3a0b9c944c43d57%2FCapturar.JPG?generation=1698506187366053&amp;alt=media\" alt=\"\"> </p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3081183%2Fe243101c19148463ed6a3ff4852de672%2FCapturar.JPG?generation=1698506415699292&amp;alt=media\" alt=\"\"></p>\n<p>Obs: The filter is a bit conservative and does not remove it every time the device is not being used, but it is useful when the device is not used for several days in a row</p>",
      "rawMarkdown": "Hi all,\n\nI have trying to find a filter to remove region that the device is not being used in the series, a lot of articles filter it by rolling standard deviation, i made this [notebook](https://www.kaggle.com/code/renatoreggiani/zzzs-viz-for-not-wear-events/notebook?scriptVersionId=148354374) to see that pattern in data, after some test I made a combination of metric the filter this. When the metric is less than 21 i decide to remove this part.\n\nSeries with some null Events:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3081183%2Fd5c41e57674d0750c3a0b9c944c43d57%2FCapturar.JPG?generation=1698506187366053&alt=media) \n\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3081183%2Fe243101c19148463ed6a3ff4852de672%2FCapturar.JPG?generation=1698506415699292&alt=media)\n\nObs: The filter is a bit conservative and does not remove it every time the device is not being used, but it is useful when the device is not used for several days in a row",
      "votes": null
    },
    {
      "id": "2508317",
      "postDate": "11/01/2023 15:51:10",
      "content": "<p><a href=\"https://www.kaggle.com/renatoreggiani\" target=\"_blank\">@renatoreggiani</a> : thanks for sharing the interesting observations, Renato!</p>",
      "rawMarkdown": "renatoreggiani : thanks for sharing the interesting observations, Renato!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2508317,
      "author_name": "gvyshnya",
      "author_url": "",
      "post_date": "11/01/2023 15:51:10",
      "content": "<p><a href=\"https://www.kaggle.com/renatoreggiani\" target=\"_blank\">@renatoreggiani</a> : thanks for sharing the interesting observations, Renato!</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2502934": "Hi all,\n\nI have trying to find a filter to remove region that the device is not being used in the series, a lot of articles filter it by rolling standard deviation, i made this [notebook](https://www.kaggle.com/code/renatoreggiani/zzzs-viz-for-not-wear-events/notebook?scriptVersionId=148354374) to see that pattern in data, after some test I made a combination of metric the filter this. When the metric is less than 21 i decide to remove this part.\n\nSeries with some null Events:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3081183%2Fd5c41e57674d0750c3a0b9c944c43d57%2FCapturar.JPG?generation=1698506187366053&alt=media) \n\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3081183%2Fe243101c19148463ed6a3ff4852de672%2FCapturar.JPG?generation=1698506415699292&alt=media)\n\nObs: The filter is a bit conservative and does not remove it every time the device is not being used, but it is useful when the device is not used for several days in a row",
    "2508317": "renatoreggiani : thanks for sharing the interesting observations, Renato!"
  },
  "source": "meta"
}