{ "id": 438112, "title": "Train_events rows that can be dropped", "url": "/competitions/child-mind-institute-detect-sleep-states/discussion/438112", "author_name": "", "post_date": "2023-09-09T15:03:31.648429400Z", "votes": 9, "comment_count": 2, "views": 0, "content": "

I have filtered rows in train_events.csv that have either have onset or wakeup but not both for a particular night. Also there are certain rows with duplicate onset and wakeup event for particular night. All of them are highlighted in yellow.
\n\"\"

\n

If we plan to merge them with the train_series.parquet to evaluate sleep and awake cycles for different series_id, it might be a good idea to drop these rows before merging. I would like to know your opinions.

", "messages": [ { "id": "2430758", "postDate": "09/09/2023 15:03:31", "content": "

I have filtered rows in train_events.csv that have either have onset or wakeup but not both for a particular night. Also there are certain rows with duplicate onset and wakeup event for particular night. All of them are highlighted in yellow.
\n\"\"

\n

If we plan to merge them with the train_series.parquet to evaluate sleep and awake cycles for different series_id, it might be a good idea to drop these rows before merging. I would like to know your opinions.

", "rawMarkdown": "I have filtered rows in train_events.csv that have either have onset or wakeup but not both for a particular night. Also there are certain rows with duplicate onset and wakeup event for particular night. All of them are highlighted in yellow.\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4472205%2Ff85db830897275a229385bee371fe795%2FPicture%201.png?generation=1694271524181863&alt=media)\n\nIf we plan to merge them with the train_series.parquet to evaluate sleep and awake cycles for different series_id, it might be a good idea to drop these rows before merging. I would like to know your opinions.", "votes": null }, { "id": "2430781", "postDate": "09/09/2023 15:15:16", "content": "

@ammarahmadqazi The same thing is being discussed here. Also, in the \"onset\" duplicate case, the \"wakeup\" time may be delayed by an hour. It is better to wait for Kaggle's opinion on this point.

", "rawMarkdown": "ammarahmadqazi The same thing is being discussed [here](https://www.kaggle.com/competitions/child-mind-institute-detect-sleep-states/discussion/437998). Also, in the \"onset\" duplicate case, the \"wakeup\" time may be delayed by an hour. It is better to wait for Kaggle's opinion on this point.", "votes": null }, { "id": "2444714", "postDate": "09/18/2023 12:36:56", "content": "

I've actually covered this in my notebook. CMI | EDA | CHUNKED DS | MEMORY REDUCTION
\n@ammarahmadqazi check it out

", "rawMarkdown": "I've actually covered this in my notebook. [CMI | EDA | CHUNKED DS | MEMORY REDUCTION](https://www.kaggle.com/code/adelinmil/cmi-eda-chunked-ds-memory-reduction)\n@ammarahmadqazi check it out", "votes": null } ], "comments": [ { "id": 2430781, "author_name": "mitsuyasuhoshino", "author_url": "", "post_date": "09/09/2023 15:15:16", "content": "

@ammarahmadqazi The same thing is being discussed here. Also, in the \"onset\" duplicate case, the \"wakeup\" time may be delayed by an hour. It is better to wait for Kaggle's opinion on this point.

", "votes": null, "replies": [] }, { "id": 2444714, "author_name": "adelinmil", "author_url": "", "post_date": "09/18/2023 12:36:56", "content": "

I've actually covered this in my notebook. CMI | EDA | CHUNKED DS | MEMORY REDUCTION
\n@ammarahmadqazi check it out

", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "2430758": "I have filtered rows in train_events.csv that have either have onset or wakeup but not both for a particular night. Also there are certain rows with duplicate onset and wakeup event for particular night. All of them are highlighted in yellow.\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4472205%2Ff85db830897275a229385bee371fe795%2FPicture%201.png?generation=1694271524181863&alt=media)\n\nIf we plan to merge them with the train_series.parquet to evaluate sleep and awake cycles for different series_id, it might be a good idea to drop these rows before merging. I would like to know your opinions.", "2430781": "ammarahmadqazi The same thing is being discussed [here](https://www.kaggle.com/competitions/child-mind-institute-detect-sleep-states/discussion/437998). Also, in the \"onset\" duplicate case, the \"wakeup\" time may be delayed by an hour. It is better to wait for Kaggle's opinion on this point.", "2444714": "I've actually covered this in my notebook. [CMI | EDA | CHUNKED DS | MEMORY REDUCTION](https://www.kaggle.com/code/adelinmil/cmi-eda-chunked-ds-memory-reduction)\n@ammarahmadqazi check it out" }, "source": "meta" }