{
  "id": 582417,
  "title": "What is the meaning of \"null\" value on the tof sensor?",
  "url": "/competitions/cmi-detect-behavior-with-sensor-data/discussion/582417",
  "author_name": "chumajin",
  "post_date": "2025-05-31T04:48:32.245000",
  "votes": 12,
  "comment_count": 7,
  "views": 0,
  "content": "<p>The dataset description page states the following:</p>\n<pre><code> there   sensor response (e.g.,  there   nearby  causing a signal reflection), a   present  this field. Units are uncalibrated sensor   the   \n</code></pre>\n<p>However, I have confirmed that the 'tof' sensor values contain not only -1 but also 'null' values.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4001300%2F122c4b000ff4bab91a527bcc5f2bc2c0%2FClipboard_05-31-2025_01.jpg?generation=1748666746905920&amp;alt=media\" alt=\"\"></p>\n<p>(in this case, tof_5 has only null value)</p>\n<p>Based on the following text, should I interpret this as a communication failure?</p>\n<pre><code>Note  that there  known sensor communication failure  this dataset, resulting  missing data   sensors   .\n</code></pre>\n<p>But is \"no sensor response\" the same as the sensor communication failure ?? confused…</p>",
  "messages": [
    {
      "id": 3214185,
      "postDate": "2025-05-31T04:48:32.247Z",
      "content": "<p>The dataset description page states the following:</p>\n<pre><code> there   sensor response (e.g.,  there   nearby  causing a signal reflection), a   present  this field. Units are uncalibrated sensor   the   \n</code></pre>\n<p>However, I have confirmed that the 'tof' sensor values contain not only -1 but also 'null' values.</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4001300%2F122c4b000ff4bab91a527bcc5f2bc2c0%2FClipboard_05-31-2025_01.jpg?generation=1748666746905920&amp;alt=media\" alt=\"\"></p>\n<p>(in this case, tof_5 has only null value)</p>\n<p>Based on the following text, should I interpret this as a communication failure?</p>\n<pre><code>Note  that there  known sensor communication failure  this dataset, resulting  missing data   sensors   .\n</code></pre>\n<p>But is \"no sensor response\" the same as the sensor communication failure ?? confused…</p>",
      "rawMarkdown": "The dataset description page states the following:\n```\nIf there is no sensor response (e.g., if there is no nearby object causing a signal reflection), a -1 is present in this field. Units are uncalibrated sensor values in the range 0-254. \n```\n\nHowever, I have confirmed that the 'tof' sensor values contain not only -1 but also 'null' values.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4001300%2F122c4b000ff4bab91a527bcc5f2bc2c0%2FClipboard_05-31-2025_01.jpg?generation=1748666746905920&alt=media)\n\n(in this case, tof_5 has only null value)\n\nBased on the following text, should I interpret this as a communication failure?\n\n```\nNote also that there is known sensor communication failure in this dataset, resulting in missing data from some sensors in some sequences.\n```\n\nBut is \"no sensor response\" the same as the sensor communication failure ?? confused...",
      "votes": 12
    },
    {
      "id": 3217018,
      "postDate": "2025-06-04T12:22:47.600Z",
      "content": "<p>Value    Meaning<br>\n0–254    Valid sensor reading (range/distance)<br>\n-1    No object detected (sensor is working, but no return signal)<br>\nnull    Communication failure (sensor did not respond at all)</p>",
      "rawMarkdown": "Value\tMeaning\n0–254\tValid sensor reading (range/distance)\n-1\tNo object detected (sensor is working, but no return signal)\nnull\tCommunication failure (sensor did not respond at all)",
      "votes": 5,
      "replies": [
        {
          "id": 3217095,
          "postDate": "2025-06-04T14:21:43.323Z",
          "content": "<p><a href=\"https://www.kaggle.com/jinhuaawang\" target=\"_blank\">@jinhuaawang</a> Thank you for comment ! Good insight.</p>",
          "rawMarkdown": "@jinhuaawang Thank you for comment ! Good insight."
        }
      ]
    },
    {
      "id": 3217321,
      "postDate": "2025-06-04T21:27:30.617Z",
      "content": "<p>I think it's related to that.<br>\n<code>Half of the hidden-test sequences are recorded with IMU only; the thermopile (thm_) and time-of-flight (tof__v*) columns are still present but contain null values for those sequences.</code></p>",
      "rawMarkdown": "I think it's related to that.\n`Half of the hidden-test sequences are recorded with IMU only; the thermopile (thm_) and time-of-flight (tof__v*) columns are still present but contain null values for those sequences.`",
      "votes": 1,
      "replies": [
        {
          "id": 3217444,
          "postDate": "2025-06-05T02:50:27.913Z",
          "content": "<p><a href=\"https://www.kaggle.com/eikyou\" target=\"_blank\">@eikyou</a> Thanks for your comment. That may be true, but I still feel that having just one test dataset—like the training data—should be sufficient.</p>",
          "rawMarkdown": "@eikyou Thanks for your comment. That may be true, but I still feel that having just one test dataset—like the training data—should be sufficient."
        }
      ]
    },
    {
      "id": 3214213,
      "postDate": "2025-05-31T05:50:54.563Z",
      "content": "<p>The details of this dataset are unclear, but there are cases where a ToF sensor returns null when no object is within its measurable range. Therefore, such behavior may be possible.</p>",
      "rawMarkdown": "The details of this dataset are unclear, but there are cases where a ToF sensor returns null when no object is within its measurable range. Therefore, such behavior may be possible.",
      "votes": 1,
      "replies": [
        {
          "id": 3214433,
          "postDate": "2025-05-31T14:22:27.930Z",
          "content": "<p><a href=\"https://www.kaggle.com/kakuteki\" target=\"_blank\">@kakuteki</a> Thanks for commenting! Ah, so that's how it works from a technical standpoint! That's really valuable information – I appreciate it. It helps a lot!</p>",
          "rawMarkdown": "@kakuteki Thanks for commenting! Ah, so that's how it works from a technical standpoint! That's really valuable information – I appreciate it. It helps a lot!",
          "votes": 1
        }
      ]
    },
    {
      "id": 3214212,
      "postDate": "2025-05-31T05:50:23.970Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 3217018,
      "author_name": "",
      "author_url": "",
      "post_date": "2025-06-04T12:22:47.600000",
      "content": "<p>Value    Meaning<br>\n0–254    Valid sensor reading (range/distance)<br>\n-1    No object detected (sensor is working, but no return signal)<br>\nnull    Communication failure (sensor did not respond at all)</p>",
      "votes": 5,
      "replies": [
        {
          "id": 3217095,
          "author_name": "chumajin",
          "author_url": "",
          "post_date": "2025-06-04T14:21:43.323000",
          "content": "<p><a href=\"https://www.kaggle.com/jinhuaawang\" target=\"_blank\">@jinhuaawang</a> Thank you for comment ! Good insight.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 3217321,
      "author_name": "eikyou",
      "author_url": "",
      "post_date": "2025-06-04T21:27:30.617000",
      "content": "<p>I think it's related to that.<br>\n<code>Half of the hidden-test sequences are recorded with IMU only; the thermopile (thm_) and time-of-flight (tof__v*) columns are still present but contain null values for those sequences.</code></p>",
      "votes": 1,
      "replies": [
        {
          "id": 3217444,
          "author_name": "chumajin",
          "author_url": "",
          "post_date": "2025-06-05T02:50:27.913000",
          "content": "<p><a href=\"https://www.kaggle.com/eikyou\" target=\"_blank\">@eikyou</a> Thanks for your comment. That may be true, but I still feel that having just one test dataset—like the training data—should be sufficient.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 3214213,
      "author_name": "kakuteki",
      "author_url": "",
      "post_date": "2025-05-31T05:50:54.563000",
      "content": "<p>The details of this dataset are unclear, but there are cases where a ToF sensor returns null when no object is within its measurable range. Therefore, such behavior may be possible.</p>",
      "votes": 1,
      "replies": [
        {
          "id": 3214433,
          "author_name": "chumajin",
          "author_url": "",
          "post_date": "2025-05-31T14:22:27.930000",
          "content": "<p><a href=\"https://www.kaggle.com/kakuteki\" target=\"_blank\">@kakuteki</a> Thanks for commenting! Ah, so that's how it works from a technical standpoint! That's really valuable information – I appreciate it. It helps a lot!</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 3214212,
      "author_name": "",
      "author_url": "",
      "post_date": "2025-05-31T05:50:23.970000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3214185": "The dataset description page states the following:\n```\nIf there is no sensor response (e.g., if there is no nearby object causing a signal reflection), a -1 is present in this field. Units are uncalibrated sensor values in the range 0-254. \n```\n\nHowever, I have confirmed that the 'tof' sensor values contain not only -1 but also 'null' values.\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F4001300%2F122c4b000ff4bab91a527bcc5f2bc2c0%2FClipboard_05-31-2025_01.jpg?generation=1748666746905920&alt=media)\n\n(in this case, tof_5 has only null value)\n\nBased on the following text, should I interpret this as a communication failure?\n\n```\nNote also that there is known sensor communication failure in this dataset, resulting in missing data from some sensors in some sequences.\n```\n\nBut is \"no sensor response\" the same as the sensor communication failure ?? confused...",
    "3217018": "Value\tMeaning\n0–254\tValid sensor reading (range/distance)\n-1\tNo object detected (sensor is working, but no return signal)\nnull\tCommunication failure (sensor did not respond at all)",
    "3217321": "I think it's related to that.\n`Half of the hidden-test sequences are recorded with IMU only; the thermopile (thm_) and time-of-flight (tof__v*) columns are still present but contain null values for those sequences.`",
    "3214213": "The details of this dataset are unclear, but there are cases where a ToF sensor returns null when no object is within its measurable range. Therefore, such behavior may be possible.",
    "3214212": ""
  }
}