![\"problems\"](\"https://postfiles.pstatic.net/MjAxODEwMTdfMjQg/MDAxNTM5NzAyNTY1MTI4.0q-z_U-X7jKpn5cxpiGn7bz-eF5-ItFzR8Mgy5chfb0g.yJ9pYDvqZ6ArcDghtqXW4Ew_0eeAwcVjFlFEmQjCALMg.PNG.dake123/load_problem.png?type=w580\")
when I use \"read.csv(\"train.csv\")\" function in R,
\n\nfullVisitorId value is not matched with original value.
\n\nex) fullVisitorId(origina) ≠ fullVisitorId(loaded by read.csv)
\n\nI know this problem can be solved by dtype={'fullVisitorId': 'str'} with Python
\n\nBut I want to handle this problem through R
\n\nDoes anyone know the solution of this ?
\n\n
when I use \"read.csv(\"train.csv\")\" function in R,
\n\nfullVisitorId value is not matched with original value.
\n\nex) fullVisitorId(origina) ≠ fullVisitorId(loaded by read.csv)
\n\nI know this problem can be solved by dtype={'fullVisitorId': 'str'} with Python
\n\nBut I want to handle this problem through R
\n\nDoes anyone know the solution of this ?
\n\n
Please look at the kernels and select R as a language - this should get you started - plus you will get the bonus of handling 'json' in an r fashion
", "rawMarkdown": "Please look at the kernels and select R as a language - this should get you started - plus you will get the bonus of handling 'json' in an r fashion", "votes": null }, { "id": "404894", "postDate": "10/16/2018 14:29:08", "content": "When you're dealing with importing DataFrames into R through CSV, columns with string data take the atomic data type 'factor', not of type 'character' (the R version of strings). 'factor' objects are supposed to be categorical whereas 'character' objects are free-form, they are not equivalent objects. In your call to read.csv() you should pass stringsAsFactors=FALSE
Thank you for reply, but What I really mean is that\nthe loaded fullVisitorId value is not mached with original fullVisitorId value.\nI uploaded what the problem is.
", "rawMarkdown": "Thank you for reply, but What I really mean is that\nthe loaded fullVisitorId value is not mached with original fullVisitorId value.\nI uploaded what the problem is.\n\n\n [1]: https://postfiles.pstatic.net/MjAxODEwMTZfMTg3/MDAxNTM5NzAxMzAzMjUz.wc13kD00N6BU2jYPFF0htv5R7WniyLdV3hLgmluvKMkg.lISNdcBcrTAqwL7aKbx1_qlSF9yVEy0dNnEmoTec02wg.PNG.dake123/load_problem.png?type=w580", "votes": null }, { "id": "404910", "postDate": "10/16/2018 14:53:47", "content": "Thank you, but I didn't use stringAsFactors .\nI uploaded the picture of problem. could you check this?
", "rawMarkdown": "Thank you, but I didn't use stringAsFactors .\nI uploaded the picture of problem. could you check this?", "votes": null }, { "id": "404931", "postDate": "10/16/2018 15:41:01", "content": "options(stringsAsFactors= FALSE)
", "rawMarkdown": "## options - to prevent some unwanted side effects\noptions(stringsAsFactors= FALSE)", "votes": null }, { "id": "404939", "postDate": "10/16/2018 15:58:58", "content": "thanks for reply... but fullVisitorId is a numeric by nature... so the option \"stingsAsFactors=F\" is not make difference ..... I tried options(stingsAsFactors=FALSE and read.csv(\"train.csv\",stingsAsFactors=F)). But it is no use...
\n\nsome people suffer from this issue.... but I don't know why this occurs
", "rawMarkdown": "thanks for reply... but fullVisitorId is a numeric by nature... so the option \"stingsAsFactors=F\" is not make difference ..... I tried options(stingsAsFactors=FALSE and read.csv(\"train.csv\",stingsAsFactors=F)). But it is no use...\n\nsome people suffer from this issue.... but I don't know why this occurs", "votes": null }, { "id": "404947", "postDate": "10/16/2018 16:18:42", "content": "No it isn't. Consider the ids 012 and 0012:\n012 => 12\n0012 => 12\nYou don't want to automatically use numbers because you will slice off the zeros! ;)
", "rawMarkdown": "No it isn't. Consider the ids 012 and 0012:\n012 => 12\n0012 => 12\nYou don't want to automatically use numbers because you will slice off the zeros! ;)", "votes": null }, { "id": "404951", "postDate": "10/16/2018 16:28:39", "content": "sorry..... I don't understand what you mean.... cause I am not good at english...
\n\nI changed my code like this read.csv(\"train.csv\",stringsAsFactors=F)
\n\nthe same problem occurs....
\n\nI am so sorry for bothering you....
", "rawMarkdown": "sorry..... I don't understand what you mean.... cause I am not good at english... \n\nI changed my code like this read.csv(\"train.csv\",stringsAsFactors=F) \n\nthe same problem occurs....\n\nI am so sorry for bothering you....", "votes": null }, { "id": "404953", "postDate": "10/16/2018 16:34:19", "content": "Look at https://www.kaggle.com/captcalculator/a-very-extensive-gstore-exploratory-analysis\nNote that fullVisitorId is chr\nThis is why I asked you to look at existing R kernels
\n\n000001 as a number is 1\n00001 as a number is 1\nAs strings these ids will not be the same
", "rawMarkdown": "Look at https://www.kaggle.com/captcalculator/a-very-extensive-gstore-exploratory-analysis\nNote that fullVisitorId is chr\nThis is why I asked you to look at existing R kernels\n\n 000001 as a number is 1\n 00001 as a number is 1\n\nAs strings these ids will not be the same", "votes": null }, { "id": "404966", "postDate": "10/16/2018 16:58:28", "content": "Do you want to explain \"00001\"(string) ≠ 00001(number) ?
\n\nI know they are different....
\n\nMy problem is when I use read.csv to load train.csv,
\n\nthe first fullVisitorId value(=1131660440785960000) is transfered to \n1131660440785968512 .....
that R kernels user use the same function read.csv(\"../train.csv\") like me,
\n\nbut the user's first fullVisitorId value is mached with original data....
\n\n(though the type is character)
", "rawMarkdown": "Do you want to explain \"00001\"(string) ≠ 00001(number) ? \n\nI know they are different....\n\nMy problem is when I use read.csv to load train.csv, \n\nthe first fullVisitorId value(=1131660440785960000) is transfered to \n1131660440785968512 ..... ![problem][1]\n\n\nthat R kernels user use the same function read.csv(\"../train.csv\") like me,\n\nbut the user's first fullVisitorId value is mached with original data....\n\n(though the type is character) \n\n\n [1]: https://postfiles.pstatic.net/MjAxODEwMTdfMjQg/MDAxNTM5NzAyNTY1MTI4.0q-z_U-X7jKpn5cxpiGn7bz-eF5-ItFzR8Mgy5chfb0g.yJ9pYDvqZ6ArcDghtqXW4Ew_0eeAwcVjFlFEmQjCALMg.PNG.dake123/load_problem.png?type=w580", "votes": null }, { "id": "404967", "postDate": "10/16/2018 17:08:18", "content": "With the deepest respect are you a troll?
", "rawMarkdown": "With the deepest respect are you a troll?", "votes": null }, { "id": "404969", "postDate": "10/16/2018 17:11:44", "content": "The first fullVisitorId is not \"value(=1131660440785960000)\" and also not \"1131660440785968512 ..... problem\".
\n\nThe first fullVisitorId is 1131660440785968503.
\n\nThe suggestions from Scirpus to look at kernels with Language R is good and can be supportive ..., most use read_csv and then work on the json part.
", "rawMarkdown": "The first fullVisitorId is not \"value(=1131660440785960000)\" and also not \"1131660440785968512 ..... problem\".\n\nThe first fullVisitorId is 1131660440785968503.\n\nThe suggestions from Scirpus to look at kernels with Language R is good and can be supportive ..., most use read_csv and then work on the json part.", "votes": null }, { "id": "404971", "postDate": "10/16/2018 17:13:26", "content": "sorry... I really don't understand.....
\n\nI solved that problem with function read_csv from your R kernel link....
\n\nthanks for help
", "rawMarkdown": "sorry... I really don't understand.....\n\nI solved that problem with function read_csv from your R kernel link....\n\nthanks for help", "votes": null }, { "id": "404977", "postDate": "10/16/2018 17:24:33", "content": "Thank goodness for that.
\n\nGood luck in the competition.
", "rawMarkdown": "Thank goodness for that.\n\nGood luck in the competition.", "votes": null }, { "id": "404980", "postDate": "10/16/2018 17:29:59", "content": "Thanks :) , I didn't catch the difference of \"read.csv\" and \"read_csv\" because I am newbie ...
", "rawMarkdown": "Thanks :) , I didn't catch the difference of \"read.csv\" and \"read_csv\" because I am newbie ...", "votes": null }, { "id": "404988", "postDate": "10/16/2018 17:45:41", "content": "Using data.table's \"fread\", this is from my notebook:
\n\n Classes<- sapply(fread(\"...train.csv\"),class)\n Classes[\"fullVisitorId\"]<-\"character\"\n Data<-fread(\"...train.csv\",colClasses = Classes)\nthanks for giving me new solution!\nDo you know why read.csv function have problems?\nread_csv and fread are works , but read.csv have problem...
", "rawMarkdown": "thanks for giving me new solution!\nDo you know why read.csv function have problems?\nread_csv and fread are works , but read.csv have problem...", "votes": null }, { "id": "406237", "postDate": "10/18/2018 22:48:26", "content": "I think the link to the picture is broken because I can't get to it. stringAsFactors is set by default to TRUE, even if you don't include it in your code, you need to explicitly turn it off, but by the looks of this discussion, your problem was solved :)
", "rawMarkdown": "I think the link to the picture is broken because I can't get to it. stringAsFactors is set by default to TRUE, even if you don't include it in your code, you need to explicitly turn it off, but by the looks of this discussion, your problem was solved :)", "votes": null }, { "id": "406258", "postDate": "10/19/2018 00:14:25", "content": "thanks ! I solved my problem with read_csv function!
", "rawMarkdown": "thanks ! I solved my problem with read_csv function!", "votes": null }, { "id": "406637", "postDate": "10/19/2018 14:59:28", "content": "data <- read.csv('../input/train.csv', colClasses=c(fullVisitorId=\"character\"))
You need to specify to read fullVisitorId as a string in read.csv ... i believe both read_csv and fread can accomplish this without you specifying though
Yes! I found that options important when loading fullVisitorId !!! \nthanks for reply
", "rawMarkdown": "Yes! I found that options important when loading fullVisitorId !!! \nthanks for reply", "votes": null } ], "comments": [ { "id": 404891, "author_name": "scirpus", "author_url": "", "post_date": "10/16/2018 14:19:30", "content": "Please look at the kernels and select R as a language - this should get you started - plus you will get the bonus of handling 'json' in an r fashion
", "votes": null, "replies": [ { "id": 404906, "author_name": "jimeng314", "author_url": "", "post_date": "10/16/2018 14:49:46", "content": "Thank you for reply, but What I really mean is that\nthe loaded fullVisitorId value is not mached with original fullVisitorId value.\nI uploaded what the problem is.
", "votes": null, "replies": [] } ] }, { "id": 404894, "author_name": "alecthekulak", "author_url": "", "post_date": "10/16/2018 14:29:08", "content": "When you're dealing with importing DataFrames into R through CSV, columns with string data take the atomic data type 'factor', not of type 'character' (the R version of strings). 'factor' objects are supposed to be categorical whereas 'character' objects are free-form, they are not equivalent objects. In your call to read.csv() you should pass stringsAsFactors=FALSE
Thank you, but I didn't use stringAsFactors .\nI uploaded the picture of problem. could you check this?
", "votes": null, "replies": [] }, { "id": 406237, "author_name": "alecthekulak", "author_url": "", "post_date": "10/18/2018 22:48:26", "content": "I think the link to the picture is broken because I can't get to it. stringAsFactors is set by default to TRUE, even if you don't include it in your code, you need to explicitly turn it off, but by the looks of this discussion, your problem was solved :)
", "votes": null, "replies": [] }, { "id": 406258, "author_name": "jimeng314", "author_url": "", "post_date": "10/19/2018 00:14:25", "content": "thanks ! I solved my problem with read_csv function!
", "votes": null, "replies": [] } ] }, { "id": 404931, "author_name": "justfor", "author_url": "", "post_date": "10/16/2018 15:41:01", "content": "options(stringsAsFactors= FALSE)
", "votes": null, "replies": [ { "id": 404939, "author_name": "jimeng314", "author_url": "", "post_date": "10/16/2018 15:58:58", "content": "thanks for reply... but fullVisitorId is a numeric by nature... so the option \"stingsAsFactors=F\" is not make difference ..... I tried options(stingsAsFactors=FALSE and read.csv(\"train.csv\",stingsAsFactors=F)). But it is no use...
\n\nsome people suffer from this issue.... but I don't know why this occurs
", "votes": null, "replies": [] }, { "id": 404947, "author_name": "scirpus", "author_url": "", "post_date": "10/16/2018 16:18:42", "content": "No it isn't. Consider the ids 012 and 0012:\n012 => 12\n0012 => 12\nYou don't want to automatically use numbers because you will slice off the zeros! ;)
", "votes": null, "replies": [] }, { "id": 404951, "author_name": "jimeng314", "author_url": "", "post_date": "10/16/2018 16:28:39", "content": "sorry..... I don't understand what you mean.... cause I am not good at english...
\n\nI changed my code like this read.csv(\"train.csv\",stringsAsFactors=F)
\n\nthe same problem occurs....
\n\nI am so sorry for bothering you....
", "votes": null, "replies": [] }, { "id": 404953, "author_name": "scirpus", "author_url": "", "post_date": "10/16/2018 16:34:19", "content": "Look at https://www.kaggle.com/captcalculator/a-very-extensive-gstore-exploratory-analysis\nNote that fullVisitorId is chr\nThis is why I asked you to look at existing R kernels
\n\n000001 as a number is 1\n00001 as a number is 1\nAs strings these ids will not be the same
", "votes": null, "replies": [] }, { "id": 404966, "author_name": "jimeng314", "author_url": "", "post_date": "10/16/2018 16:58:28", "content": "Do you want to explain \"00001\"(string) ≠ 00001(number) ?
\n\nI know they are different....
\n\nMy problem is when I use read.csv to load train.csv,
\n\nthe first fullVisitorId value(=1131660440785960000) is transfered to \n1131660440785968512 .....
that R kernels user use the same function read.csv(\"../train.csv\") like me,
\n\nbut the user's first fullVisitorId value is mached with original data....
\n\n(though the type is character)
", "votes": null, "replies": [] }, { "id": 404967, "author_name": "scirpus", "author_url": "", "post_date": "10/16/2018 17:08:18", "content": "With the deepest respect are you a troll?
", "votes": null, "replies": [] }, { "id": 404971, "author_name": "jimeng314", "author_url": "", "post_date": "10/16/2018 17:13:26", "content": "sorry... I really don't understand.....
\n\nI solved that problem with function read_csv from your R kernel link....
\n\nthanks for help
", "votes": null, "replies": [] }, { "id": 404977, "author_name": "scirpus", "author_url": "", "post_date": "10/16/2018 17:24:33", "content": "Thank goodness for that.
\n\nGood luck in the competition.
", "votes": null, "replies": [] } ] }, { "id": 404969, "author_name": "justfor", "author_url": "", "post_date": "10/16/2018 17:11:44", "content": "The first fullVisitorId is not \"value(=1131660440785960000)\" and also not \"1131660440785968512 ..... problem\".
\n\nThe first fullVisitorId is 1131660440785968503.
\n\nThe suggestions from Scirpus to look at kernels with Language R is good and can be supportive ..., most use read_csv and then work on the json part.
", "votes": null, "replies": [ { "id": 404980, "author_name": "jimeng314", "author_url": "", "post_date": "10/16/2018 17:29:59", "content": "Thanks :) , I didn't catch the difference of \"read.csv\" and \"read_csv\" because I am newbie ...
", "votes": null, "replies": [] } ] }, { "id": 404988, "author_name": "tpthegreat", "author_url": "", "post_date": "10/16/2018 17:45:41", "content": "Using data.table's \"fread\", this is from my notebook:
\n\n Classes<- sapply(fread(\"...train.csv\"),class)\n Classes[\"fullVisitorId\"]<-\"character\"\n Data<-fread(\"...train.csv\",colClasses = Classes)\nthanks for giving me new solution!\nDo you know why read.csv function have problems?\nread_csv and fread are works , but read.csv have problem...
", "votes": null, "replies": [] }, { "id": 406637, "author_name": "returnofsputnik", "author_url": "", "post_date": "10/19/2018 14:59:28", "content": "data <- read.csv('../input/train.csv', colClasses=c(fullVisitorId=\"character\"))
You need to specify to read fullVisitorId as a string in read.csv ... i believe both read_csv and fread can accomplish this without you specifying though
Yes! I found that options important when loading fullVisitorId !!! \nthanks for reply
", "votes": null, "replies": [] } ] } ], "raw_markdown_by_id": { "404866": "when I use \"read.csv(\"train.csv\")\" function in R, \n\nfullVisitorId value is not matched with original value.\n\nex) fullVisitorId(origina) ≠ fullVisitorId(loaded by read.csv) \n\nI know this problem can be solved by dtype={'fullVisitorId': 'str'} with Python\n\nBut I want to handle this problem through R\n\nDoes anyone know the solution of this ?\n\n![problems][1]\n\n\n [1]: https://postfiles.pstatic.net/MjAxODEwMTdfMjQg/MDAxNTM5NzAyNTY1MTI4.0q-z_U-X7jKpn5cxpiGn7bz-eF5-ItFzR8Mgy5chfb0g.yJ9pYDvqZ6ArcDghtqXW4Ew_0eeAwcVjFlFEmQjCALMg.PNG.dake123/load_problem.png?type=w580", "404891": "Please look at the kernels and select R as a language - this should get you started - plus you will get the bonus of handling 'json' in an r fashion", "404894": "When you're dealing with importing DataFrames into R through CSV, columns with string data take the atomic data type 'factor', not of type 'character' (the R version of strings). 'factor' objects are supposed to be categorical whereas 'character' objects are free-form, they are not equivalent objects. In your call to read.csv() you should pass `stringsAsFactors=FALSE`", "404906": "Thank you for reply, but What I really mean is that\nthe loaded fullVisitorId value is not mached with original fullVisitorId value.\nI uploaded what the problem is.\n\n\n [1]: https://postfiles.pstatic.net/MjAxODEwMTZfMTg3/MDAxNTM5NzAxMzAzMjUz.wc13kD00N6BU2jYPFF0htv5R7WniyLdV3hLgmluvKMkg.lISNdcBcrTAqwL7aKbx1_qlSF9yVEy0dNnEmoTec02wg.PNG.dake123/load_problem.png?type=w580", "404910": "Thank you, but I didn't use stringAsFactors .\nI uploaded the picture of problem. could you check this?", "404931": "## options - to prevent some unwanted side effects\noptions(stringsAsFactors= FALSE)", "404939": "thanks for reply... but fullVisitorId is a numeric by nature... so the option \"stingsAsFactors=F\" is not make difference ..... I tried options(stingsAsFactors=FALSE and read.csv(\"train.csv\",stingsAsFactors=F)). But it is no use...\n\nsome people suffer from this issue.... but I don't know why this occurs", "404947": "No it isn't. Consider the ids 012 and 0012:\n012 => 12\n0012 => 12\nYou don't want to automatically use numbers because you will slice off the zeros! ;)", "404951": "sorry..... I don't understand what you mean.... cause I am not good at english... \n\nI changed my code like this read.csv(\"train.csv\",stringsAsFactors=F) \n\nthe same problem occurs....\n\nI am so sorry for bothering you....", "404953": "Look at https://www.kaggle.com/captcalculator/a-very-extensive-gstore-exploratory-analysis\nNote that fullVisitorId is chr\nThis is why I asked you to look at existing R kernels\n\n 000001 as a number is 1\n 00001 as a number is 1\n\nAs strings these ids will not be the same", "404966": "Do you want to explain \"00001\"(string) ≠ 00001(number) ? \n\nI know they are different....\n\nMy problem is when I use read.csv to load train.csv, \n\nthe first fullVisitorId value(=1131660440785960000) is transfered to \n1131660440785968512 ..... ![problem][1]\n\n\nthat R kernels user use the same function read.csv(\"../train.csv\") like me,\n\nbut the user's first fullVisitorId value is mached with original data....\n\n(though the type is character) \n\n\n [1]: https://postfiles.pstatic.net/MjAxODEwMTdfMjQg/MDAxNTM5NzAyNTY1MTI4.0q-z_U-X7jKpn5cxpiGn7bz-eF5-ItFzR8Mgy5chfb0g.yJ9pYDvqZ6ArcDghtqXW4Ew_0eeAwcVjFlFEmQjCALMg.PNG.dake123/load_problem.png?type=w580", "404967": "With the deepest respect are you a troll?", "404969": "The first fullVisitorId is not \"value(=1131660440785960000)\" and also not \"1131660440785968512 ..... problem\".\n\nThe first fullVisitorId is 1131660440785968503.\n\nThe suggestions from Scirpus to look at kernels with Language R is good and can be supportive ..., most use read_csv and then work on the json part.", "404971": "sorry... I really don't understand.....\n\nI solved that problem with function read_csv from your R kernel link....\n\nthanks for help", "404977": "Thank goodness for that.\n\nGood luck in the competition.", "404980": "Thanks :) , I didn't catch the difference of \"read.csv\" and \"read_csv\" because I am newbie ...", "404988": "Using data.table's \"fread\", this is from my notebook:\n\n Classes<- sapply(fread(\"...train.csv\"),class)\n Classes[\"fullVisitorId\"]<-\"character\"\n Data<-fread(\"...train.csv\",colClasses = Classes)", "404996": "thanks for giving me new solution!\nDo you know why read.csv function have problems?\nread_csv and fread are works , but read.csv have problem...", "406237": "I think the link to the picture is broken because I can't get to it. stringAsFactors is set by default to TRUE, even if you don't include it in your code, you need to explicitly turn it off, but by the looks of this discussion, your problem was solved :)", "406258": "thanks ! I solved my problem with read_csv function!", "406637": "`data <- read.csv('../input/train.csv', colClasses=c(fullVisitorId=\"character\"))`\n\nYou need to specify to read fullVisitorId as a string in read.csv ... i believe both `read_csv` and `fread` can accomplish this without you specifying though", "407119": "Yes! I found that options important when loading fullVisitorId !!! \nthanks for reply" }, "source": "meta" }