{ "id": 118047, "title": "Is that fair?", "url": "/competitions/ashrae-energy-prediction/discussion/118047", "author_name": "Bertrand P", "post_date": "2019-11-19T11:15:24.210000", "votes": 32, "comment_count": 10, "views": 0, "content": "

What is fairness? There seems to be no consensus.\nTo my eyes, fairness is a human concept. It does not exist without human beings. And as it is does not exist by itself, there is not only one definition.\nI have to share the ASU data that I have scraped to be inline with my own definition of fairness:\n- https://www.kaggle.com/pdnartreb/asu-buildings-energy-consumption,\n- https://www.kaggle.com/pdnartreb/scrap-asu-data.

\n\n

Thanks to @gunesevitan, @mpware, @poedator to have shown the right way.

", "messages": [ { "id": 676624, "postDate": "2019-11-19T11:15:24.210Z", "content": "

What is fairness? There seems to be no consensus.\nTo my eyes, fairness is a human concept. It does not exist without human beings. And as it is does not exist by itself, there is not only one definition.\nI have to share the ASU data that I have scraped to be inline with my own definition of fairness:\n- https://www.kaggle.com/pdnartreb/asu-buildings-energy-consumption,\n- https://www.kaggle.com/pdnartreb/scrap-asu-data.

\n\n

Thanks to @gunesevitan, @mpware, @poedator to have shown the right way.

", "rawMarkdown": "What is fairness? There seems to be no consensus.\nTo my eyes, fairness is a human concept. It does not exist without human beings. And as it is does not exist by itself, there is not only one definition.\nI have to share the ASU data that I have scraped to be inline with my own definition of fairness:\n- https://www.kaggle.com/pdnartreb/asu-buildings-energy-consumption,\n- https://www.kaggle.com/pdnartreb/scrap-asu-data.\n\nThanks to @gunesevitan, @mpware, @poedator to have shown the right way.", "votes": 32 }, { "id": 677282, "postDate": "2019-11-20T01:45:56.817Z", "content": "

Thank you very much for sharing, as well as for your considerations about the meaning of fairness. I believe that many people (including me) who participated in this competition to improve their skills and enhance knowledge are glad to know that despite the fact that we all competing with each other, there is a great feeling of mutual help, respect and support.

", "rawMarkdown": "Thank you very much for sharing, as well as for your considerations about the meaning of fairness. I believe that many people (including me) who participated in this competition to improve their skills and enhance knowledge are glad to know that despite the fact that we all competing with each other, there is a great feeling of mutual help, respect and support.", "votes": 3 }, { "id": 676923, "postDate": "2019-11-19T16:02:46.230Z", "content": "

Thank you for your sharing. I verified your data. It can improve the public LB about 0.05 (1.03 -> 0.98).\nSo there are three sites(0, 1, 2) have been found and opened. I wonder to know which is the next.

", "rawMarkdown": "Thank you for your sharing. I verified your data. It can improve the public LB about 0.05 (1.03 -> 0.98).\nSo there are three sites(0, 1, 2) have been found and opened. I wonder to know which is the next.", "votes": 3, "replies": [ { "id": 676984, "postDate": "2019-11-19T17:25:47.093Z", "content": "

To be complete, building_id 245 is missing.\nHopefully this is the last leak and we can now focused on ML...

", "rawMarkdown": "To be complete, building_id 245 is missing.\nHopefully this is the last leak and we can now focused on ML...", "votes": 1 } ] }, { "id": 676860, "postDate": "2019-11-19T14:56:38.850Z", "content": "

excellent job.\nBtw, in order to learn something new in this competition, can you please disclose the code (tricks) to download the data ?

", "rawMarkdown": "excellent job.\nBtw, in order to learn something new in this competition, can you please disclose the code (tricks) to download the data ?", "votes": 3, "replies": [ { "id": 676914, "postDate": "2019-11-19T15:46:23.003Z", "rawMarkdown": "", "isDeleted": true }, { "id": 677411, "postDate": "2019-11-20T05:38:45.633Z", "content": "

It is a very simple spider.

\n\n", "rawMarkdown": "It is a very simple spider.\n\n* First, you find your session cookie from request headers in Chrome. It looks like this. You use it in the headers while sending requests to next urls.\n`Cookie: __cfduid=d148f1f668892c657356c1b09cdd123171572891266; DG5SESSION=96B48C7EE436665D2277CACD5283BFAA`\n* Second, you find the ajax call which returns the building ids and store the building_ids in memory.\n`http://cm.asu.edu/dgdb?db=VES&query=%5Bcm%5D.%5Bdbo%5D.%5BpCM_Select_Building_List_By_Campus%5D+%40selCampus+%3D+%22Tempe%22%2C+%40selOrderBy%3D%22bldgname%22%2C+%40selAscDesc%3D%22ASC%22%3B`\n* Finally, fetch the building meter readings from this url.\n`'http://cm.asu.edu/dgdb?db=VES&query=%5Bcm%5D.%5Bdbo%5D.%5BpCM_Retrieve_Utility_Data_By_Campus_Building%5D+%40selCampus+%3D+%22Tempe%22%2C+%40selBldg+%3D+%22{}%22%2C%40selPeriod+%3D+%22Custom+Dates%22%2C%40selInterval+%3D+%22Hourly%22%2C%40selBeginDate+%3D+%222016-01-01%22%2C%40selEndDate+%3D+%222018-12-31%22%3B'.format(building_id)`", "votes": 1 }, { "id": 677634, "postDate": "2019-11-20T12:34:33.967Z", "content": "

@chabir I have updated the kernel (https://www.kaggle.com/pdnartreb/scrap-asu-data) to show how I did the scraping. It took (probably too much) time to me so I hope you will learn something!

", "rawMarkdown": "@chabir I have updated the kernel (https://www.kaggle.com/pdnartreb/scrap-asu-data) to show how I did the scraping. It took (probably too much) time to me so I hope you will learn something!", "votes": 2 }, { "id": 677736, "postDate": "2019-11-20T14:34:34.240Z", "content": "

merci beaucoup ! I learnt something !

", "rawMarkdown": "merci beaucoup ! I learnt something !", "votes": 1 } ] }, { "id": 677157, "postDate": "2019-11-19T21:33:13.037Z", "content": "

Thank you for your sharing. You have done great work !!\nI will make new highway kernel soon

", "rawMarkdown": "Thank you for your sharing. You have done great work !!\nI will make new highway kernel soon", "votes": 1 }, { "id": 678464, "postDate": "2019-11-21T12:31:59.223Z", "rawMarkdown": "", "isDeleted": true } ], "comments": [ { "id": 677282, "author_name": "Stanislav Lykov", "author_url": "", "post_date": "2019-11-20T01:45:56.817000", "content": "

Thank you very much for sharing, as well as for your considerations about the meaning of fairness. I believe that many people (including me) who participated in this competition to improve their skills and enhance knowledge are glad to know that despite the fact that we all competing with each other, there is a great feeling of mutual help, respect and support.

", "votes": 3, "replies": [] }, { "id": 676923, "author_name": "Johnny Lee", "author_url": "", "post_date": "2019-11-19T16:02:46.230000", "content": "

Thank you for your sharing. I verified your data. It can improve the public LB about 0.05 (1.03 -> 0.98).\nSo there are three sites(0, 1, 2) have been found and opened. I wonder to know which is the next.

", "votes": 3, "replies": [ { "id": 676984, "author_name": "Bertrand P", "author_url": "", "post_date": "2019-11-19T17:25:47.093000", "content": "

To be complete, building_id 245 is missing.\nHopefully this is the last leak and we can now focused on ML...

", "votes": 1, "replies": [] } ] }, { "id": 676860, "author_name": "eagle4", "author_url": "", "post_date": "2019-11-19T14:56:38.850000", "content": "

excellent job.\nBtw, in order to learn something new in this competition, can you please disclose the code (tricks) to download the data ?

", "votes": 3, "replies": [ { "id": 676914, "author_name": "", "author_url": "", "post_date": "2019-11-19T15:46:23.003000", "content": "", "votes": 0, "replies": [] }, { "id": 677411, "author_name": "Gunes Evitan", "author_url": "", "post_date": "2019-11-20T05:38:45.633000", "content": "

It is a very simple spider.

\n\n", "votes": 1, "replies": [] }, { "id": 677634, "author_name": "Bertrand P", "author_url": "", "post_date": "2019-11-20T12:34:33.967000", "content": "

@chabir I have updated the kernel (https://www.kaggle.com/pdnartreb/scrap-asu-data) to show how I did the scraping. It took (probably too much) time to me so I hope you will learn something!

", "votes": 2, "replies": [] }, { "id": 677736, "author_name": "eagle4", "author_url": "", "post_date": "2019-11-20T14:34:34.240000", "content": "

merci beaucoup ! I learnt something !

", "votes": 1, "replies": [] } ] }, { "id": 677157, "author_name": "Isamu", "author_url": "", "post_date": "2019-11-19T21:33:13.037000", "content": "

Thank you for your sharing. You have done great work !!\nI will make new highway kernel soon

", "votes": 1, "replies": [] }, { "id": 678464, "author_name": "", "author_url": "", "post_date": "2019-11-21T12:31:59.223000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "676624": "What is fairness? There seems to be no consensus.\nTo my eyes, fairness is a human concept. It does not exist without human beings. And as it is does not exist by itself, there is not only one definition.\nI have to share the ASU data that I have scraped to be inline with my own definition of fairness:\n- https://www.kaggle.com/pdnartreb/asu-buildings-energy-consumption,\n- https://www.kaggle.com/pdnartreb/scrap-asu-data.\n\nThanks to @gunesevitan, @mpware, @poedator to have shown the right way.", "677282": "Thank you very much for sharing, as well as for your considerations about the meaning of fairness. I believe that many people (including me) who participated in this competition to improve their skills and enhance knowledge are glad to know that despite the fact that we all competing with each other, there is a great feeling of mutual help, respect and support.", "676923": "Thank you for your sharing. I verified your data. It can improve the public LB about 0.05 (1.03 -> 0.98).\nSo there are three sites(0, 1, 2) have been found and opened. I wonder to know which is the next.", "676860": "excellent job.\nBtw, in order to learn something new in this competition, can you please disclose the code (tricks) to download the data ?", "677157": "Thank you for your sharing. You have done great work !!\nI will make new highway kernel soon", "678464": "" } }