{ "id": 7493, "title": "Anyone using CNN?", "url": "/competitions/galaxy-zoo-the-galaxy-challenge/discussion/7493", "author_name": "ChenglongChen", "post_date": "2014-03-22T17:34:39.097000", "votes": 1, "comment_count": 7, "views": 2029, "content": "

Hi all,

\n

I have been studying DL the past few months. I entered this comp to practice some of the ideas. I implemented a CNN using theano for this comp. About 90% randomly sampled images from the whole image set are used for training and the rest as a validation set. The best RMSE I got on the validation set is around 0.11, which gives my current LB score. Has anyone else been using CNN? What is your validation set RMSE if you feel like sharing? I wonder if I can push 0.11 down to 0.10 or even 0.09 using CNN...

\n

Yr

", "messages": [ { "id": 40843, "postDate": "2014-03-22T17:34:39.097Z", "content": "

Hi all,

\n

I have been studying DL the past few months. I entered this comp to practice some of the ideas. I implemented a CNN using theano for this comp. About 90% randomly sampled images from the whole image set are used for training and the rest as a validation set. The best RMSE I got on the validation set is around 0.11, which gives my current LB score. Has anyone else been using CNN? What is your validation set RMSE if you feel like sharing? I wonder if I can push 0.11 down to 0.10 or even 0.09 using CNN...

\n

Yr

", "votes": 1 }, { "id": 1260984, "postDate": "2021-04-02T15:23:59.760Z", "content": "

Great foresight!

", "rawMarkdown": "Great foresight!" }, { "id": 40881, "postDate": "2014-03-23T04:28:20.847Z", "content": "

[quote=Wayne Zhang;40876]

\n

I used a large set of handcrafted features.

\n

In the past month, I tried my home-brew CNN but found out it was impossible to scale up to get any competitive result without a GPU.

\n

The discussion forum here and in previous competitions like face expression and dog cat may give you some hints.

\n

[/quote]

\n

Thanks. I will spend some time reading those comps.

\n

Yr

" }, { "id": 40876, "postDate": "2014-03-23T03:49:11.357Z", "content": "

I used a large set of handcrafted features.

\n

In the past month, I tried my home-brew CNN but found out it was impossible to scale up to get any competitive result without a GPU.

\n

The discussion forum here and in previous competitions like face expression and dog cat may give you some hints.

" }, { "id": 40872, "postDate": "2014-03-23T03:27:24.113Z", "content": "

[quote=Wayne Zhang;40862]

\n

You can reduce your error to 0.07735 if you try hard.

\n

[/quote]

\n

Is that the current leader's score on the public LB (LOL)? That you mean the leader is also using CNN? I am newbie to DL and currently get panic by so many hyper-params to be tuned. Do you have any tips links to some references on that topic? I'd be happy if I can reduce the error to 0.09.

\n

Yr

" }, { "id": 40862, "postDate": "2014-03-23T01:29:34.783Z", "content": "

You can reduce your error to 0.07735 if you try hard.

" }, { "id": 1260980, "postDate": "2021-04-02T15:22:48.227Z", "rawMarkdown": "", "isDeleted": true }, { "id": 1260972, "postDate": "2021-04-02T15:12:46.853Z", "rawMarkdown": "", "isDeleted": true } ], "comments": [ { "id": 1260984, "author_name": "Joshua Pan", "author_url": "", "post_date": "2021-04-02T15:23:59.760000", "content": "

Great foresight!

", "votes": 0, "replies": [] }, { "id": 40881, "author_name": "ChenglongChen", "author_url": "", "post_date": "2014-03-23T04:28:20.847000", "content": "

[quote=Wayne Zhang;40876]

\n

I used a large set of handcrafted features.

\n

In the past month, I tried my home-brew CNN but found out it was impossible to scale up to get any competitive result without a GPU.

\n

The discussion forum here and in previous competitions like face expression and dog cat may give you some hints.

\n

[/quote]

\n

Thanks. I will spend some time reading those comps.

\n

Yr

", "votes": 0, "replies": [] }, { "id": 40876, "author_name": "Wayne Zhang", "author_url": "", "post_date": "2014-03-23T03:49:11.357000", "content": "

I used a large set of handcrafted features.

\n

In the past month, I tried my home-brew CNN but found out it was impossible to scale up to get any competitive result without a GPU.

\n

The discussion forum here and in previous competitions like face expression and dog cat may give you some hints.

", "votes": 0, "replies": [] }, { "id": 40872, "author_name": "ChenglongChen", "author_url": "", "post_date": "2014-03-23T03:27:24.113000", "content": "

[quote=Wayne Zhang;40862]

\n

You can reduce your error to 0.07735 if you try hard.

\n

[/quote]

\n

Is that the current leader's score on the public LB (LOL)? That you mean the leader is also using CNN? I am newbie to DL and currently get panic by so many hyper-params to be tuned. Do you have any tips links to some references on that topic? I'd be happy if I can reduce the error to 0.09.

\n

Yr

", "votes": 0, "replies": [] }, { "id": 40862, "author_name": "Wayne Zhang", "author_url": "", "post_date": "2014-03-23T01:29:34.783000", "content": "

You can reduce your error to 0.07735 if you try hard.

", "votes": 0, "replies": [] }, { "id": 1260980, "author_name": "", "author_url": "", "post_date": "2021-04-02T15:22:48.227000", "content": "", "votes": 0, "replies": [] }, { "id": 1260972, "author_name": "", "author_url": "", "post_date": "2021-04-02T15:12:46.853000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "40843": "", "1260984": "Great foresight!", "40881": "", "40876": "", "40872": "", "40862": "", "1260980": "", "1260972": "" } }