I've posted a simple example for nolearn.convnet that shows how to use the ImageNet-pretrained DeCAF as a feature extractor, and get a score of 94% with only 50 lines of code, and with merely 100 examples used for training.
\nhttp://pythonhosted.org/nolearn/decaf.html#example-dogs-vs-cats
\nhttps://github.com/dnouri/nolearn
\nEdit: Install instructions are here.
", "messages": [ { "id": 37424, "postDate": "2014-01-15T22:16:19.567Z", "content": "I've posted a simple example for nolearn.convnet that shows how to use the ImageNet-pretrained DeCAF as a feature extractor, and get a score of 94% with only 50 lines of code, and with merely 100 examples used for training.
\nhttp://pythonhosted.org/nolearn/decaf.html#example-dogs-vs-cats
\nhttps://github.com/dnouri/nolearn
\nEdit: Install instructions are here.
", "votes": 17 }, { "id": 113980, "postDate": "2016-04-06T16:14:43.490Z", "content": "Cannot find DecafNet files. How can I get the decaf_pretrained file imagnet.decaf.epoch90
", "rawMarkdown": "Cannot find DecafNet files. How can I get the decaf_pretrained file imagnet.decaf.epoch90", "votes": 3 }, { "id": 126752, "postDate": "2016-07-12T05:25:54.923Z", "content": "Can someone help in finding Pretrained imagenet models? The link provided doesn't exist anymore.
", "rawMarkdown": "Can someone help in finding Pretrained imagenet models? The link provided doesn't exist anymore.", "votes": 1 }, { "id": 37548, "postDate": "2014-01-18T00:24:46.263Z", "content": "I believe the problem is that your numpy is too old. This might fix your issue:
\n# pip install -U numpy
\nAlthough I'd recommend against installing Python packages with pip system-wide because it's too easy to mess up your global install. Instead you could use a virtualenv, and then always use the "python" and "pip" commands from its "bin/" directory to run and install libs.
\n$ git clone git@github.com:UCB-ICSI-Vision-Group/decaf-release.git
\n$ cd decaf-release
\n$ virtualenv . --system-site-packages
\n$ bin/pip install -U numpy # if your system numpy is too old
\n$ bin/pip install -U scipy # if your system scipy is too old
\n$ bin/pip install -U Cython # if your system Cython is too old
\n$ bin/python setup.py install # compile, install decaf; make sure it runs w/o errors
\n$ bin/pip install nolearn # install nolearn
\n$ bin/python mydecaf.py # run your own script
\n", "votes": 5 }, { "id": 37923, "postDate": "2014-01-25T17:06:58.450Z", "content": "
[quote=stevenwudi;37921]
\nThough just one line of code, but I could not understand your cache mechanism. Can you brief enlighten me about the @cache.cached purpose? Many thanks
\n[/quote]
\nTake a look at the nolearn.cache docs, they explain what this is about.
\nThe gist is that computing features with decaf can be slow if you have a lot of examples. So you don't want to do the calculation every time you run the script, but cache the results between runs (if you're using the same parameters).
", "votes": 1 }, { "id": 37920, "postDate": "2014-01-25T16:51:19.033Z", "content": "[quote=stevenwudi;37919]
\nHI Daniel, thank you for your answer, I used 1000 examples as well, rendering similar result for the 3rd and 4th fold, and normal accurarcy(95%) for the 1,2,5 fold. Quite bizarre for me to understand. And yes, I will read more thoroughly about your two recommendation links.
\n[/quote]
\nSo you've found a bug in the caching code of nolearn.convnet. I've pushed a quick fix; will make a proper release next week. For now you'll have the get the latest version from here:
\nhttps://github.com/dnouri/nolearn
\n[quote=stevenwudi;37919]
\nI checked out your personal website yesterday and like your works a lot.
\n[/quote]
\nThanks :-)
", "votes": 1 }, { "id": 37899, "postDate": "2014-01-25T03:45:49.407Z", "content": "It's a gcc issue on mac it seems , while installing decaf :
\npython setup.py install
\nmake -C layers/cpp/g++ -c -fPIC -O3 -Wall -ffast-math -msse -msse2 -fopenmp im2col.cpp fastpool.cpp local_response_normalization.cpp neuron.cppclang: warning: argument unused during compilation: '-fopenmp'local_response_normalization.cpp:7:10: fatal error: 'omp.h' file not found#include <omp.h>
\n^1 error generated.make[1]: ***
\n[all] Error 1make: *** [all]
\nError 2Failed to build the C libraries; exiting
", "votes": 1 }, { "id": 37886, "postDate": "2014-01-24T19:55:34.610Z", "content": "[quote=charizard;37884]
\nThanks for sharing
I tried this method , but I am not able to run my script
Error:
ImportError: No module named decaf.scripts.imagenet
[/quote]
\nHave you followed the install instructions that I posted? Because it seems you haven't run this command from within the decaf folder:
\n$ bin/python setup.py install # compile, install decaf; make sure it runs w/o errors
", "votes": 1 }, { "id": 37748, "postDate": "2014-01-22T18:33:47.503Z", "content": "Pip install pil
", "votes": 1 }, { "id": 37734, "postDate": "2014-01-22T17:33:55.683Z", "content": "Unfortunately I couldn't manage to have it run on Windows (yet). It seems I have some not so well identified trouble with MPI, but I have to further investigate the matter. So, in the end, I made it run under Linux (on a virtual machine, I assure you, a very sloow experience!).
\nAs for as the problem mentioned by Steven, the pretrained netfile is in Unix format, so, Steven, you have to modify the code in such a fashion:
\ncuda_decafnet = pickle.load(open(net_file,"rb"))
\nThe "rb" option will have Python to read smoothly the data. Please let me know if, after fixing that, your script runs well because I would like to ask you some information about your specific configuration and compiling procedures, then.
\n", "votes": 1 }, { "id": 37708, "postDate": "2014-01-22T03:40:20.117Z", "content": "
0.09x is also possible with a regular non-conv neural net. I'd guess imagenet's features don't generalize too well to such a specific non-general purpose task. Also wouldn't using a system like that break the no outside data without public declaration/consent rule for galaxy zoo?
", "votes": 1 }, { "id": 37698, "postDate": "2014-01-21T23:45:30.927Z", "content": "i tried decaf in galaxy zoo with random forest on top of it, but couldnt get a score of less than 0.15
", "votes": 1 }, { "id": 37697, "postDate": "2014-01-21T23:43:46.537Z", "content": "[quote=Matt;37695]
\nOk, bear with me, I'll try to rephrase the question: How do the features generated from decaf and overfeat compare with each other regarding predictive power (e.g. have you tried to stick the same supervised learning algorithm on top of both and compared the results?).
\n[/quote]
\nYes, you can use OverFeat pretty much the same way. OverFeat looks at multiple scales and sliding windows of the test image to extract features, which will give you more (and more powerful) features, at the expense of speed.
\nOf course one could use multiple scales with decaf or caffe, too. That wouldn't be too hard to implement.
\n[quote=Matt;37695]
\nFurthermore, does it make sense to apply the feature extraction step in the galaxy zoo competition or do these model only perform so well because they were trained on a similar (but larger) training set (ImageNet)?
\n[/quote]
\nI'd say it's definitely worth a try to use decaf in the galaxy zoo competition. You would however want to extract features from maybe the second or the third layer, and possibly feed those features into a neural net. Then again, the galaxy zoo competition comes with plenty images for training (60k), so it might just work better to just train a convnet from scratch.
\nIf you try decaf with galaxy zoo, I'd be interested to hear how that goes.
\n(I just saw that someone else had the exact same question as you in the galaxy zoo competition's forum.)
\n", "votes": 1 }, { "id": 37547, "postDate": "2014-01-18T00:22:54.847Z", "content": "
Delete numpy from the decaf egg. I had this error - it's looking for multiarray in decaf version of numpy.
", "votes": 1 }, { "id": 37539, "postDate": "2014-01-17T21:27:21.937Z", "content": "[quote=orchid;37538]ImportError: No module named multiarray[/quote]
\n\n
multiarray is part of numpy, which numpy version are you using?
", "votes": 1 }, { "id": 37706, "postDate": "2014-01-22T03:31:33.470Z", "content": "For galaxy, if I remember correctly second-last hidden layer of decaf trained with a neural net got me around 0.11. You can get 0.09x pretty easily with a convnet trained from scratch, so I don't expect decaf features to be competitive there.
", "votes": 2 }, { "id": 37515, "postDate": "2014-01-17T16:35:13.407Z", "content": "remove that param from decaf/layers/Makefile and compile
", "votes": 2 }, { "id": 365214, "postDate": "2018-08-02T05:55:35.857Z", "content": "Looks like link to pre-trained model is now broken: http://www.eecs.berkeley.edu/~jiayq/decaf_pretrained/\nIt's showing github 404 page
", "rawMarkdown": "Looks like link to pre-trained model is now broken: http://www.eecs.berkeley.edu/~jiayq/decaf_pretrained/\nIt's showing github 404 page" }, { "id": 59460, "postDate": "2014-12-03T13:57:38.050Z", "content": "[quote=stevenwudi;37747]
\n[quote=Luca Massaron;37741]
\nIt seems the same problem as before:
\nline 52: self.label_names = meta['label_names']
\nso let's look for meta...
\nline 45: meta = pickle.load(open(meta_file))
\nplease try to modify also this into:
\nmeta = pickle.load(open(meta_file,"rb"))
\nDoes it work?
\n[/quote]
\nHi Luca, for meta file, "rb" is not an issue, I used Anaconda and there is some conflicts (not sure why)
\n\nSo I used official Python2.7 and install packages from scratch and now it can read the files.
\n\nBut one more issue:
\n"
\nin \\site-packages\\nolearn\\convent.py line 112, in transform
\nimport Images #soft dep
\nImportError: No module name Image"
\n\nSo I am wondering what is module Image here. Sorry for the spam..
\n[/quote]
\n\nI have met the same problem. It is fortunate that I am familiar with the Library PIL. Check that you have installed the PIL. Then change the "import Image" into "from PIL import Image" and it works.
" }, { "id": 59443, "postDate": "2014-12-03T05:43:32.283Z", "content": "[quote=charizard;37899]
\nIt's a gcc issue on mac it seems , while installing decaf :
\npython setup.py install
\nmake -C layers/cpp/g++ -c -fPIC -O3 -Wall -ffast-math -msse -msse2 -fopenmp im2col.cpp fastpool.cpp local_response_normalization.cpp neuron.cppclang: warning: argument unused during compilation: '-fopenmp'local_response_normalization.cpp:7:10: fatal error: 'omp.h' file not found#include <omp.h>
\n^1 error generated.make[1]: ***
\n[all] Error 1make: *** [all]
\nError 2Failed to build the C libraries; exiting
\n[/quote]
\n\nI have met the same error on MAC OS. Can anyone give us a solution to such error? Thank you.
" }, { "id": 38013, "postDate": "2014-01-27T16:37:32.870Z", "content": "Hello everyone, this piece of code throws errors on Windows:
\ntry:
_DLL = np.ctypeslib.load_library('libcpputil.so',
os.path.join(os.path.dirname(__file__)))
except Exception as error:
raise error
\n
It's inside wrapper.py
\n" }, { "id": 37921, "postDate": "2014-01-25T16:58:59.827Z", "content": "
[quote=Daniel Nouri;37920]
\n[quote=stevenwudi;37919]
\nHI Daniel, thank you for your answer, I used 1000 examples as well, rendering similar result for the 3rd and 4th fold, and normal accurarcy(95%) for the 1,2,5 fold. Quite bizarre for me to understand. And yes, I will read more thoroughly about your two recommendation links.
\n[/quote]
\nSo you've found a bug in the caching code of nolearn.convnet. I've pushed a quick fix; will make a proper release next week. For now you'll have the get the latest version from here:
\nhttps://github.com/dnouri/nolearn
\n[quote=stevenwudi;37919]
\nI checked out your personal website yesterday and like your works a lot.
\n[/quote]
\nThanks :-)
\n[/quote]
\n\n
Thanks Daniel, you are truly efficient! Now it works fine.
\nThough just one line of code, but I could not understand your cache mechanism. Can you brief enlighten me about the @cache.cached purpose? Many thanks
\n" }, { "id": 37919, "postDate": "2014-01-25T16:44:27.283Z", "content": "
[quote=Daniel Nouri;37917]
\n[quote=stevenwudi;37916]
\nNo idea why such great discrepancies in accuracy: is there some thing fundamentally wrong in my code?
\nThank you for your illumination. (P.S. sklearn seems awesome and neat!)
\n[/quote]
\n<strike>The way you use KFold you're using only 20 examples for testing, which explains the discrepancy. Increase the number you use for testing and training, maybe by a factor of 10:</strike>
\nWoops, looks like I was wrong. I can reproduce your problem even with more examples. Will look into this soon.
\n[/quote]
\nHI Daniel, thank you for your answer, I used 1000 examples as well, rendering similar result for the 3rd and 4th fold, and normal accurarcy(95%) for the 1,2,5 fold. Quite bizarre for me to understand. And yes, I will read more thoroughly about your two recommendation links.
\nI checked out your personal website yesterday and like your works a lot. (I used to use matlab, now much more convincing to use Python now.) And I do agree you pair-coding working style :)
\nBest X
" }, { "id": 37917, "postDate": "2014-01-25T16:37:21.050Z", "content": "[quote=stevenwudi;37916]
\nNo idea why such great discrepancies in accuracy: is there some thing fundamentally wrong in my code?
\nThank you for your illumination. (P.S. sklearn seems awesome and neat!)
\n[/quote]
\n<strike>The way you use KFold you're using only 20 examples for testing, which explains the discrepancy. Increase the number you use for testing and training, maybe by a factor of 10:</strike>
\nWoops, looks like I was wrong. I can reproduce your problem even with more examples. Looking into this right now.
" }, { "id": 37916, "postDate": "2014-01-25T16:14:09.883Z", "content": "Hi, I have encounter some problems in cross-validation (I am new to explore the sklearn):
\nI used nolearn and cv: as
\n<pre> X_train, y_train = X[:100], y[:100]
#X_test, y_test = X[500:1000], y[500:1000]
# Simple K-Fold cross validation. 5 folds.
cv = cross_validation.KFold(len(X_train), n_folds=5, indices=True)
for traincv, testcv in cv:
print "Fitting..."
pl.fit(X_train[traincv], y_train[traincv])
print "Predicting..."
y_pred = pl.predict(X_train[testcv])
print "Accuracy: %.3f" % accuracy_score(y_train[testcv], y_pred)
</pre>
\nthe output is
\n<pre>
\n0.9
\n0.9
\n0.36
\n0.45
\n1.0
\n</pre>
\nNo idea why such great discrepancies in accuracy: is there some thing fundamentally wrong in my code?
\nThank you for your illumination. (P.S. sklearn seems awesome and neat!)
" }, { "id": 37884, "postDate": "2014-01-24T19:12:43.023Z", "content": "Thanks for sharing
I tried this method , but I am not able to run my script
Error:
ImportError: No module named decaf.scripts.imagenet
[quote=Luca Massaron;37734]
\nUnfortunately I couldn't manage to have it run on Windows (yet). It seems I have some not so well identified trouble with MPI, but I have to further investigate the matter. So, in the end, I made it run under Linux (on a virtual machine, I assure you, a very sloow experience!).
\nAs for as the problem mentioned by Steven, the pretrained netfile is in Unix format, so, Steven, you have to modify the code in such a fashion:
\ncuda_decafnet = pickle.load(open(net_file,"rb"))
\nThe "rb" option will have Python to read smoothly the data. Please let me know if, after fixing that, your script runs well because I would like to ask you some information about your specific configuration and compiling procedures, then.
\n\n
[/quote]
\n\n
Hey, Luca. Finally I am able to run the code and have the 93% accuracy. I have scribble a blog here:http://vision.group.shef.ac.uk/wordpress/?p=93
\nApologies if anything unclear. Too late now, need to sleep...
" }, { "id": 37769, "postDate": "2014-01-22T22:48:14.980Z", "content": "I finally got the code running under Windows Visual Studio environment. However, when I run some simple demo like:
\n"
\nscores = net.classify(img)
\n"
\nIt just kept running without any output. And I checked the python code, for base.py, Class Layer, def predict method, the predict method says
\n """A wrapper function to do prediction. If a layer has different
behaviors during training and testing, one can write a predict()
function which is called during testing time.
In default, the predict() function will simply call forward.
"""
Not sure why the code just keeps running... ( I compiled the cpp code in the layer folder using Cygwin, not sure whether it is relevant)
\n" }, { "id": 37747, "postDate": "2014-01-22T18:31:28.623Z", "content": "
[quote=Luca Massaron;37741]
\nIt seems the same problem as before:
\nline 52: self.label_names = meta['label_names']
\nso let's look for meta...
\nline 45: meta = pickle.load(open(meta_file))
\nplease try to modify also this into:
\nmeta = pickle.load(open(meta_file,"rb"))
\nDoes it work?
\n[/quote]
\nHi Luca, for meta file, "rb" is not an issue, I used Anaconda and there is some conflicts (not sure why)
\n\n
So I used official Python2.7 and install packages from scratch and now it can read the files.
\n\n
But one more issue:
\n"
\nin \\site-packages\\nolearn\\convent.py line 112, in transform
\nimport Images #soft dep
\nImportError: No module name Image"
\n\n
So I am wondering what is module Image here. Sorry for the spam..
" }, { "id": 37741, "postDate": "2014-01-22T18:00:57.713Z", "content": "It seems the same problem as before:
\nline 52: self.label_names = meta['label_names']
\nso let's look for meta...
\nline 45: meta = pickle.load(open(meta_file))
\nplease try to modify also this into:
\nmeta = pickle.load(open(meta_file,"rb"))
\nDoes it work?
" }, { "id": 37736, "postDate": "2014-01-22T17:50:12.037Z", "content": "[quote=Luca Massaron;37734]
\nUnfortunately I couldn't manage to have it run on Windows (yet). It seems I have some not so well identified trouble with MPI, but I have to further investigate the matter. So, in the end, I made it run under Linux (on a virtual machine, I assure you, a very sloow experience!).
\nAs for as the problem mentioned by Steven, the pretrained netfile is in Unix format, so, Steven, you have to modify the code in such a fashion:
\ncuda_decafnet = pickle.load(open(net_file,"rb"))
\nThe "rb" option will have Python to read smoothly the data. Please let me know if, after fixing that, your script runs well because I would like to ask you some information about your specific configuration and compiling procedures, then.
\n\n
[/quote]
\n\n
HI Luca,
\nIt does work now. However, for line 52 in imagenet.py, I encounter the error:
\n" self.label_names = meta['label_names']" 'Access violation'.
\n\n
Quite bizarre error, anyone can help?
" }, { "id": 37729, "postDate": "2014-01-22T17:00:51.837Z", "content": "[quote=stevenwudi;37728]
\nHi, I am wondering whether anybody has made DeCAF work under windows?
\nMy issue is that for the pretrained netfile, which I downloaded from http://www.eecs.berkeley.edu/~jiayq/decaf_pretrained/, I am not able to read it
\n" cuda_decafnet = pickle.load(open(net_file)) EOFError"
\nAnyone can cast light on this? Many thanks!
\n[/quote]
\nI believe at least Luca has it running under Windows.
\nYour EOFError looks like the file you downloaded may be corrupted. The md5 checksum of imagenet.decafnet.epoch90 should be 66155aca4447b9fe8c203ccbfb19b93b.
\n\n
" }, { "id": 37728, "postDate": "2014-01-22T16:51:32.040Z", "content": "
Hi, I am wondering whether anybody has made DeCAF work under windows?
\nMy issue is that for the pretrained netfile, which I downloaded from http://www.eecs.berkeley.edu/~jiayq/decaf_pretrained/, I am not able to read it
\n" cuda_decafnet = pickle.load(open(net_file)) EOFError"
\nAnyone can cast light on this? Many thanks!
" }, { "id": 37703, "postDate": "2014-01-22T02:36:07.947Z", "content": "tried all available ones using grid search
" }, { "id": 37699, "postDate": "2014-01-21T23:48:17.773Z", "content": "[quote=Abhishek;37698]
\ni tried decaf in galaxy zoo with random forest on top of it, but couldnt get a score of less than 0.15
\n[/quote]
\nWhich layer did you use for extracting features?
\n" }, { "id": 37695, "postDate": "2014-01-21T22:44:07.897Z", "content": "
Haha :D
\nOk, bear with me, I'll try to rephrase the question: How do the features generated from decaf and overfeat compare with each other regarding predictive power (e.g. have you tried to stick the same supervised learning algorithm on top of both and compared the results?).
\nFurthermore, does it make sense to apply the feature extraction step in the galaxy zoo competition or do these model only perform so well because they were trained on a similar (but larger) training set (ImageNet)?
" }, { "id": 37691, "postDate": "2014-01-21T20:36:10.370Z", "content": "I think it's save to say Pierre did. ;-)
" }, { "id": 37685, "postDate": "2014-01-21T18:24:17.380Z", "content": "Has anybody tried to do the same with Overfeat?
" }, { "id": 37603, "postDate": "2014-01-19T12:27:49.247Z", "content": "[quote=saraswathi;37598]
\nI tried installing nolearn using the command:
\n$pip install nolearn
\n\n
After downloading nolearn, I get the following error:
\nDownloading/unpacking gdbn (from nolearn)
Could not find any downloads that satisfy the requirement gdbn (from nolearn)
Cleaning up...
No distributions at all found for gdbn (from nolearn)
[/quote]
\n
I fixed this. You should be able to just use "bin/pip install nolearn" now.
" }, { "id": 37598, "postDate": "2014-01-19T08:02:33.500Z", "content": "I tried installing nolearn using the command:
\n$pip install nolearn
\n\n
After downloading nolearn, I get the following error:
\nDownloading/unpacking gdbn (from nolearn)
Could not find any downloads that satisfy the requirement gdbn (from nolearn)
Cleaning up...
No distributions at all found for gdbn (from nolearn)
Storing debug log for failure in /var/folders/m9/fndll3l57399ymnsyk5dnwcm0000gn/T/tmpd8G236
\n
Can someone suggest what I should do to fix this? (Am a Python noob). Using Anaconda on Mac 10.8.5
\n\n
Thanks.
\n\n
EDIT: Installed gdbn from github and now it works. The code runs. But now, getting warning to install mpi4py. Trying to understand what that one is :) .
" }, { "id": 37546, "postDate": "2014-01-17T23:59:35.410Z", "content": "Well, I got same "No module named multiarray" error on Cygwin like i got in Ubuntu.
\nnumpy version on Cygwin is 1.6.2 and multiarray.dll is already at numpy/core/ directory
\n\n
\n
\n
$ python mydecaf.py
\nFitting...
\nCouldn't import dot_parser, loading of dot files will not be possible.
WARNING:root:decaf.util.pyvml: unable to load the mkl library. Using fallback options.
Traceback (most recent call last):
File "mydecaf.py", line 44, in <module>
main()
\nFile "mydecaf.py", line 40, in main
\npl.fit(X_train, y_train)
File "/usr/lib/python2.7/site-packages/scikit_learn-0.14.1-py2.7-cygwin-1.7.27-x86_64.egg/sklearn/pipeline.py", line 130, in fit
Xt, fit_params = self._pre_transform(X, y, **fit_params)
File "/usr/lib/python2.7/site-packages/scikit_learn-0.14.1-py2.7-cygwin-1.7.27-x86_64.egg/sklearn/pipeline.py", line 122, in _pre_transform
Xt = transform.fit(Xt, y, **fit_params_steps[name]) \\
File "/usr/lib/python2.7/site-packages/nolearn-0.4.1dev-py2.7.egg/nolearn/convnet.py", line 98, in fit
self.pretrained_meta,
File "/usr/lib/python2.7/site-packages/decaf-0.9-py2.7.egg/decaf/scripts/imagenet.py", line 45, in __init__
meta = pickle.load(open(meta_file))
ImportError: No module named multiarray
\n
$ cat mydecaf.py
import os
from nolearn.convnet import ConvNetFeatures
from sklearn.linear_model import LogisticRegression
from sklearn.metrics import accuracy_score
from sklearn.pipeline import Pipeline
from sklearn.utils import shuffle
DECAF_IMAGENET_DIR = './imagenet/'
TRAIN_DATA_DIR = './data/'
def get_dataset():
cat_dir = TRAIN_DATA_DIR + 'cat/'
cat_filenames = [cat_dir + fn for fn in os.listdir(cat_dir)]
dog_dir = TRAIN_DATA_DIR + 'dog/'
dog_filenames = [dog_dir + fn for fn in os.listdir(dog_dir)]
labels = [0] * len(cat_filenames) + [1] * len(dog_filenames)
filenames = cat_filenames + dog_filenames
return shuffle(filenames, labels, random_state=0)
def main():
convnet = ConvNetFeatures(
pretrained_params=DECAF_IMAGENET_DIR + 'imagenet.decafnet.epoch90',
pretrained_meta=DECAF_IMAGENET_DIR + 'imagenet.decafnet.meta',
)
clf = LogisticRegression()
pl = Pipeline([
('convnet', convnet),
('clf', clf),
])
X, y = get_dataset()
X_train, y_train = X[:100], y[:100]
X_test, y_test = X[100:300], y[100:300]
print "Fitting..."
pl.fit(X_train, y_train)
print "Predicting..."
y_pred = pl.predict(X_test)
print "Accuracy: %.3f" % accuracy_score(y_test, y_pred)
main()
\n
" }, { "id": 37543, "postDate": "2014-01-17T22:12:35.803Z", "content": "
1.6.1.
\nI checked my numpy directory dist-packages/numpy/core/, multiarray.so file actually is there. Just don't know why pickle.load can not locate this .so file.
\n\n
" }, { "id": 37538, "postDate": "2014-01-17T21:09:04.363Z", "content": "
I ran the python codes (from the link http://pythonhosted.org/nolearn/convnet.html#example-dogs-vs-cats) on Ubuntu 12.04.4 and got below error message. I guess the issue was related to numpy on my Ubuntu. Any python expert has any thoughts ?
\n\n
root@ubuntu:~/test# python mydecaf.py
Fitting...
WARNING:root:decaf.util.pyvml: unable to load the mkl library. Using fallback options.
Traceback (most recent call last):
File "mydecaf.py", line 46, in <module>
\nFile "mydecaf.py", line 42, in main
\npl.fit(X_train, y_train)
File "/usr/local/lib/python2.7/dist-packages/sklearn/pipeline.py", line 130, in fit
Xt, fit_params = self._pre_transform(X, y, **fit_params)
File "/usr/local/lib/python2.7/dist-packages/sklearn/pipeline.py", line 122, in _pre_transform
Xt = transform.fit(Xt, y, **fit_params_steps[name])
File "/usr/local/lib/python2.7/dist-packages/nolearn-0.4.1dev-py2.7.egg/nolearn/convnet.py", line 98, in fit self.pretrained_meta,
File "/usr/local/lib/python2.7/dist-packages/decaf-0.9-py2.7.egg/decaf/scripts/imagenet.py", line 49, in __init__
meta = pickle.load(open(meta_file))
ImportError: No module named multiarray
A question: can DeCAF (which I understand is compulsory for nolearn.convnet.ConvNetFeature to work) be installed on a Windows 7 64-bit system? I've tried with Cygwin and MingW-w64 but it seems that g++ doesn't really like the syntax (-Wl parameter) required by the make process. Should I really turn to Linux to see it work? Thanks.
" }, { "id": 37427, "postDate": "2014-01-15T22:34:00.543Z", "content": "To find the example, follow the first link above.
\nhttp://pythonhosted.org/nolearn/convnet.html#example-dogs-vs-cats
" }, { "id": 37426, "postDate": "2014-01-15T22:31:54.847Z", "content": "Great. I was working with nolearn convnet only but I didnt know that just 100 images can produce an accuracy of 94%. By the way, I'm unable to find the example you mentioned.
\nEDIT: nevermind found it
" }, { "id": 365213, "postDate": "2018-08-02T05:54:37.337Z", "rawMarkdown": "", "isDeleted": true } ], "comments": [ { "id": 113980, "author_name": "PengfeiDu", "author_url": "", "post_date": "2016-04-06T16:14:43.490000", "content": "Cannot find DecafNet files. How can I get the decaf_pretrained file imagnet.decaf.epoch90
", "votes": 3, "replies": [] }, { "id": 126752, "author_name": "apatti", "author_url": "", "post_date": "2016-07-12T05:25:54.923000", "content": "Can someone help in finding Pretrained imagenet models? The link provided doesn't exist anymore.
", "votes": 1, "replies": [] }, { "id": 37548, "author_name": "Daniel Nouri", "author_url": "", "post_date": "2014-01-18T00:24:46.263000", "content": "I believe the problem is that your numpy is too old. This might fix your issue:
\n# pip install -U numpy
\nAlthough I'd recommend against installing Python packages with pip system-wide because it's too easy to mess up your global install. Instead you could use a virtualenv, and then always use the "python" and "pip" commands from its "bin/" directory to run and install libs.
\n$ git clone git@github.com:UCB-ICSI-Vision-Group/decaf-release.git
\n$ cd decaf-release
\n$ virtualenv . --system-site-packages
\n$ bin/pip install -U numpy # if your system numpy is too old
\n$ bin/pip install -U scipy # if your system scipy is too old
\n$ bin/pip install -U Cython # if your system Cython is too old
\n$ bin/python setup.py install # compile, install decaf; make sure it runs w/o errors
\n$ bin/pip install nolearn # install nolearn
\n$ bin/python mydecaf.py # run your own script
\n", "votes": 5, "replies": [] }, { "id": 37923, "author_name": "Daniel Nouri", "author_url": "", "post_date": "2014-01-25T17:06:58.450000", "content": "
[quote=stevenwudi;37921]
\nThough just one line of code, but I could not understand your cache mechanism. Can you brief enlighten me about the @cache.cached purpose? Many thanks
\n[/quote]
\nTake a look at the nolearn.cache docs, they explain what this is about.
\nThe gist is that computing features with decaf can be slow if you have a lot of examples. So you don't want to do the calculation every time you run the script, but cache the results between runs (if you're using the same parameters).
", "votes": 1, "replies": [] }, { "id": 37920, "author_name": "Daniel Nouri", "author_url": "", "post_date": "2014-01-25T16:51:19.033000", "content": "[quote=stevenwudi;37919]
\nHI Daniel, thank you for your answer, I used 1000 examples as well, rendering similar result for the 3rd and 4th fold, and normal accurarcy(95%) for the 1,2,5 fold. Quite bizarre for me to understand. And yes, I will read more thoroughly about your two recommendation links.
\n[/quote]
\nSo you've found a bug in the caching code of nolearn.convnet. I've pushed a quick fix; will make a proper release next week. For now you'll have the get the latest version from here:
\nhttps://github.com/dnouri/nolearn
\n[quote=stevenwudi;37919]
\nI checked out your personal website yesterday and like your works a lot.
\n[/quote]
\nThanks :-)
", "votes": 1, "replies": [] }, { "id": 37899, "author_name": "charizard", "author_url": "", "post_date": "2014-01-25T03:45:49.407000", "content": "It's a gcc issue on mac it seems , while installing decaf :
\npython setup.py install
\nmake -C layers/cpp/g++ -c -fPIC -O3 -Wall -ffast-math -msse -msse2 -fopenmp im2col.cpp fastpool.cpp local_response_normalization.cpp neuron.cppclang: warning: argument unused during compilation: '-fopenmp'local_response_normalization.cpp:7:10: fatal error: 'omp.h' file not found#include <omp.h>
\n^1 error generated.make[1]: ***
\n[all] Error 1make: *** [all]
\nError 2Failed to build the C libraries; exiting
", "votes": 1, "replies": [] }, { "id": 37886, "author_name": "Daniel Nouri", "author_url": "", "post_date": "2014-01-24T19:55:34.610000", "content": "[quote=charizard;37884]
\nThanks for sharing
I tried this method , but I am not able to run my script
Error:
ImportError: No module named decaf.scripts.imagenet
[/quote]
\nHave you followed the install instructions that I posted? Because it seems you haven't run this command from within the decaf folder:
\n$ bin/python setup.py install # compile, install decaf; make sure it runs w/o errors
", "votes": 1, "replies": [] }, { "id": 37748, "author_name": "Abhishek Thakur", "author_url": "", "post_date": "2014-01-22T18:33:47.503000", "content": "Pip install pil
", "votes": 1, "replies": [] }, { "id": 37734, "author_name": "Luca Massaron", "author_url": "", "post_date": "2014-01-22T17:33:55.683000", "content": "Unfortunately I couldn't manage to have it run on Windows (yet). It seems I have some not so well identified trouble with MPI, but I have to further investigate the matter. So, in the end, I made it run under Linux (on a virtual machine, I assure you, a very sloow experience!).
\nAs for as the problem mentioned by Steven, the pretrained netfile is in Unix format, so, Steven, you have to modify the code in such a fashion:
\ncuda_decafnet = pickle.load(open(net_file,"rb"))
\nThe "rb" option will have Python to read smoothly the data. Please let me know if, after fixing that, your script runs well because I would like to ask you some information about your specific configuration and compiling procedures, then.
\n", "votes": 1, "replies": [] }, { "id": 37708, "author_name": "Alec Radford", "author_url": "", "post_date": "2014-01-22T03:40:20.117000", "content": "
0.09x is also possible with a regular non-conv neural net. I'd guess imagenet's features don't generalize too well to such a specific non-general purpose task. Also wouldn't using a system like that break the no outside data without public declaration/consent rule for galaxy zoo?
", "votes": 1, "replies": [] }, { "id": 37698, "author_name": "Abhishek Thakur", "author_url": "", "post_date": "2014-01-21T23:45:30.927000", "content": "i tried decaf in galaxy zoo with random forest on top of it, but couldnt get a score of less than 0.15
", "votes": 1, "replies": [] }, { "id": 37697, "author_name": "Daniel Nouri", "author_url": "", "post_date": "2014-01-21T23:43:46.537000", "content": "[quote=Matt;37695]
\nOk, bear with me, I'll try to rephrase the question: How do the features generated from decaf and overfeat compare with each other regarding predictive power (e.g. have you tried to stick the same supervised learning algorithm on top of both and compared the results?).
\n[/quote]
\nYes, you can use OverFeat pretty much the same way. OverFeat looks at multiple scales and sliding windows of the test image to extract features, which will give you more (and more powerful) features, at the expense of speed.
\nOf course one could use multiple scales with decaf or caffe, too. That wouldn't be too hard to implement.
\n[quote=Matt;37695]
\nFurthermore, does it make sense to apply the feature extraction step in the galaxy zoo competition or do these model only perform so well because they were trained on a similar (but larger) training set (ImageNet)?
\n[/quote]
\nI'd say it's definitely worth a try to use decaf in the galaxy zoo competition. You would however want to extract features from maybe the second or the third layer, and possibly feed those features into a neural net. Then again, the galaxy zoo competition comes with plenty images for training (60k), so it might just work better to just train a convnet from scratch.
\nIf you try decaf with galaxy zoo, I'd be interested to hear how that goes.
\n(I just saw that someone else had the exact same question as you in the galaxy zoo competition's forum.)
\n", "votes": 1, "replies": [] }, { "id": 37547, "author_name": "Bluefool", "author_url": "", "post_date": "2014-01-18T00:22:54.847000", "content": "
Delete numpy from the decaf egg. I had this error - it's looking for multiarray in decaf version of numpy.
", "votes": 1, "replies": [] }, { "id": 37539, "author_name": "Matt", "author_url": "", "post_date": "2014-01-17T21:27:21.937000", "content": "[quote=orchid;37538]ImportError: No module named multiarray[/quote]
\n\n
multiarray is part of numpy, which numpy version are you using?
", "votes": 1, "replies": [] }, { "id": 37706, "author_name": "Ryan Kiros", "author_url": "", "post_date": "2014-01-22T03:31:33.470000", "content": "For galaxy, if I remember correctly second-last hidden layer of decaf trained with a neural net got me around 0.11. You can get 0.09x pretty easily with a convnet trained from scratch, so I don't expect decaf features to be competitive there.
", "votes": 2, "replies": [] }, { "id": 37515, "author_name": "Abhishek Thakur", "author_url": "", "post_date": "2014-01-17T16:35:13.407000", "content": "remove that param from decaf/layers/Makefile and compile
", "votes": 2, "replies": [] }, { "id": 365214, "author_name": "yhosoai", "author_url": "", "post_date": "2018-08-02T05:55:35.857000", "content": "Looks like link to pre-trained model is now broken: http://www.eecs.berkeley.edu/~jiayq/decaf_pretrained/\nIt's showing github 404 page
", "votes": 0, "replies": [] }, { "id": 59460, "author_name": "PengPai", "author_url": "", "post_date": "2014-12-03T13:57:38.050000", "content": "[quote=stevenwudi;37747]
\n[quote=Luca Massaron;37741]
\nIt seems the same problem as before:
\nline 52: self.label_names = meta['label_names']
\nso let's look for meta...
\nline 45: meta = pickle.load(open(meta_file))
\nplease try to modify also this into:
\nmeta = pickle.load(open(meta_file,"rb"))
\nDoes it work?
\n[/quote]
\nHi Luca, for meta file, "rb" is not an issue, I used Anaconda and there is some conflicts (not sure why)
\n\nSo I used official Python2.7 and install packages from scratch and now it can read the files.
\n\nBut one more issue:
\n"
\nin \\site-packages\\nolearn\\convent.py line 112, in transform
\nimport Images #soft dep
\nImportError: No module name Image"
\n\nSo I am wondering what is module Image here. Sorry for the spam..
\n[/quote]
\n\nI have met the same problem. It is fortunate that I am familiar with the Library PIL. Check that you have installed the PIL. Then change the "import Image" into "from PIL import Image" and it works.
", "votes": 0, "replies": [] }, { "id": 59443, "author_name": "PengPai", "author_url": "", "post_date": "2014-12-03T05:43:32.283000", "content": "[quote=charizard;37899]
\nIt's a gcc issue on mac it seems , while installing decaf :
\npython setup.py install
\nmake -C layers/cpp/g++ -c -fPIC -O3 -Wall -ffast-math -msse -msse2 -fopenmp im2col.cpp fastpool.cpp local_response_normalization.cpp neuron.cppclang: warning: argument unused during compilation: '-fopenmp'local_response_normalization.cpp:7:10: fatal error: 'omp.h' file not found#include <omp.h>
\n^1 error generated.make[1]: ***
\n[all] Error 1make: *** [all]
\nError 2Failed to build the C libraries; exiting
\n[/quote]
\n\nI have met the same error on MAC OS. Can anyone give us a solution to such error? Thank you.
", "votes": 0, "replies": [] }, { "id": 38013, "author_name": "Fede", "author_url": "", "post_date": "2014-01-27T16:37:32.870000", "content": "Hello everyone, this piece of code throws errors on Windows:
\ntry:
_DLL = np.ctypeslib.load_library('libcpputil.so',
os.path.join(os.path.dirname(__file__)))
except Exception as error:
raise error
\n
It's inside wrapper.py
\n", "votes": 0, "replies": [] }, { "id": 37921, "author_name": "stevenwudi", "author_url": "", "post_date": "2014-01-25T16:58:59.827000", "content": "
[quote=Daniel Nouri;37920]
\n[quote=stevenwudi;37919]
\nHI Daniel, thank you for your answer, I used 1000 examples as well, rendering similar result for the 3rd and 4th fold, and normal accurarcy(95%) for the 1,2,5 fold. Quite bizarre for me to understand. And yes, I will read more thoroughly about your two recommendation links.
\n[/quote]
\nSo you've found a bug in the caching code of nolearn.convnet. I've pushed a quick fix; will make a proper release next week. For now you'll have the get the latest version from here:
\nhttps://github.com/dnouri/nolearn
\n[quote=stevenwudi;37919]
\nI checked out your personal website yesterday and like your works a lot.
\n[/quote]
\nThanks :-)
\n[/quote]
\n\n
Thanks Daniel, you are truly efficient! Now it works fine.
\nThough just one line of code, but I could not understand your cache mechanism. Can you brief enlighten me about the @cache.cached purpose? Many thanks
\n", "votes": 0, "replies": [] }, { "id": 37919, "author_name": "stevenwudi", "author_url": "", "post_date": "2014-01-25T16:44:27.283000", "content": "
[quote=Daniel Nouri;37917]
\n[quote=stevenwudi;37916]
\nNo idea why such great discrepancies in accuracy: is there some thing fundamentally wrong in my code?
\nThank you for your illumination. (P.S. sklearn seems awesome and neat!)
\n[/quote]
\n<strike>The way you use KFold you're using only 20 examples for testing, which explains the discrepancy. Increase the number you use for testing and training, maybe by a factor of 10:</strike>
\nWoops, looks like I was wrong. I can reproduce your problem even with more examples. Will look into this soon.
\n[/quote]
\nHI Daniel, thank you for your answer, I used 1000 examples as well, rendering similar result for the 3rd and 4th fold, and normal accurarcy(95%) for the 1,2,5 fold. Quite bizarre for me to understand. And yes, I will read more thoroughly about your two recommendation links.
\nI checked out your personal website yesterday and like your works a lot. (I used to use matlab, now much more convincing to use Python now.) And I do agree you pair-coding working style :)
\nBest X
", "votes": 0, "replies": [] }, { "id": 37917, "author_name": "Daniel Nouri", "author_url": "", "post_date": "2014-01-25T16:37:21.050000", "content": "[quote=stevenwudi;37916]
\nNo idea why such great discrepancies in accuracy: is there some thing fundamentally wrong in my code?
\nThank you for your illumination. (P.S. sklearn seems awesome and neat!)
\n[/quote]
\n<strike>The way you use KFold you're using only 20 examples for testing, which explains the discrepancy. Increase the number you use for testing and training, maybe by a factor of 10:</strike>
\nWoops, looks like I was wrong. I can reproduce your problem even with more examples. Looking into this right now.
", "votes": 0, "replies": [] }, { "id": 37916, "author_name": "stevenwudi", "author_url": "", "post_date": "2014-01-25T16:14:09.883000", "content": "Hi, I have encounter some problems in cross-validation (I am new to explore the sklearn):
\nI used nolearn and cv: as
\n<pre> X_train, y_train = X[:100], y[:100]
#X_test, y_test = X[500:1000], y[500:1000]
# Simple K-Fold cross validation. 5 folds.
cv = cross_validation.KFold(len(X_train), n_folds=5, indices=True)
for traincv, testcv in cv:
print "Fitting..."
pl.fit(X_train[traincv], y_train[traincv])
print "Predicting..."
y_pred = pl.predict(X_train[testcv])
print "Accuracy: %.3f" % accuracy_score(y_train[testcv], y_pred)
</pre>
\nthe output is
\n<pre>
\n0.9
\n0.9
\n0.36
\n0.45
\n1.0
\n</pre>
\nNo idea why such great discrepancies in accuracy: is there some thing fundamentally wrong in my code?
\nThank you for your illumination. (P.S. sklearn seems awesome and neat!)
", "votes": 0, "replies": [] }, { "id": 37884, "author_name": "charizard", "author_url": "", "post_date": "2014-01-24T19:12:43.023000", "content": "Thanks for sharing
I tried this method , but I am not able to run my script
Error:
ImportError: No module named decaf.scripts.imagenet
[quote=Luca Massaron;37734]
\nUnfortunately I couldn't manage to have it run on Windows (yet). It seems I have some not so well identified trouble with MPI, but I have to further investigate the matter. So, in the end, I made it run under Linux (on a virtual machine, I assure you, a very sloow experience!).
\nAs for as the problem mentioned by Steven, the pretrained netfile is in Unix format, so, Steven, you have to modify the code in such a fashion:
\ncuda_decafnet = pickle.load(open(net_file,"rb"))
\nThe "rb" option will have Python to read smoothly the data. Please let me know if, after fixing that, your script runs well because I would like to ask you some information about your specific configuration and compiling procedures, then.
\n\n
[/quote]
\n\n
Hey, Luca. Finally I am able to run the code and have the 93% accuracy. I have scribble a blog here:http://vision.group.shef.ac.uk/wordpress/?p=93
\nApologies if anything unclear. Too late now, need to sleep...
", "votes": 0, "replies": [] }, { "id": 37769, "author_name": "stevenwudi", "author_url": "", "post_date": "2014-01-22T22:48:14.980000", "content": "I finally got the code running under Windows Visual Studio environment. However, when I run some simple demo like:
\n"
\nscores = net.classify(img)
\n"
\nIt just kept running without any output. And I checked the python code, for base.py, Class Layer, def predict method, the predict method says
\n """A wrapper function to do prediction. If a layer has different
behaviors during training and testing, one can write a predict()
function which is called during testing time.
In default, the predict() function will simply call forward.
"""
Not sure why the code just keeps running... ( I compiled the cpp code in the layer folder using Cygwin, not sure whether it is relevant)
\n", "votes": 0, "replies": [] }, { "id": 37747, "author_name": "stevenwudi", "author_url": "", "post_date": "2014-01-22T18:31:28.623000", "content": "
[quote=Luca Massaron;37741]
\nIt seems the same problem as before:
\nline 52: self.label_names = meta['label_names']
\nso let's look for meta...
\nline 45: meta = pickle.load(open(meta_file))
\nplease try to modify also this into:
\nmeta = pickle.load(open(meta_file,"rb"))
\nDoes it work?
\n[/quote]
\nHi Luca, for meta file, "rb" is not an issue, I used Anaconda and there is some conflicts (not sure why)
\n\n
So I used official Python2.7 and install packages from scratch and now it can read the files.
\n\n
But one more issue:
\n"
\nin \\site-packages\\nolearn\\convent.py line 112, in transform
\nimport Images #soft dep
\nImportError: No module name Image"
\n\n
So I am wondering what is module Image here. Sorry for the spam..
", "votes": 0, "replies": [] }, { "id": 37741, "author_name": "Luca Massaron", "author_url": "", "post_date": "2014-01-22T18:00:57.713000", "content": "It seems the same problem as before:
\nline 52: self.label_names = meta['label_names']
\nso let's look for meta...
\nline 45: meta = pickle.load(open(meta_file))
\nplease try to modify also this into:
\nmeta = pickle.load(open(meta_file,"rb"))
\nDoes it work?
", "votes": 0, "replies": [] }, { "id": 37736, "author_name": "", "author_url": "", "post_date": "2014-01-22T17:50:12.037000", "content": "", "votes": 0, "replies": [] }, { "id": 37729, "author_name": "", "author_url": "", "post_date": "2014-01-22T17:00:51.837000", "content": "", "votes": 0, "replies": [] }, { "id": 37728, "author_name": "", "author_url": "", "post_date": "2014-01-22T16:51:32.040000", "content": "", "votes": 0, "replies": [] }, { "id": 37703, "author_name": "", "author_url": "", "post_date": "2014-01-22T02:36:07.947000", "content": "", "votes": 0, "replies": [] }, { "id": 37699, "author_name": "", "author_url": "", "post_date": "2014-01-21T23:48:17.773000", "content": "", "votes": 0, "replies": [] }, { "id": 37695, "author_name": "", "author_url": "", "post_date": "2014-01-21T22:44:07.897000", "content": "", "votes": 0, "replies": [] }, { "id": 37691, "author_name": "", "author_url": "", "post_date": "2014-01-21T20:36:10.370000", "content": "", "votes": 0, "replies": [] }, { "id": 37685, "author_name": "", "author_url": "", "post_date": "2014-01-21T18:24:17.380000", "content": "", "votes": 0, "replies": [] }, { "id": 37603, "author_name": "", "author_url": "", "post_date": "2014-01-19T12:27:49.247000", "content": "", "votes": 0, "replies": [] }, { "id": 37598, "author_name": "", "author_url": "", "post_date": "2014-01-19T08:02:33.500000", "content": "", "votes": 0, "replies": [] }, { "id": 37546, "author_name": "", "author_url": "", "post_date": "2014-01-17T23:59:35.410000", "content": "", "votes": 0, "replies": [] }, { "id": 37543, "author_name": "", "author_url": "", "post_date": "2014-01-17T22:12:35.803000", "content": "", "votes": 0, "replies": [] }, { "id": 37538, "author_name": "", "author_url": "", "post_date": "2014-01-17T21:09:04.363000", "content": "", "votes": 0, "replies": [] }, { "id": 37514, "author_name": "", "author_url": "", "post_date": "2014-01-17T16:31:27.857000", "content": "", "votes": 0, "replies": [] }, { "id": 37427, "author_name": "", "author_url": "", "post_date": "2014-01-15T22:34:00.543000", "content": "", "votes": 0, "replies": [] }, { "id": 37426, "author_name": "", "author_url": "", "post_date": "2014-01-15T22:31:54.847000", "content": "", "votes": 0, "replies": [] }, { "id": 365213, "author_name": "", "author_url": "", "post_date": "2018-08-02T05:54:37.337000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "37424": "", "113980": "Cannot find DecafNet files. How can I get the decaf_pretrained file imagnet.decaf.epoch90", "126752": "Can someone help in finding Pretrained imagenet models? The link provided doesn't exist anymore.", "37548": "", "37923": "", "37920": "", "37899": "", "37886": "", "37748": "", "37734": "", "37708": "", "37698": "", "37697": "", "37547": "", "37539": "", "37706": "", "37515": "", "365214": "Looks like link to pre-trained model is now broken: http://www.eecs.berkeley.edu/~jiayq/decaf_pretrained/\nIt's showing github 404 page", "59460": "", "59443": "", "38013": "", "37921": "", "37919": "", "37917": "", "37916": "", "37884": "", "37774": "", "37769": "", "37747": "", "37741": "", "37736": "", "37729": "", "37728": "", "37703": "", "37699": "", "37695": "", "37691": "", "37685": "", "37603": "", "37598": "", "37546": "", "37543": "", "37538": "", "37514": "", "37427": "", "37426": "", "365213": "" } }