The research paper published by Stanford University can be found at: http://cs.stanford.edu/~jngiam
export PYTHONPATH='path/to/the/directory/where/you/downloaded/the/code'
cd sparse/demos/sparse_filtering
# Training phase
python demo_sparse.py --train [--unsupervised | --supervised | --all] [--input "/path/to/train.txt"] [--model "model_name"]
# Execution phase
python demo_sparse.py [--input path/to/train.txt] [--model "model_name"]
python demo_sparse.py [--input path/to/val.txt] [--model "model_name"]
python ../../../util/tsne_python/tsne.py
cd sparse/util/plibsvm-3.18
./gen.sh [-o "output_folder"] [-n "network_folder"]
The zip file with all the training data, validation data and annotations taken from the TRECVID dataset can be downloaded from Amazon S3. The zip file with the images of cats, birds, dogs and lamps taken from the ImageNet dataset can be downloaded from Amazon S3
All the input files (train.txt and val.txt) must be written with the following format:
image_path label
dog/dog_001.png 0
cat/cat_002.png 0
bird/dird_001.png 0
To generate these files for the ImageNet dataset you can use the 'gen_train.sh' and 'gen_val.sh' scripts available in the folder 'sparse/util/_data'. To generate the input files for the trecvid dataset you can use the 'gen_data.py' script in the folder 'sparse/util/_data/trecvid'.
./gen_train.sh num_of_desired_images
./gen_val num_of_desired_images
python gen_data.py num_of_train_images num_of_test_images
Firstly install mkl intel library! (Building numpy, scipy and numexpr from source will give a speed increase with respect to the precompiled versions downloaded through apt-get.)
sudo apt-get install python-dev
sudo apt-get install libfreetype6-dev
sudo apt-get install python-numpy
sudo apt-get install python-scipy python-matplotlib ipython
sudo apt-get install python-numexpr
sudo apt-get install libblas-dev
sudo easy_install networkx
sudo apt-get install python-skimage
sudo apt-get install python-pydot
sudo apt-get install python-mpi python-mpi4py
sudo -E pip install --upgrade sklearnexport CFLAGS=-Qunused-arguments
export CPPFLAGS=-Qunused-arguments
sudo -E pip install --upgrade numpy
sudo -E pip install --upgrade gfortran
sudo -E pip install --upgrade scipy
sudo -E pip install --upgrade cython
sudo -E pip install --upgrade scikit
sudo -E pip install --upgrade matplotlib
sudo -E pip install --upgrade pydot
brew install graphviz
sudo -E pip install --upgrade pillow
sudo -E pip install --upgrade scikit-learn