Zoo Animal Classification using Naive Bayes.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Zoo Animal Classification using Naive Bayes\n",
    "<hr>\n",
    "\n",
    "Here we would be looking at yet another Classifier called Naive Bayes. We would be using the Zoo dataset which is a simple database containing 17 Boolean-valued attributes. The \"type\" attribute appears to be the class attribute. Here is a breakdown of which animals are in which type:\n",
    "\n",
    "Class# <-> Set of animals: \n",
    "1. (41) aardvark, antelope, bear, boar, buffalo, calf, cavy, cheetah, deer, dolphin, elephant, fruitbat, giraffe, girl, goat, gorilla, hamster, hare, leopard, lion, lynx, mink, mole, mongoose, opossum, oryx, platypus, polecat, pony, porpoise, puma, pussycat, raccoon, reindeer, seal, sealion, squirrel, vampire, vole, wallaby,wolf \n",
    "2. (20) chicken, crow, dove, duck, flamingo, gull, hawk, kiwi, lark, ostrich, parakeet, penguin, pheasant, rhea, skimmer, skua, sparrow, swan, vulture, wren \n",
    "3. (5) pitviper, seasnake, slowworm, tortoise, tuatara \n",
    "4. (13) bass, carp, catfish, chub, dogfish, haddock, herring, pike, piranha, seahorse, sole, stingray, tuna \n",
    "5. (4) frog, frog, newt, toad \n",
    "6. (8) flea, gnat, honeybee, housefly, ladybird, moth, termite, wasp \n",
    "7. (10) clam, crab, crayfish, lobster, octopus, scorpion, seawasp, slug, starfish, worm\n",
    "\n",
    "The dataset can be downloaded from https://archive.ics.uci.edu/ml/datasets/Zoo\n",
    "\n",
    "Place the saved `zoo.data` in the current directory as your code. We begin by importing the required modules:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "import os\n",
    "import pandas as pd\n",
    "import numpy as np\n",
    "from sklearn.cross_validation import train_test_split\n",
    "from sklearn import cross_validation, metrics\n",
    "from sklearn.naive_bayes import BernoulliNB\n",
    "from time import time\n",
    "from sklearn import preprocessing\n",
    "from sklearn.pipeline import Pipeline\n",
    "from sklearn.metrics import roc_auc_score , classification_report\n",
    "from sklearn.grid_search import GridSearchCV\n",
    "from sklearn.pipeline import Pipeline\n",
    "from sklearn.metrics import precision_score, recall_score, accuracy_score, classification_report"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We load the data in a Pandas dataframe as always and specify our column names."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "# read .csv from provided dataset\n",
    "csv_filename=\"zoo.data\"\n",
    "\n",
    "# df=pd.read_csv(csv_filename,index_col=0)\n",
    "df=pd.read_csv(csv_filename, \n",
    "              names=[\"Animal\", \"Hair\" , \"Feathers\" , \"Eggs\" , \"Milk\" , \"Airborne\",\n",
    "                     \"Aquatic\" , \"Predator\" , \"Toothed\" , \"Backbone\", \"Breathes\" , \"Venomous\",\n",
    "                     \"Fins\", \"Legs\", \"Tail\", \"Domestic\", \"Catsize\", \"Type\" ])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We'll have a look at our dataset:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Animal</th>\n",
       "      <th>Hair</th>\n",
       "      <th>Feathers</th>\n",
       "      <th>Eggs</th>\n",
       "      <th>Milk</th>\n",
       "      <th>Airborne</th>\n",
       "      <th>Aquatic</th>\n",
       "      <th>Predator</th>\n",
       "      <th>Toothed</th>\n",
       "      <th>Backbone</th>\n",
       "      <th>Breathes</th>\n",
       "      <th>Venomous</th>\n",
       "      <th>Fins</th>\n",
       "      <th>Legs</th>\n",
       "      <th>Tail</th>\n",
       "      <th>Domestic</th>\n",
       "      <th>Catsize</th>\n",
       "      <th>Type</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>aardvark</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>antelope</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>bass</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>bear</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>boar</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     Animal  Hair  Feathers  Eggs  Milk  Airborne  Aquatic  Predator  Toothed  \\\n",
       "0  aardvark     1         0     0     1         0        0         1        1   \n",
       "1  antelope     1         0     0     1         0        0         0        1   \n",
       "2      bass     0         0     1     0         0        1         1        1   \n",
       "3      bear     1         0     0     1         0        0         1        1   \n",
       "4      boar     1         0     0     1         0        0         1        1   \n",
       "\n",
       "   Backbone  Breathes  Venomous  Fins  Legs  Tail  Domestic  Catsize  Type  \n",
       "0         1         1         0     0     4     0         0        1     1  \n",
       "1         1         1         0     0     4     1         0        1     1  \n",
       "2         1         0         0     1     0     1         0        0     4  \n",
       "3         1         1         0     0     4     0         0        1     1  \n",
       "4         1         1         0     0     4     1         0        1     1  "
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Animal</th>\n",
       "      <th>Hair</th>\n",
       "      <th>Feathers</th>\n",
       "      <th>Eggs</th>\n",
       "      <th>Milk</th>\n",
       "      <th>Airborne</th>\n",
       "      <th>Aquatic</th>\n",
       "      <th>Predator</th>\n",
       "      <th>Toothed</th>\n",
       "      <th>Backbone</th>\n",
       "      <th>Breathes</th>\n",
       "      <th>Venomous</th>\n",
       "      <th>Fins</th>\n",
       "      <th>Legs</th>\n",
       "      <th>Tail</th>\n",
       "      <th>Domestic</th>\n",
       "      <th>Catsize</th>\n",
       "      <th>Type</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>96</th>\n",
       "      <td>wallaby</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>97</th>\n",
       "      <td>wasp</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>6</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>98</th>\n",
       "      <td>wolf</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>99</th>\n",
       "      <td>worm</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>100</th>\n",
       "      <td>wren</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      Animal  Hair  Feathers  Eggs  Milk  Airborne  Aquatic  Predator  \\\n",
       "96   wallaby     1         0     0     1         0        0         0   \n",
       "97      wasp     1         0     1     0         1        0         0   \n",
       "98      wolf     1         0     0     1         0        0         1   \n",
       "99      worm     0         0     1     0         0        0         0   \n",
       "100     wren     0         1     1     0         1        0         0   \n",
       "\n",
       "     Toothed  Backbone  Breathes  Venomous  Fins  Legs  Tail  Domestic  \\\n",
       "96         1         1         1         0     0     2     1         0   \n",
       "97         0         0         1         1     0     6     0         0   \n",
       "98         1         1         1         0     0     4     1         0   \n",
       "99         0         0         1         0     0     0     0         0   \n",
       "100        0         1         1         0     0     2     1         0   \n",
       "\n",
       "     Catsize  Type  \n",
       "96         1     1  \n",
       "97         0     6  \n",
       "98         1     1  \n",
       "99         0     7  \n",
       "100        0     2  "
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.tail()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['aardvark', 'antelope', 'bass', 'bear', 'boar', 'buffalo', 'calf',\n",
       "       'carp', 'catfish', 'cavy', 'cheetah', 'chicken', 'chub', 'clam',\n",
       "       'crab', 'crayfish', 'crow', 'deer', 'dogfish', 'dolphin', 'dove',\n",
       "       'duck', 'elephant', 'flamingo', 'flea', 'frog', 'fruitbat',\n",
       "       'giraffe', 'girl', 'gnat', 'goat', 'gorilla', 'gull', 'haddock',\n",
       "       'hamster', 'hare', 'hawk', 'herring', 'honeybee', 'housefly',\n",
       "       'kiwi', 'ladybird', 'lark', 'leopard', 'lion', 'lobster', 'lynx',\n",
       "       'mink', 'mole', 'mongoose', 'moth', 'newt', 'octopus', 'opossum',\n",
       "       'oryx', 'ostrich', 'parakeet', 'penguin', 'pheasant', 'pike',\n",
       "       'piranha', 'pitviper', 'platypus', 'polecat', 'pony', 'porpoise',\n",
       "       'puma', 'pussycat', 'raccoon', 'reindeer', 'rhea', 'scorpion',\n",
       "       'seahorse', 'seal', 'sealion', 'seasnake', 'seawasp', 'skimmer',\n",
       "       'skua', 'slowworm', 'slug', 'sole', 'sparrow', 'squirrel',\n",
       "       'starfish', 'stingray', 'swan', 'termite', 'toad', 'tortoise',\n",
       "       'tuatara', 'tuna', 'vampire', 'vole', 'vulture', 'wallaby', 'wasp',\n",
       "       'wolf', 'worm', 'wren'], dtype=object)"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['Animal'].unique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now this data contains textual data. The values are in String not in Integer or Float as we would like for our classifier. So we'll use LabelEncoder to transform the data:\n",
    "\n",
    "Next we convert the Legs column in a binarized form using the get_dummies method."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "#Convert animal labels to numbers\n",
    "le_animals = preprocessing.LabelEncoder()\n",
    "df['animals'] = le_animals.fit_transform(df.Animal)\n",
    " \n",
    "#Get binarized Legs columns\n",
    "df['Legs'] = pd.get_dummies(df.Legs)\n",
    "#types = pd.get_dummies(df.Type)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Our data now looks like:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Animal</th>\n",
       "      <th>Hair</th>\n",
       "      <th>Feathers</th>\n",
       "      <th>Eggs</th>\n",
       "      <th>Milk</th>\n",
       "      <th>Airborne</th>\n",
       "      <th>Aquatic</th>\n",
       "      <th>Predator</th>\n",
       "      <th>Toothed</th>\n",
       "      <th>Backbone</th>\n",
       "      <th>Breathes</th>\n",
       "      <th>Venomous</th>\n",
       "      <th>Fins</th>\n",
       "      <th>Legs</th>\n",
       "      <th>Tail</th>\n",
       "      <th>Domestic</th>\n",
       "      <th>Catsize</th>\n",
       "      <th>Type</th>\n",
       "      <th>animals</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>aardvark</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>antelope</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>bass</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>bear</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>boar</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     Animal  Hair  Feathers  Eggs  Milk  Airborne  Aquatic  Predator  Toothed  \\\n",
       "0  aardvark     1         0     0     1         0        0         1        1   \n",
       "1  antelope     1         0     0     1         0        0         0        1   \n",
       "2      bass     0         0     1     0         0        1         1        1   \n",
       "3      bear     1         0     0     1         0        0         1        1   \n",
       "4      boar     1         0     0     1         0        0         1        1   \n",
       "\n",
       "   Backbone  Breathes  Venomous  Fins  Legs  Tail  Domestic  Catsize  Type  \\\n",
       "0         1         1         0     0     0     0         0        1     1   \n",
       "1         1         1         0     0     0     1         0        1     1   \n",
       "2         1         0         0     1     1     1         0        0     4   \n",
       "3         1         1         0     0     0     0         0        1     1   \n",
       "4         1         1         0     0     0     1         0        1     1   \n",
       "\n",
       "   animals  \n",
       "0        0  \n",
       "1        1  \n",
       "2        2  \n",
       "3        3  \n",
       "4        4  "
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([1, 4, 2, 7, 6, 5, 3], dtype=int64)"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['Type'].unique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Our class values range from 1 to 7 denotin specific Animal type."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We specify our features and target variable"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "features=(list(df.columns[1:]))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['Hair',\n",
       " 'Feathers',\n",
       " 'Eggs',\n",
       " 'Milk',\n",
       " 'Airborne',\n",
       " 'Aquatic',\n",
       " 'Predator',\n",
       " 'Toothed',\n",
       " 'Backbone',\n",
       " 'Breathes',\n",
       " 'Venomous',\n",
       " 'Fins',\n",
       " 'Legs',\n",
       " 'Tail',\n",
       " 'Domestic',\n",
       " 'Catsize',\n",
       " 'Type',\n",
       " 'animals']"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "features"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "features.remove('Type')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "X = df[features]\n",
    "y = df['Type']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Hair</th>\n",
       "      <th>Feathers</th>\n",
       "      <th>Eggs</th>\n",
       "      <th>Milk</th>\n",
       "      <th>Airborne</th>\n",
       "      <th>Aquatic</th>\n",
       "      <th>Predator</th>\n",
       "      <th>Toothed</th>\n",
       "      <th>Backbone</th>\n",
       "      <th>Breathes</th>\n",
       "      <th>Venomous</th>\n",
       "      <th>Fins</th>\n",
       "      <th>Legs</th>\n",
       "      <th>Tail</th>\n",
       "      <th>Domestic</th>\n",
       "      <th>Catsize</th>\n",
       "      <th>animals</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Hair  Feathers  Eggs  Milk  Airborne  Aquatic  Predator  Toothed  Backbone  \\\n",
       "0     1         0     0     1         0        0         1        1         1   \n",
       "1     1         0     0     1         0        0         0        1         1   \n",
       "2     0         0     1     0         0        1         1        1         1   \n",
       "3     1         0     0     1         0        0         1        1         1   \n",
       "4     1         0     0     1         0        0         1        1         1   \n",
       "\n",
       "   Breathes  Venomous  Fins  Legs  Tail  Domestic  Catsize  animals  \n",
       "0         1         0     0     0     0         0        1        0  \n",
       "1         1         0     0     0     1         0        1        1  \n",
       "2         0         0     1     1     1         0        0        2  \n",
       "3         1         0     0     0     0         0        1        3  \n",
       "4         1         0     0     0     1         0        1        4  "
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As usual, we split our dataset to 60% training and 40% testing"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# split dataset to 60% training and 40% testing\n",
    "X_train, X_test, y_train, y_test = cross_validation.train_test_split(X, y, test_size=0.4, random_state=0)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "((60, 17), (60,))"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X_train.shape, y_train.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Finding Feature importances with forests of trees\n",
    "\n",
    "This examples shows the use of forests of trees to evaluate the importance of features on an artificial classification task. The red bars are the feature importances of the forest, along with their inter-trees variability."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Feature ranking:\n",
      "1. feature 3 - Milk (0.138606) \n",
      "2. feature 1 - Feathers (0.138508) \n",
      "3. feature 2 - Eggs (0.113904) \n",
      "4. feature 7 - Toothed (0.083274) \n",
      "5. feature 0 - Hair (0.083251) \n",
      "6. feature 8 - Backbone (0.082373) \n",
      "7. feature 9 - Breathes (0.076449) \n",
      "8. feature 11 - Fins (0.063457) \n",
      "9. feature 13 - Tail (0.050104) \n",
      "10. feature 12 - Legs (0.048997) \n",
      "11. feature 5 - Aquatic (0.035794) \n",
      "12. feature 4 - Airborne (0.035151) \n",
      "13. feature 16 - animals (0.016738) \n",
      "14. feature 15 - Catsize (0.011835) \n",
      "15. feature 6 - Predator (0.011787) \n",
      "16. feature 10 - Venomous (0.009257) \n",
      "17. feature 14 - Domestic (0.000515) \n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAABIAAAANDCAYAAADVc2TOAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAAPYQAAD2EBqD+naQAAIABJREFUeJzs3XuYl3WB///XDKAcRBRBUFFOLmqSAuNp/YaooChr5tUq\nNckiulu4aKZYtlmCeAqMljJBNNdN02XVbbezkY2H3XbRTNhylVwPCIIy21hiiSjC5/fH/JicAMXD\nJ+A9j8d13Vfwnvvzvt/vwT+6ntd935+aSqVSCQAAAADFqt3aCwAAAACgugQgAAAAgMIJQAAAAACF\nE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQgAIA/snTp0tTW1uaW\nW27Z2ksBAHhPCEAA0MbdfPPNqa2t3eRx8cUXV+26d911V6ZNm1a1+d+tmpqarb2Ed+W6667LzTff\nvLWXAQBsI9pv7QUAAFtfTU1NLr/88vTr16/V+ODBg6t2zR/+8IeZM2dOpk6dWrVrvFN9+/bNK6+8\nkg4dOmztpbxjc+bMSc+ePXPGGWds7aUAANsAAQgASJKccMIJGTZs2J/sepVKpSrzrl69Op07d37X\n8+ywww7vwWr+9F555ZV06tRpay8DANjGeAQMANhit956aw455JB07tw5u+22W+rr67N8+fJW5/z0\npz/N2LFj07dv33Ts2DH77LNPJk+enDVr1rScc+aZZ2bOnDlJ0vK4Wbt27ZIk9913X2pra/Pv//7v\nrebd1Ht5JkyYkK5du+bpp5/OmDFjsvPOO2fcuHEtP3/wwQdzwgknZJdddkmXLl1y9NFH57/+67/e\ncp9vdq1nn302J510Urp27Zo+ffq07OORRx7JyJEjs9NOO6Vfv36ZN29eqzk3PGr3H//xH5k4cWJ6\n9OiRbt265YwzzsiLL7640RrmzJmTwYMHp2PHjtlrr71y7rnnZtWqVa3OOfroo3PQQQdl4cKFOeqo\no9KlS5dcfPHF6d+/fx599NGW32VtbW2OPfbYJMlvf/vbfPrTn85BBx2Url27plu3bhkzZkx++ctf\ntpr7/vvvT21tbe68885ceeWV2XvvvdOpU6eMGjUqTz311EbrffDBBzNmzJh07949O+20Uw4++OBc\nc801rc55/PHHc+qpp2a33XZLp06dcuihh+Z73/teq3Nef/31TJs2LYMGDUqnTp3So0ePDB8+PA0N\nDW/1zwYAvAl3AAEASZJVq1blhRdeaDW22267tfz5yiuvzJQpU/LRj340H//4x/PrX/8611xzTUaM\nGJFFixZl5513TpLceeedeeWVVzJp0qTstttu+dnPfpavfe1rWbFiRW6//fYkydlnn53nnnsuP/nJ\nT3Lbbbe1uhuopqZmi9+/U1NTk9dffz2jR4/O8OHD8+Uvf7nl7p977rknY8aMySGHHJJLL700tbW1\n+cd//Mcce+yx+elPf5pDDjnkbf1+ampqsn79+px44okZMWJEvvSlL+W2227LJz/5yXTp0iWf//zn\nM27cuPzlX/5l5s6dmzPOOCNHHnlk+vbt22qec889N7vuumumTZuWxx9/PHPmzMmyZcty7733tpxz\n6aWX5rLLLsvxxx+fSZMmtZz385//PP/5n//ZEstqamrS1NSUMWPG5KMf/WjGjx+fXr165Zhjjsm5\n556brl275gtf+EIqlUp69eqVJHn66afz3e9+N6eddlr69++fxsbGXH/99Tn66KPz2GOPpXfv3q3W\nO3369LRr1y6f+cxnsmrVqsyYMSPjxo3LggULWs65++6788EPfjB77rlnzj///PTu3TuLFy/OD37w\ng5x33nlJkkcffTQf+MAH0qdPn3zuc59Lly5dcscdd+SUU07Jv/7rv+ZDH/pQkmTq1KmZPn16PvGJ\nT+TQQw/NSy+9lJ///OdZuHBhRo4c+bb+zQCAN6gAAG3aN77xjUpNTc1GR21tbcs5S5curbRv374y\nffr0Vp999NFHKx06dKh88YtfbBlbs2bNRteYPn16pV27dpVnn322Zezcc89tdY0N7rvvvkptbW3l\n/vvvbzX+zDPPVGpqaio333xzy9iECRMqtbW1lc9//vMbzTNo0KDKmDFjWo2tWbOmMmDAgMro0aM3\n9+t4y2vNmDGjZezFF1+sdO7cudKuXbvKnXfe2TL++OOPV2pqairTpk1rGdvwez7ssMMqr7/+esv4\nl770pUptbW3le9/7XqVSqVR+/etfV3bcccfKiSee2GpNs2fPrtTW1la+8Y1vtIwdffTRldra2srX\nv/71jfYwePDgyjHHHLPR+GuvvbbR2NKlSysdO3asXHHFFS1j9913X6WmpqZy4IEHtlrvNddcU6mt\nra08+uijlUqlUlm3bl2lf//+lQEDBlReeumljebeYOTIkZUhQ4ZU1q5d22r8//2//1fZb7/9Wv4+\nZMiQygc/+MHNzgMAvDMeAQMAUlNTk+uuuy4/+clPWo6777675eff+ta3UqlUctppp+WFF15oOXbf\nfff82Z/9Wau7V3bccceWP69evTovvPBC/vzP/zzr16/PokWLqrL+s88+u9Xf//u//ztPPPFE6uvr\nW633d7/7XUaOHLnR42Vvx1//9V+3/Llbt27Zb7/90qVLl5x66qkt44MGDcouu+ySp59+eqPPf+IT\nn2i5gydJ/vZv/zbt2rXLD3/4wyTNd9OsXbs2559/fqvPffzjH0/Xrl3zgx/8oNX4jjvumAkTJmzx\n+t/4Yuv169fnN7/5TTp37pz99tsvCxcu3Oj8s846q9V6hw8fnkql0rK3RYsW5Zlnnsn555+frl27\nbvKav/3tb3PvvffmtNNOa7nTbMNx/PHH54knnsjzzz+fJNlll13y6KOP5sknn9ziPQEAb80jYABA\nkuTQQw/d7Eugn3zyyaxfvz777rvvRj+rqalp9cLkZ599Npdcckm+973v5be//W2r8/74HTbvhfbt\n26dPnz6txp544okkyfjx4zf5mdra2qxatSrdunV7W9fq2LFjq8fikuYI9MfX3zD+xv0nzb+DP/4d\ndunSJXvssUeeeeaZJMmyZcuSNEekN+rQoUMGDBiQpUuXthrfa6+90r79lv9fukqlkq985Su57rrr\nsmTJkqxbt65lbT169Njo/L333rvV33fdddckadnbU089lZqamhx44IGbveaTTz6ZSqWSSy65JF/4\nwhc2+nlNTU3+7//+L3vssUcuu+yynHLKKRk0aFAGDx6cE044IX/1V3+V97///Vu8RwBgYwIQAPCW\n1q9fn9ra2vzoRz9Kbe3GNxDvtNNOLeeNGjUqL774Yj73uc+13B2zYsWKnHHGGVm/fv1bXmtz7//Z\nECr+2BvvOHrjepPky1/+cg4++OBNfm7Dmt+ON94JsyXjlSp909kbvd1v/NrwLqe/+Zu/yRVXXJHu\n3buntrY2n/rUpzb57/Ne7G3DvJ/+9KczevToTZ6zIYwNHz48Tz31VL7zne/kxz/+cf7hH/4hs2bN\nyvXXX5+zzjpri68JALQmAAEAb2ngwIGpVCrp16/fJu8C2uCRRx7JE088kW9+85s5/fTTW8Z/8pOf\nbHTu5kLPrrvumkqlstE3Y224Q2ZL15skXbt2bfn2q21BpVLJE088kREjRrSMvfzyy3n++efzF3/x\nF0nS8tLoxx9/PP369Ws5b+3atVmyZEmOO+64LbrW5n6/3/rWt3LsscfmhhtuaDX+4osvpmfPnm9n\nO0n+8N/G//zP/2z2dz1gwIAkzXcxbcm/xy677JIzzjgjZ5xxRlavXp3hw4fn0ksvFYAA4F3wDiAA\n4C19+MMfTm1tbaZNm7bJn//mN79J8oe7Rf74TpKvfOUrGwWJLl26JEleeumlVuN9+/ZNu3btNnpP\nz5w5c7b428Hq6uoycODAzJw5My+//PJGP29qatqiearhhhtuyOuvv97y9zlz5mTdunUZM2ZMkmTU\nqFHp0KHDRl+hfuONN+all17KSSedtEXX6dKlyya/Xr5du3Yb3b1z5513ZsWKFW93K0mSYcOGpX//\n/vnKV76y2Uf8evbsmaOPPjrXX399Vq5cudHP3/jvseG/pQ06d+6cfffdN6+++uo7Wh8A0MwdQADA\nWz7OM2DAgFxxxRW5+OKLs2TJkpxyyinp2rVrnn766Xz729/OxIkTM3ny5Oy///4ZOHBgLrzwwixf\nvjw777xzvvWtb20yRNTV1aVSqeSTn/xkRo8enXbt2uUjH/lIdt5555x22mktAWTgwIH5/ve/n1//\n+tdbvJ+amprceOONGTNmTA488MCceeaZ2WuvvbJixYrce++96datW77zne+8vV/Se+S1117LyJEj\nM3bs2PzqV7/Kddddl+HDh7eEnR49euRzn/tcLrvsspxwwgk5+eSTW8477LDDWt1Z9Wbq6uoyd+7c\nXHnlldl3332z++6755hjjslJJ52Uyy+/PGeddVaOPPLIPPLII7ntttta7pp6uza8QPzkk0/OkCFD\ncuaZZ2aPPfbIr371qzz22GO56667kiSzZ8/O8OHD8/73vz8f//jHM2DAgDQ2NmbBggVZsWJFywvC\n3/e+9+Xoo49OXV1dunfvnoceeij/8i//0vJ18gDAOyMAAQBbdGfNZz/72ey3336ZNWtWLrvssiTN\nLwjeECmS5hcyf//73895552X6dOnp2PHjvnwhz+cc845Z6N38Xz4wx/Oeeedl3/+53/Obbfdlkql\nko985CNJkq997Wt5/fXXc/3112fHHXfMRz7ykcycOTODBw/e4rWPGDEiCxYsyOWXX57Zs2fn97//\nfXr37p3DDz88EydOfEe/k81da3Pn/vF4TU1Nrr322tx2222ZOnVq1q5dm9NPPz1f/epXW503derU\n7L777rn22mszefLkdO/ePWeffXauvPLKjd7Js7k1TZkyJcuWLcuXvvSl/O53v8uIESNyzDHH5OKL\nL87q1avzT//0T7njjjtSV1eXH/7wh/m7v/u7Ta53S/Z7/PHH59577820adPy93//91m/fn0GDhyY\nT3ziEy3nHHDAAfn5z3+eadOm5eabb275FrmhQ4dmypQpLed96lOfyne/+93cfffdefXVV9O3b99c\nddVV+fSnP73JtQAAW6am8qd4OyEAQBt3880356yzzspDDz202W9bAwColqq/A2j27Nnp379/OnXq\nlCOOOCIPPfTQZs/9t3/7txx66KHZdddds9NOO2Xo0KG59dZbNzpvypQp2XPPPdO5c+ccd9xxefLJ\nJ6u5BQAAAIDtWlUD0O23354LL7ww06ZNy6JFi3LwwQdn9OjRm33x4m677ZYvfOELeeCBB/LII4/k\nzDPPzJlnnpm777675ZwZM2bk2muvzQ033JCf/exn6dKlS0aPHp3XXnutmlsBAHjX3HgNAGwtVX0E\n7Igjjsjhhx/e8lx7pVLJ3nvvnfPOOy8XXXTRFs1RV1eXk046qeVbR/bcc8985jOfyQUXXJCk+ZtD\nevXqlZtvvjljx46tzkYAAN4lj4ABAFtT1e4AWrt2bR5++OGMHDmyZaympiajRo3KggULtmiOhoaG\n/O///m9GjBiRJFmyZElWrlzZas6dd945hx9++BbPCQCwNZxxxhlZt26d+AMAbBVV+xawpqamrFu3\nLr169Wo13qtXrzz++OOb/dxLL72UvfbaK6+++mrat2+fOXPm5Nhjj02SrFy5MjU1NZucc+XKlW+6\nlvnz56dfv37p1KnTu9gVAAAAwLbjlVdeyTPPPJPRo0enR48emz1vm/sa+K5du+YXv/hFfv/736eh\noSEXXHBBBgwYkKOOOuodzzl//vyMGzfuPVwlAAAAwLbj1ltvzemnn77Zn1ctAPXo0SPt2rVLY2Nj\nq/HGxsb07t17s5+rqanJgAEDkiQHHXRQHnvssXzxi1/MUUcdld69e6dSqaSxsbHVXUCNjY0ZOnTo\nZufs169fkuZfxgEHHPAudrX9uOCCCzJr1qytvYw/mba236Tt7dl+y9bW9pu0vT3bb/na2p7tt2xt\nbb9J29uz/ZavLe158eLFGTduXEv72JyqBaAOHTqkrq4uDQ0NOfnkk5M0vwS6oaEh55133hbPs379\n+rz66qtJkv79+6d3795paGjIQQcdlKT5kbEHH3ww55xzzmbn2PDY1wEHHNBmnrvv1q1bm9lr0vb2\nm7S9Pdtv2drafpO2t2f7LV9b27P9lq2t7Tdpe3u23/K1xT2/1StvqvoI2OTJkzNhwoTU1dXlsMMO\ny6xZs7J69epMmDAhSTJ+/Pj06dMnV111VZJk+vTpOeSQQzJw4MC8+uqr+cEPfpBbb701c+fObZnz\n/PPPzxVXXJF99903/fr1yyWXXJI+ffrkQx/6UDW3AgAAALDdqmoAGjt2bJqamjJlypQ0NjZmyJAh\nmT9/fnr27JkkWb58edq3/8MSXn755ZxzzjlZvnx5OnXqlP333z+33XZbTj311JZzLrrooqxevToT\nJ07Miy++mOHDh+euu+7KDjvsUM2tbPPmzWs+kmTNmuS//is5/vikY8fmsfr65gMAAABoe6r+EuhJ\nkyZl0qRJm/zZPffc0+rvl19+eS6//PK3nPPSSy/NpZde+l4srxhvDDwLFyZ1dcn06Ukbu+MNAAAA\n2ITarb0AqqVt3e5T3wZvb2pre7bfsrW1/SZtb8/2W762tmf7LVtb22/S9vZsv+Vri3t+KzWVSqWy\ntRdRbQsXLkxdXV0efvjhNvESqA13AD38sDuAAAAAoGRb2jzcAQQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQOAEIAAAAoHACEAAAAEDh\nBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFK791l4AsGXmzWs+kmTNmmTp0qRv36Rjx+ax+vrm\nAwAAAP6YAATbiTcGnoULk7q65iA0bNjWXRcAAADbPo+AAQAAABSu6gFo9uzZ6d+/fzp16pQjjjgi\nDz300GbPvfHGG3PUUUele/fu6d69e4477riNzj/zzDNTW1vb6hgzZky1twEAAACw3apqALr99ttz\n4YUXZtq0aVm0aFEOPvjgjB49Ok1NTZs8//7778/HPvax3HfffXnggQey99575/jjj8/zzz/f6rwT\nTzwxjY2NWblyZVauXJl5G16MAgAAAMBGqhqAZs2alYkTJ2b8+PHZf//9M3fu3HTu3Dk33XTTJs//\n5je/mbPPPjsHHXRQBg0alBtvvDHr169PQ0NDq/N23HHH9OzZM7vvvnt23333dOvWrZrbAAAAANiu\nVS0ArV27Ng8//HBGjhzZMlZTU5NRo0ZlwYIFWzTHyy+/nLVr16Z79+6txu+777706tUr+++/fyZN\nmpTf/OY37+naAQAAAEpStQDU1NSUdevWpVevXq3Ge/XqlZUrV27RHJ/97Gez1157ZdSoUS1jJ554\nYm655Zbcc889ufrqq3P//fdnzJgxqVQq7+n6AQAAAEqxzX4N/PTp03PHHXfk/vvvzw477NAyPnbs\n2JY/H3jggXn/+9+fgQMH5r777ssxxxzzpnNecMEFGz0uVl9fn/oN360NAAAAsI2aN2/eRu9BXrVq\n1RZ9tmoBqEePHmnXrl0aGxtbjTc2NqZ3795v+tmZM2fm6quvTkNDQw488MA3Pbd///7p0aNHnnzy\nybcMQLNmzcqwYcO2bAMAAAAA25BN3cSycOHC1NXVveVnq/YIWIcOHVJXV9fqBc6VSiUNDQ058sgj\nN/u5q6++OldeeWXmz5+foUOHvuV1li9fnhdeeCF77LHHe7JuAAAAgNJU9VvAJk+enK9//eu55ZZb\n8qtf/Spnn312Vq9enQkTJiRJxo8fn4svvrjl/BkzZmTKlCm56aabss8++6SxsTGNjY15+eWXkzS/\nFPqiiy7Kgw8+mKVLl6ahoSGnnHJKBg0alNGjR1dzKwAAAADbraq+A2js2LFpamrKlClT0tjYmCFD\nhmT+/Pnp2bNnkua7d9q3/8MS5s6dm7Vr1+bUU09tNc/UqVMzZcqUtGvXLr/85S9zyy235MUXX8ye\ne+6Z0aNH57LLLkuHDh2quRUAAACA7VbVXwI9adKkTJo0aZM/u+eee1r9fcmSJW86V8eOHfOjH/3o\nPVsbAAAAQFtQ1UfAAAAAANj6BCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQA\nAABQOAEIAAAAoHACEAAAAEDhBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQA\nAABQuPZbewHwTsyb13wkyZo1ydKlSd++SceOzWP19c0HAAAAIACxnXpj4Fm4MKmraw5Cw4Zt3XUB\nAADAtsgjYAAAAACFE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQg\nAAAAgMIJQAAAAACFE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQg\nAAAAgMIJQAAAAACFE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQg\nAAAAgMIJQAAAAACFE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQg\nAAAAgMIJQAAAAACFE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQg\nAAAAgMIJQAAAAACFE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQg\nAAAAgMIJQAAAAACFE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQg\nAAAAgMIJQAAAAACFE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQg\nAAAAgMIJQAAAAACFE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQg\nAAAAgMIJQAAAAACFa7+1FwBAMm9e85Eka9YkS5cmffsmHTs2j9XXNx8AAADvhAAEsA14Y+BZuDCp\nq2sOQsOGbd11AQAAZfAIGAAAAEDhBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACic\nAAQAAABQuKoHoNmzZ6d///7p1KlTjjjiiDz00EObPffGG2/MUUcdle7du6d79+457rjjNnn+lClT\nsueee6Zz58457rjj8uSTT1ZzCwAAAADbtaoGoNtvvz0XXnhhpk2blkWLFuXggw/O6NGj09TUtMnz\n77///nzsYx/LfffdlwceeCB77713jj/++Dz//PMt58yYMSPXXnttbrjhhvzsZz9Lly5dMnr06Lz2\n2mvV3AoAAADAdquqAWjWrFmZOHFixo8fn/333z9z585N586dc9NNN23y/G9+85s5++yzc9BBB2XQ\noEG58cYbs379+jQ0NLSc89WvfjWXXHJJTjrppAwePDi33HJLnnvuuXz729+u5lYAAAAAtltVC0Br\n167Nww8/nJEjR7aM1dTUZNSoUVmwYMEWzfHyyy9n7dq16d69e5JkyZIlWblyZas5d9555xx++OFb\nPCcAAABAW1O1ANTU1JR169alV69ercZ79eqVlStXbtEcn/3sZ7PXXntl1KhRSZKVK1empqbmXc0J\nAAAA0Na039oL2Jzp06fnjjvuyP33358ddthhay8HAAAAYLtVtQDUo0ePtGvXLo2Nja3GGxsb07t3\n7zf97MyZM3P11VenoaEhBx54YMt47969U6lU0tjY2OouoMbGxgwdOvQt13TBBRekW7durcbq6+tT\nX1+/JVsCAAAA2GrmzZuXefPmtRpbtWrVFn22agGoQ4cOqaurS0NDQ04++eQkSaVSSUNDQ84777zN\nfu7qq6/OF7/4xfz4xz/eKOr0798/vXv3TkNDQw466KAkyUsvvZQHH3ww55xzzluuadasWRk2bNi7\n2BUAAADA1rGpm1gWLlyYurq6t/xsVR8Bmzx5ciZMmJC6urocdthhmTVrVlavXp0JEyYkScaPH58+\nffrkqquuStL8Fe9Tp07NvHnzss8++7TcPbTTTjulS5cuSZLzzz8/V1xxRfbdd9/069cvl1xySfr0\n6ZMPfehD1dwKAAAAwHarqgFo7NixaWpqypQpU9LY2JghQ4Zk/vz56dmzZ5Jk+fLlad/+D0uYO3du\n1q5dm1NJOINwAAAgAElEQVRPPbXVPFOnTs2UKVOSJBdddFFWr16diRMn5sUXX8zw4cNz1113eU8Q\nAAAAwGZU/SXQkyZNyqRJkzb5s3vuuafV35csWbJFc1566aW59NJL3+3SAAAAANqEqn0NPAAAAADb\nBgEIAAAAoHACEAAAAEDhBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQ\nOAEIAAAAoHACEAAAAEDhBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQ\nOAEIAAAAoHACEAAAAEDhBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQ\nOAEIAAAAoHACEAAAAEDhBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQ\nOAEIAAAAoHACEAAAAEDhBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQ\nOAEIAAAAoHACEAAAAEDhBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQ\nOAEIAAAAoHACEAAAAEDhBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQ\nOAEIAAAAoHACEAAAAEDhBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQ\nOAEIAAAAoHACEAAAAEDhBCAAAACAwglAAAAAAIUTgAAAAAAKJwABAAAAFE4AAgAAACicAAQAAABQ\nOAEIAAAAoHACEAAAAEDhBCAAAACAwglAAAAAAIVrv7UXALAp8+Y1H0myZk2ydGnSt2/SsWPzWH19\n8wEAAMBbE4CAbdIbA8/ChUldXXMQGjZs664LAABge+QRMAAAAIDCCUAAAAAAhROAAAAAAAonAAEA\nAAAUTgACAAAAKJwABAAAAFA4AQgAAACgcAIQAAAAQOEEIAAAAIDCCUAAAAAAhROAAAAAAAonAAEA\nAAAUTgACAAAAKJwABAAAAFA4AQgAAACgcAIQAAAAQOEEIAAAAIDCCUAAAAAAhROAAAAAAAonAAEA\nAAAUTgACAAAAKFzVA9Ds2bPTv3//dOrUKUcccUQeeuihzZ772GOP5dRTT03//v1TW1uba665ZqNz\npk2bltra2lbH+973vmpuAQAAAGC7VtUAdPvtt+fCCy/MtGnTsmjRohx88MEZPXp0mpqaNnn+6tWr\nM3DgwMyYMSN77LHHZucdPHhwGhsbs3LlyqxcuTI//elPq7UFAAAAgO1eVQPQrFmzMnHixIwfPz77\n779/5s6dm86dO+emm27a5PmHHHJIZsyYkbFjx2aHHXbY7Lzt27dPz549s/vuu2f33XdP9+7dq7UF\nAAAAgO1e1QLQ2rVr8/DDD2fkyJEtYzU1NRk1alQWLFjwruZ+4oknstdee2XgwIEZN25cnn322Xe7\nXAAAAIBiVS0ANTU1Zd26denVq1er8V69emXlypXveN4jjjgi3/jGNzJ//vzMnTs3S5YsyVFHHZWX\nX3753S4ZAAAAoEjtt/YC3q7Ro0e3/Hnw4ME57LDD0rdv39xxxx0588wzt+LKAAAAALZNVQtAPXr0\nSLt27dLY2NhqvLGxMb17937PrtOtW7cMGjQoTz755Fuee8EFF6Rbt26txurr61NfX/+erQcAAACg\nGubNm5d58+a1Glu1atUWfbZqAahDhw6pq6tLQ0NDTj755CRJpVJJQ0NDzjvvvPfsOr///e/z1FNP\nZfz48W957qxZszJs2LD37NoAAAAAfyqbuoll4cKFqaure8vPVvURsMmTJ2fChAmpq6vLYYcdllmz\nZmX16tWZMGFCkmT8+PHp06dPrrrqqiTNL45+7LHHUqlU8tprr2XFihX5xS9+kZ122ikDBw5Mknzm\nM5/JBz/4wfTt2zcrVqzI1KlT0759e3fxAAAAAGxGVQPQ2LFj09TUlClTpqSxsTFDhgzJ/Pnz07Nn\nzyTJ8uXL0779H5bw3HPPZejQoampqUmSzJw5MzNnzsyIESNyzz33tHzmYx/7WF544YX07NkzH/jA\nB/LAAw9kt912q+ZWAAAAALZbVX8J9KRJkzJp0qRN/mxD1Nmgb9++Wb9+/ZvO98fPugEAAADw5qr2\nNfAAAAAAbBu2u6+BB2D7N29e85Eka9YkS5cmffsmHTs2j9XXNx8AAMB7QwAC4E/ujYFn4cKkrq45\nCPmiRgAAqA6PgAEAAAAUTgACAAAAKJwABAAAAFA4AQgAAACgcAIQAAAAQOEEIAAAAIDCCUAAAAAA\nhROAAAAAAAonAAEAAAAUTgACAAAAKJwABAAAAFA4AQgAAACgcAIQAAAAQOEEIAAAAIDCCUAAAAAA\nhROAAAAAAArXfmsvoK1atmxZmpqaqjL34sWdkhyQxYsXJ3mlKtfo0aNH9tlnny0+v63tFwAAALYl\nAtBWsGzZshyw335ZvWZNla4wNMnCjBt3epJFVblC544ds/jxx7coirS1/QJsyrx5zUeSrFmTLF2a\n9O2bdOzYPFZf33wAAEA1CEBbQVNTU1avWZNbkxxQhfkXJxmXVHf+NWvS1NS0RUGkre0XYFPeGHgW\nLkzq6pqD0LBhW3ddAAC0DQLQVnRAkmr+//5qz/92tbX9AgAAwLbCS6ABAAAACicAAQAAABROAAIA\nAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQgAAAAgMIJQAAAAACFE4AAAAAACicAAQAAABROAAIA\nAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQgAAAAgMIJQAAAAACFE4AAAAAACicAAQAAABROAAIA\nAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQgAAAAgMIJQAAAAACFE4AAAAAACicAAQAAABROAAIA\nAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQgAAAAgMK139oLAADKM29e85Eka9YkS5cmffsmHTs2\nj9XXNx8AAPxpCEAAwHvujYFn4cKkrq45CA0btnXXBQDQVnkEDAAAAKBwAhAAAABA4QQgAAAAgMIJ\nQAAAAACFE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQgAAAAgMIJ\nQAAAAACFE4AAAAAACicAAQAAABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4dpv7QVAqZYt\nW5ampqaqzL14cackB2Tx4sVJXqnKNXr06JF99tmnKnMDAADwpyUAQRUsW7YsB+y3X1avWVOlKwxN\nsjDjxp2eZFFVrtC5Y8csfvxxEQgAAKAAAhBUQVNTU1avWZNbkxxQhfkXJxmXVHf+NWvS1NQkAAEA\nABRAAIIqOiDJsO14fgAAAMrgJdAAAAAAhROAAAAAAAonAAEAAAAUTgACAAAAKJwABAAAAFA4AQgA\nAACgcAIQAAAAQOEEIAAAAIDCCUAAAAAAhROAAAAAAAonAAEAAAAUTgACAAAAKJwABAAAAFA4AQgA\nAACgcAIQAAAAQOEEIAAAAIDCCUAAAAAAhROAAAAAAAonAAEAAAAUTgACAAAAKJwABAAAAFC49lt7\nAQAA27t585qPJFmzJlm6NOnbN+nYsXmsvr75AADYWqp+B9Ds2bPTv3//dOrUKUcccUQeeuihzZ77\n2GOP5dRTT03//v1TW1uba6655l3PCQBQbfX1yXe/23xMn5787/82/++GMfEHANjaqhqAbr/99lx4\n4YWZNm1aFi1alIMPPjijR49OU1PTJs9fvXp1Bg4cmBkzZmSPPfZ4T+YEAAAAaOuqGoBmzZqViRMn\nZvz48dl///0zd+7cdO7cOTfddNMmzz/kkEMyY8aMjB07NjvssMN7MicAAABAW1e1ALR27do8/PDD\nGTlyZMtYTU1NRo0alQULFmwzcwIAAACUrmoBqKmpKevWrUuvXr1ajffq1SsrV67cZuYEAAAAKF2b\n+hawCy64IN26dWs1Vl9fn3pvZgQAAAC2cfPmzcu8DV89+v9btWrVFn22agGoR48eadeuXRobG1uN\nNzY2pnfv3ltlzlmzZmXYsGHv6NoAAAAAW9OmbmJZuHBh6urq3vKzVXsErEOHDqmrq0tDQ0PLWKVS\nSUNDQ4488shtZk4AAACA0lX1EbDJkydnwoQJqaury2GHHZZZs2Zl9erVmTBhQpJk/Pjx6dOnT666\n6qokzS95fuyxx1KpVPLaa69lxYoV+cUvfpGddtopAwcO3KI5AQAAAGitqgFo7NixaWpqypQpU9LY\n2JghQ4Zk/vz56dmzZ5Jk+fLlad/+D0t47rnnMnTo0NTU1CRJZs6cmZkzZ2bEiBG55557tmhOAAAA\nAFqr+kugJ02alEmTJm3yZxuizgZ9+/bN+vXr39WcAAAAALRWtXcAAQAAALBtEIAAAAAACicAAQAA\nABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQgAAAAgMIJQAAAAACFE4AAAAAACicAAQAA\nABROAAIAAAAonAAEAAAAUDgBCAAAAKBwAhAAAABA4QQgAAAAgMK139oLAABg+zNvXvORJGvWJEuX\nJn37Jh07No/V1zcfAMC2QQACAOBte2PgWbgwqatrDkLDhm3ddQEAm+YRMAAAAIDCCUAAAAAAhROA\nAAAAAAonAAEAAAAUTgACAAAAKJwABAAAAFA4AQgAAACgcAIQAAAAQOEEIAAAAIDCCUAAAAAAhROA\nAAAAAAonAAEAAAAUrv3WXgBQhmXLlqWpqakqcy9e3CnJAVm8eHGSV6pyjR49emSfffbZ4vPb2n4B\nAIDtmwAEvGvLli3LAfvtl9Vr1lTpCkOTLMy4cacnWVSVK3Tu2DGLH398i6JIW9svAACw/ROAgHet\nqakpq9esya1JDqjC/IuTjEuqO/+aNWlqatqiINLW9pts/3c8Je56AgCgbROAgPfMAUmGbcfzv11t\nZb8l3PGUuOsJAIC2TQAC4E1t73c8tVzjbd71BAAAJRGAANgibeWOJwAAKJGvgQcAAAAonAAEAAAA\nUDgBCAAAAKBwAhAAAABA4QQgAAD4/9q79+i66jpvwJ+EFtJyqUAggUIvXNoG1NrW6UXEESjEonKx\nwhCoFQZYOBUR6gD1ZYHWG5c1YwcGsIoiYiUFncWgMghY5KJ2ANtSRUIBUQJio1EBaRuocN4/suxY\newWzc9qd51nrt9rs7P3b3+86JyfnfLIvAFBy7gIGAACspbW1eyRJV1fy1FPJ0KFJXV33spaW7gHA\n1kMABAAArOWvA57Fi5Nx47oDobFjq1sXAK+fU8AAAAAASk4ABAAAAFByTgEDgPVob29PZ2dnIXO3\ntQ1I0pS2trYkqwrZR319fYYMGVLI3AAAbH0EQADwN9rb29M0cmRWdnUVtIcxSRZn2rSTkiwpZA8D\n6+rStmyZEAgAgCQCIABYR2dnZ1Z2dWVekqYC5m9LMi0pdv6urnR2dgqAAABIIgACgA1qSlLkDW+K\nnh8AAP7CRaABAAAASk4ABAAAAFByAiAAAACAkhMAAQAAAJScAAgAAACg5ARAAAAAACUnAAIAAAAo\nOQEQAAAAQMkJgAAAAABKTgAEAAAAUHICIAAAAICSEwABAAAAlJwACAAAAKDkBEAAAAAAJScAAgAA\nACg5ARAAAABAyQmAAAAAAEpOAAQAAABQcv2qXQAAAGzpWlu7R5J0dSVPPZUMHZrU1XUva2npHgCw\npRIAAQDAJvx1wLN4cTJuXHcgNHZsdesCgM3lFDAAAACAkhMAAQAAAJScAAgAAACg5ARAAAAAACUn\nAAIAAAAoOXcBAwDS3t6ezs7OQuZuaxuQpCltbW1JVhWyj/r6+gwZMqSQuQEAykAABAB9XHt7e5pG\njszKrq6C9jAmyeJMm3ZSkiWF7GFgXV3ali0TAgEAbIAACAD6uM7Ozqzs6sq8JE0FzN+WZFpS7Pxd\nXens7BQAAQBsgAAIAEjSHc6M3YrnBwBgw1wEGgAAAKDkBEAAAAAAJScAAgAAACg5ARAAAABAyQmA\nAAAAAEpOAAQAAABQcgIgAAAAgJITAAEAAACUnAAIAAAAoOQEQAAAAAAlJwACAAAAKDkBEAAAAEDJ\nCYAAAAAASk4ABAAAAFByAiAAAACAkhMAAQAAAJScAAgAAACg5ARAAAAAACUnAAIAAAAoOQEQAAAA\nQMkJgAAAAABKTgAEAAAAUHKFB0BXXXVVhg8fngEDBmTixIl58MEHN7r+N7/5zTQ1NWXAgAEZPXp0\nbrvttrW+f8opp6S2tnatceSRRxbZAgAAAMBWrdAA6MYbb8zHPvaxzJ49O0uWLMno0aPT3Nyczs7O\n9a7/4x//OCeeeGJOP/30PPTQQzn66KNzzDHH5JFHHllrvSlTpqSjoyPLly/P8uXL09raWmQbAAAA\nAFu1QgOgOXPm5Iwzzsj06dMzatSozJ07NwMHDsy111673vWvuOKKTJkyJTNnzszIkSPzqU99KmPH\njs2VV1651nrbbbdddtttt+y+++7ZfffdM2jQoCLbAAAAANiqFRYArV69OosWLcphhx22ZllNTU0m\nT56chQsXrnebhQsXZvLkyWsta25uXmf9u+++Ow0NDRk1alRmzJiRP/zhDz3fAAAAAEBJ9Ctq4s7O\nzrzyyitpaGhYa3lDQ0OWLVu23m2WL1++3vWXL1++5uspU6Zk6tSpGT58eH7xi1/k4x//eI488sgs\nXLgwNTU1Pd8IAFA67e3tGzwl/e/V1jYgSVPa2tqSrCpkH/X19RkyZEghcwMA5VRYAFSU448/fs3/\nDzzwwLzpTW/Kvvvum7vvvjuHHHLIRrc955xz1jldrKWlJS0tLYXUCgBsedrb29M0cmRWdnUVtIcx\nSRZn2rSTkiwpZA8D6+rStmyZEAgA+pjW1tZ1roP8/PPPb9a2hQVA9fX12WabbdLR0bHW8o6OjjQ2\nNq53m8bGxte0fpIMHz489fX1eeKJJzYZAM2ZMydjx47dzA4AgDLq7OzMyq6uzEvSVMD8bUmmJcXO\n39WVzs7OzQ6AijziKXHUEwD0lvUdxLJ48eKMGzduk9sWFgD1798/48aNy4IFC3LUUUclSSqVShYs\nWJCzzjprvdtMmjRpne/feeedmTRp0gb388wzz+T3v/999thjj55tAAAotaYkRf5ZqOj5N1fxRzwl\njnoCgC1foaeAzZw5MyeffHLGjRuX8ePHZ86cOVm5cmVOPvnkJMn06dOz11575XOf+1yS5KMf/Wje\n+c535vOf/3ze/e53p7W1NYsWLco111yTJFmxYkVmz56dqVOnprGxMU888UTOP//8jBgxIs3NzUW2\nAgCwVSr6iKdkyzzqCQBYW6EB0PHHH5/Ozs5cdNFF6ejoyFve8pbcfvvt2W233ZJ0H73Tr9//lTBp\n0qTccMMNueCCC3LBBRdk//33zy233JIDDjggSbLNNtvkpz/9aa6//vo899xz2XPPPdPc3JxPfepT\n6d+/f5GtAABs1XrjiKQt5agnAGBdhV8EesaMGZkxY8Z6v3fXXXets2zq1KmZOnXqetevq6vL9773\nvR6tDwAAAKDsaqtdAAAAAADFEgABAAAAlJwACAAAAKDkBEAAAAAAJScAAgAAACg5ARAAAABAyQmA\nAAAAAEpOAAQAAABQcgIgAAAAgJITAAEAAACUnAAIAAAAoOQEQAAAAAAlJwACAAAAKDkBEAAAAEDJ\nCYAAAAAASk4ABAAAAFByAiAAAACAkhMAAQAAAJScAAgAAACg5ARAAAAAACUnAAIAAAAoOQEQAAAA\nQMkJgAAAAABKTgAEAAAAUHL9ql0AvB6tOSGtaUmSdGW7jMiyzMrFqctLSZKWtKYl86tZIgBQRe3t\n7ens7Cxk7ra2AUma0tbWlmRVIfuor6/PkCFDCpkbgL5JAMRWqSXzBTwAwHq1t7enaeTIrOzqKmgP\nY5IszrRpJyVZUsgeBtbVpW3ZMiEQAD1GAAQAQKl0dnZmZVdX5iVpKmD+tiTTkmLn7+pKZ2fnZgdA\njngCYFMEQAAAlFJTkrFb8fybyxFPAGwOARAAAGzF+uIRTwC8dgIgAAAogb5yxBMAr48ACAAAoI9p\nbe0eSdLVlTz1VDJ0aFJX172spaV7AOUhAAIAAOhj/jrgWbw4GTeuOxAa6zAvKC0BEAAA0Kc5Ggbo\nCwRAAABAn+ZoGKAvqK12AQAAAAAUSwAEAAAAUHICIAAAAICSEwABAAAAlJwACAAAAKDkBEAAAAAA\nJScAAgAAACg5ARAAAABAyQmAAAAAAEpOAAQAAABQcgIgAAAAgJITAAEAAACUXL9qFwAAAABFam3t\nHknS1ZU89VQydGhSV9e9rKWle0CZCYAAAAAotb8OeBYvTsaN6w6Exo6tbl3Qm5wCBgAAAFByAiAA\nAACAkhMAAQAAAJScAAgAAACg5ARAAAAAACUnAAIAAAAoOQEQAAAAQMn1q3YBAAAAQM9pbe0eSdLV\nlTz1VDJ0aFJX172spaV70LcIgAAAAKBE/jrgWbw4GTeuOxAaO7a6dVFdTgEDAAAAKDkBEAAAAEDJ\nCYAAAAAASk4ABAAAAFByAiAAAACAkhMAAQAAAJScAAgAAACg5ARAAAAAACXXr9oFAND3tOaEtKYl\nSdKV7TIiyzIrF6cuLyVJWtKalsyvZokAAFAqAiAAel1L5gt4AACgFwmAAACArUp7e3s6OzsLmbut\nbUCSprS1tSVZVcg+kqS+vj5DhgwpbH6AvyUAAgAAthrt7e1pGjkyK7u6CtrDmCSLM23aSUmWFLSP\nZGBdXdqWLRMCAb1GAAQAAGw1Ojs7s7KrK/OSNBUwf1uSaUlh86/ZR1dXOjs7BUBArxEAAQAAW52m\nJGO34vkBepvbwAMAAACUnAAIAAAAoOScAgYAvaA1J6Q1LUmSrmyXEVmWWbk4dXkpSdKS1rRkfjVL\nBACgxARAANALWjJfwAMAQNU4BQwAAACg5ARAAAAAACUnAAIAAAAoOdcAAgAA2MK1t7ens7OzkLnb\n2gYkaUpbW1uSVYXso76+PkOGDNns9ftav9AbBEAAAABbsPb29jSNHJmVXV0F7WFMksWZNu2kJEsK\n2cPAurq0LVu2WaFIX+sXeosACAAAYAvW2dmZlV1dmZekqYD525JMS4qdv6srnZ2dmxWI9LV+obcI\ngAAAALYCTUnGbsXzv1Z9rV8omotAAwAAAJScI4AAAACgilz0mt4gAAIAAIAqcdFreosACAAAAKrE\nRa/pLQIgAAAAqDIXvaZoAiAAAF6z1pyQ1rQkSbqyXUZkWWbl4tTlpSRJS1rTkvnVLBEA+CsCIAAA\nXrOWzBfwAMBWxG3gAQAAAEpOAAQAAABQcgIgAAAAgJITAAEAAACUnAAIAAAAoOQEQAAAAAAl5zbw\nAACwCa05Ia1pSZJ0ZbuMyLLMysWpy0tJkpa0piXzq1kiAGyUAAgA6HE+LFM2LZnvOQvAVk0ABGyR\nfHiErZsPywAAWxYBELBF8uERAACg5xR+Eeirrroqw4cPz4ABAzJx4sQ8+OCDG13/m9/8ZpqamjJg\nwICMHj06t9122zrrXHTRRdlzzz0zcODAHH744XniiSeKKh8AAABgq1doAHTjjTfmYx/7WGbPnp0l\nS5Zk9OjRaW5uTmdn53rX//GPf5wTTzwxp59+eh566KEcffTROeaYY/LII4+sWefSSy/NlVdemS99\n6Ut54IEHsv3226e5uTkvv/xyka0AAAAAW6jW1uSoo7rHEUckI0d2//uXZa2t1a6w+goNgObMmZMz\nzjgj06dPz6hRozJ37twMHDgw11577XrXv+KKKzJlypTMnDkzI0eOzKc+9amMHTs2V1555Zp1Lr/8\n8lx44YV5z3vekze+8Y25/vrr8+yzz+a///u/i2wFAAAA2EK1tCTf/nb3uOSS5LHHuv/9y7KWlmpX\nWH2FBUCrV6/OokWLcthhh61ZVlNTk8mTJ2fhwoXr3WbhwoWZPHnyWsuam5vXrP/kk09m+fLla825\n0047ZcKECRucEwAAAKCvK+wi0J2dnXnllVfS0NCw1vKGhoYsW7ZsvdssX758vesvX748SdLR0ZGa\nmpqNrgMAAPBauPso9K729vYNXhqmJ7S1DUjSlLa2tiSrCtlHfX19hgwZUsjcRXEXsCpqK3jeoufv\nre2q7e+p22O8ddjS+vX49ry+1rN+i91uc+f1M9xz+lrPW1q/feE5PTLz88lNBDyLe3B/W0LP65u3\nzI/x+ubVb8/Ov7na29vTNHJkVnZ1FVJPtzFJFmfatJOSLClkDwPr6tK2bNlWFQIVFgDV19dnm222\nSUdHx1rLOzo60tjYuN5tGhsbN7p+Y2NjKpVKOjo61joKqKOjI2PGjNlkTeecc04GDRq01rKWlpa0\n9PLJgPX19RlYV5dphT7hk2kFzj2wri719fWbtW5v9Vuk19Jv4jHeGm2J/Xp8e1Zf61m/G+ZneOvU\n13reEvv1nO5ZW2LPfe0x1m/Pea2fl3j9Wltb0/o3V7R+/vnnN2vbmkqlUimiqCSZOHFiJkyYkMsv\nvzxJUqlUMmTIkJx11lk599xz11n/hBNOyKpVq3LLLbesWXbQQQdl9OjRufrqq5Mke+65Z84999yc\nc845SZIXXnghDQ0Nuf7663Pcccett47Fixdn3LhxWbRoUcaOHdvTbb4uRR7y1tY2INOmNWXevLY0\nNW0Zh7sVfYhf0V7P4X0e463LltSvx7cYfa1n/W6cn+GtT1/reUvq13O6GFtSz33tMdZvz9uS+k22\nzJ6LtLmZR6EB0E033ZSTTz45c+fOzfjx4zNnzpx861vfyqOPPprddtst06dPz1577ZXPfe5zSbov\nAv3Od74zF198cd797nentbU1l1xySRYvXpwDDjggSXLZZZfl0ksvzXXXXZdhw4blwgsvzM9//vP8\n/L8WUUMAABgdSURBVOc/z7bbbrveOrbEAKhIixcn48YlixYlfaDdPsljXG4eX9i6+RmmbDyny6+v\nPcb6LafW1v+71XtXV/LUU8nQoUldXfeylpby3glsczOPQq8BdPzxx6ezszMXXXRROjo68pa3vCW3\n3357dttttyTJM888k379/q+ESZMm5YYbbsgFF1yQCy64IPvvv39uueWWNeFPkpx33nlZuXJlzjjj\njDz33HM5+OCDc9ttt20w/AEAAADKrcwBT08p/CLQM2bMyIwZM9b7vbvuumudZVOnTs3UqVM3Oucn\nP/nJfPKTn+yJ8gAAAABKr7baBQAAAABQLLeBBwD4O/3tdQdGjEhmzeob1x0A2Bp4nQYBEADA380H\nB4Atm9dpEAABAABAqTjiifURAAEAAECJCHhYHxeBBgAAACg5ARAAAABAyQmAAAAAAEpOAAQAAABQ\ncgIgAAAAgJITAAEAAACUnAAIAAAAoOQEQAAAAAAl16/aBQAAAFuW1tbukSRdXcmIEcmsWUldXfey\nlpbuAcDWQwAEAACsRcADUD5OAQMAAAAoOQEQAAAAQMk5BQwAAKCPcZ0n6HsEQAAAAH2MgAf6HqeA\nAQAAAJScAAgAAACg5ARAAAAAACUnAAIAAAAoOQEQAAAAQMkJgAAAAABKTgAEAAAAUHICIAAAAICS\nEwABAAAAlJwACAAAAKDkBEAAAAAAJScAAgAAACg5ARAAAABAyQmAAAAAAEpOAAQAAABQcgIgAAAA\ngJITAAEAAACUnAAIAAAAoOQEQAAAAAAlJwACAAAAKDkBEAAAAEDJCYAAAAAASk4ABAAAAFBy/apd\nAD2jtbV7JElXVzJiRDJrVlJX172spaV7AAAAAH2PAKgkBDwAAADAhjgFDAAAAKDkBEAAAAAAJScA\nAgAAACg5ARAAAABAyQmAAAAAAEpOAAQAAABQcgIgAAAAgJITAAEAAACUXL9qFwBsntbW7pEkXV3J\niBHJrFlJXV33spaW7gEAAAB/SwAEWwkBDwAAAK+XU8AAAAAASk4ABAAAAFByAiAAAACAkhMAAQAA\nAJScAAgAAACg5ARAAAAAACUnAAIAAAAoOQEQAAAAQMkJgAAAAABKTgAEAAAAUHICIAAAAICSEwAB\nAAAAlJwACAAAAKDkBEAAAAAAJScAAgAAACg5ARAAAABAyQmAAAAAAEpOAAQAAABQcgIgAAAAgJIT\nAAEAAACUnAAIAAAAoOQEQAAAAAAlJwACAAAAKDkBEAAAAEDJCYAAAAAASk4ABAAAAFByAiAAAACA\nkhMAAQAAAJScAAgAAACg5ARAAAAAACXXr9oFAJC0tnaPJOnqSkaMSGbNSurqupe1tHQPAACA10MA\nBLAFEPAAAABFcgoYAAAAQMkJgAAAAABKTgAEAAAAUHICIAAAAICSEwABAAAAlJwACAAAAKDkBEAA\nAAAAJScAAgAAACg5ARAAAABAyQmAAAAAAEpOAAQAAABQcgIgAAAAgJITAAEAAACUnACopFpbW6td\nQq/qa/0mfa9n/ZZbX+s36Xs967f8+lrP+i23vtZv0vd61m/59cWeN6WwAOiPf/xjTjrppAwaNCg7\n77xzTjvttKxYsWKj27z00kv58Ic/nPr6+uy44455//vfn9/+9rdrF1xbu9bYZpttctNNNxXVxlar\nrz3Z+1q/Sd/rWb/l1tf6Tfpez/otv77Ws37Lra/1m/S9nvVbfn2x500pLAA68cQT09bWlgULFuTW\nW2/NvffemzPOOGOj25x99tm59dZb81//9V+599578+yzz2bq1KnrrPe1r30tHR0dWb58eX7zm9/k\nmGOOKaoNAAAAgK1evyImffTRR3P77bdn0aJFGTNmTJLkP//zP/Pud787//Zv/5bGxsZ1tnnhhRdy\n7bXXZv78+fnHf/zHJMlXv/rVNDU15YEHHsj48ePXrDto0KDstttuRZQOAAAAUDqFHAG0cOHC7Lzz\nzmvCnySZPHlyampqcv/99693m0WLFuXPf/5zDjvssDXLRo4cmSFDhmThwoVrrfvhD384u+22WyZM\nmJCvfvWrRbQAAAAAUBqFHAG0fPny7L777mst22abbbLLLrtk+fLlG9xm2223zU477bTW8oaGhrW2\n+fSnP51DDz00AwcOzB133JEZM2ZkxYoVOfPMMzdYz6pVq5IkbW1tr7elrc7zzz+fxYsXV7uMXtPX\n+k36Xs/6Lbe+1m/S93rWb/n1tZ71W259rd+k7/Ws3/LrSz3/Jev4S/axQZXXYNasWZWampoNjtra\n2sqyZcsqn/vc5yqjRo1aZ/vdd9+9Mnfu3PXOfcMNN1Tq6urWWT5+/PjKrFmzNljTRRddVBkyZMhG\n6543b14liWEYhmEYhmEYhmEYRinHvHnzNpqNvKYjgP71X/81p5xyykbX2WeffdLY2LjO3bteeeWV\n/OEPf1jv9X+SpLGxMS+//HJeeOGFtY4C6ujo2OA2STJhwoR85jOfyerVq9O/f//1rtPc3Jx58+Zl\n2LBhGTBgwEbrBwAAANharFq1Kr/61a/S3Ny80fVeUwC06667Ztddd93kepMmTcpzzz2XJUuWrLkO\n0IIFC1KpVDJhwoT1bjNu3Lj069cvCxYsyLHHHpskWbZsWdrb2zNp0qQN7mvJkiXZeeedNxj+JEl9\nfX1OOumkTdYNAAAAsLU56KCDNrlOIdcAGjVqVJqbm3P66afnC1/4Ql5++eV85CMfSUtLy5qjeZ59\n9tkcdthh+frXv563vvWt2WmnnXLqqadm5syZ2XnnnbPjjjvmrLPOykEHHbTmDmDf/e5309HRkYkT\nJ6auri533HFHLr744px33nlFtAEAAABQCoUEQElyww035Mwzz8zkyZNTW1ub97///bn88svXfH/1\n6tV57LHHsnLlyjXL5syZk2222Sbvf//789JLL+Vd73pXrrrqqjXf79+/f6666qrMnDkzlUol++23\nX/7jP/4jp512WlFtAAAAAGz1aiqVSqXaRQAAAABQnNpqFwAAAABAsQRAJTJ37tyMHj06gwYNyqBB\ng/K2t70t3/ve96pdVmHuu+++HHXUURk8eHBqa2vz7W9/u9olFeriiy/O+PHjs9NOO6WhoSHHHnts\nHnvssWqXVajhw4entrZ2nfGRj3yk2qUV6qqrrsrw4cMzYMCATJw4MQ8++GC1SyrEq6++mgsvvDD7\n7LNPBg4cmP322y+f+cxnql1WoV588cWcffbZGTZsWAYOHJi3v/3t+clPflLtsnrMpl6Xb7755jQ3\nN6e+vj61tbX56U9/WqVKe8am+p09e3aampqyww47ZJdddsnhhx+eBx54oErV/v021u+f//znnH/+\n+Xnzm9+cHXbYIYMHD84HP/jB/OY3v6lixT1v9uzZ6/xOOuCAA6pdVq+45JJLUltbm5kzZ1a7lB6z\nOe8l29racvTRR+cNb3hDdthhh0yYMCHPPPNMFar9+22q31NOOWWd5/eRRx5ZpWqL8+yzz+YDH/hA\n6uvrM3DgwIwePTqLFy+udlk9YnOe0xdddFH23HPPDBw4MIcffnieeOKJKlTaM17L58EPfehDqa2t\nzRVXXNGLFW55BEAlsvfee+fSSy/N4sWLs2jRohx66KE5+uij09bWVu3SCrFixYq85S1vydVXX52a\nmppql1O4++67Lx/5yEdy//335/vf/35Wr16dI444IqtWrap2aYX5yU9+kuXLl68Zd955Z2pqanL8\n8cdXu7TC3HjjjfnYxz6W2bNnZ8mSJRk9enSam5vT2dlZ7dJ63CWXXJIvfvGLufrqq/Poo4/msssu\ny2WXXZYrr7yy2qUV5tRTT82CBQvyjW98Iw8//HAOP/zwTJ48uTQfkjf1urxixYocfPDBueyyy0rx\nur2pfkeOHJmrrroqDz/8cH70ox9l2LBhOeKII/L73/++CtX+/TbW78qVK/PQQw/lE5/4RJYsWZKb\nb745y5Yty9FHH12laovzxje+MR0dHWt+N/3whz+sdkmFe/DBB/OlL30po0ePrnYpPWpTP8O/+MUv\ncvDBB+eAAw7Ivffem5/97Ge58MILU1dXV4Vq/36b8955ypQpaz2/W1tbe7nKYj333HM56KCDst12\n2+X2229PW1tb/v3f/z0777xztUvrEZt6jC+99NJceeWV+dKXvpQHHngg22+/fZqbm/Pyyy9Xodq/\n3+Z+Hrz55ptz//33Z/Dgwb1Y3RaqQqntsssulWuvvbbaZRSupqamcsstt1S7jF71u9/9rlJTU1O5\n7777ql1Kr/noRz9a2X///atdRqEmTJhQOeuss9Z8/eqrr1YGDx5cufTSS6tYVTHe8573VE477bS1\nlk2dOrXygQ98oEoVFWvVqlWVfv36VW677ba1lo8bN65y4YUXVqmq4mzsdflXv/pVpaamprJ06dJe\nrqo4m/N76IUXXqjU1NRU7rrrrl6qqjib0++DDz5Yqa2trTz99NO9VFXxPvnJT1bGjBlT7TJ61Z/+\n9KfKiBEjKgsWLKi8853vrJxzzjnVLqkQ63tOn3DCCZXp06dXqaJira/fk08+uXLsscdWqaLecf75\n51fe8Y53VLuMXrG+x3iPPfaofP7zn1/z9fPPP1+pq6ur3Hjjjb1dXo/b0O+lZ555prL33ntXHnnk\nkcqwYcMql19+eRWq23I4AqikXn311cyfPz8rV67MpEmTql0OBXjuuedSU1OTXXbZpdql9IrVq1fn\nG9/4Rk499dRql1KY1atXZ9GiRTnssMPWLKupqcnkyZOzcOHCKlZWjLe97W1ZsGBBHn/88STJ0qVL\n86Mf/aiUh5sn3afIvPLKK9luu+3WWj5gwIA+cQRBX7d69ep88YtfzBve8IbSHUWxIX/5PfWGN7yh\n2qX0qMcffzyDBw/Ovvvum2nTpuXpp5+udkmF+vCHP5z3vve9OfTQQ6tdSq+qVCq59dZbs//+++dd\n73pXGhoaMnHixNxyyy3VLq1Qd999dxoaGjJq1KjMmDEjf/jDH6pdUo/6zne+k7e+9a05/vjj09DQ\nkLFjx+bLX/5ytcvqFb/85S+zfPnytd5n7rTTTpkwYUIp32cm3T/H06dPz3nnnZempqZql7NFEACV\nzMMPP5wdd9wx2223XWbMmJGbb745o0aNqnZZ9LBKpZKzzz47b3/72/vMtQduvvnmPP/88/ngBz9Y\n7VIK09nZmVdeeSUNDQ1rLW9oaMjy5curVFVxZs2alX/6p3/KqFGjsu2222bcuHE5++yzc8IJJ1S7\ntELssMMOmTRpUj796U/nN7/5TV599dXMmzcvCxcuLM0pYKzr1ltvzY477pi6urpcfvnlufPOO/tE\ncP/SSy9l1qxZOfHEE7PDDjtUu5weM3HixFx33XW5/fbbM3fu3Pzyl7/MO97xjqxYsaLapRVi/vz5\neeihh3LxxRdXu5Re99vf/jYvvvhiLr300hx55JG58847c+yxx+Z973tf7rvvvmqXV4gpU6bk+uuv\nz1133ZXLLrss99xzT4488shUSnTT6CeffDJf+MIXMnLkyNxxxx35l3/5l5x11ln5+te/Xu3SCrd8\n+fLU1NT0mfeZSfflBrbddtuceeaZ1S5li9Gv2gXQs0aNGpWlS5fm+eefz7e+9a1Mnz499957rxCo\nZGbMmJFHHnkkP/rRj6pdSq+59tprM2XKlDQ2Nla7FHrIjTfemBtuuCHz58/PAQcckIceeigf/ehH\ns+eee+YDH/hAtcsrxLx58/LP//zPGTx4cPr165exY8fmxBNPzKJFi6pdGgU59NBDs3Tp0nR2duaa\na67JcccdlwceeCD19fXVLq0wf/7zn3PcccelpqYmV199dbXL6VHNzc1r/v/GN74x48ePz9ChQ3PT\nTTfllFNOqWJlPe+ZZ57J2Wefne9///vp379/tcvpda+++mqS5JhjjslZZ52VJHnzm9+cH//4x5k7\nd24OPvjgapZXiL++xuKBBx6YN73pTdl3331z991355BDDqliZT3n1Vdfzfjx4/PpT386STJ69Og8\n/PDDmTt3bmnfe/RVixYtyhVXXJElS5ZUu5QtiiOASqZfv37ZZ599MmbMmHz2s5/N6NGjc/nll1e7\nLHrQmWeemf/5n//J3XffnT322KPa5fSK9vb2fP/738/pp59e7VIKVV9fn2222SYdHR1rLe/o6Chl\n8HXeeefl4x//eI477rgceOCBOemkk3LOOeeU+i/Nw4cPzw9+8IOsWLEiTz/9dP73f/83L7/8cvbZ\nZ59ql0ZBBgwYkH322Sfjx4/PNddck379+uUrX/lKtcsqzF/Cn6effjp33HFHqY7+WZ9BgwZlxIgR\nW/VddDZk0aJF+d3vfpexY8emf//+6d+/f+65555cfvnl2XbbbUt1VMj61NfXp1+/fuucNtLU1JT2\n9vYqVdW7hg8fnvr6+lI9v/fYY48++5g2NjamUqn0mfeZP/zhD/O73/0ue++995rXsKeeeiozZ87s\n0++7BEAl9+qrr+all16qdhn0kDPPPDO33HJLfvCDH2TIkCHVLqfXXHvttWloaCjttWH+on///hk3\nblwWLFiwZlmlUsmCBQvytre9rYqVFWPlypXr3LGhtrZ2zV9dy2zAgAFpaGjIH//4x9x+++055phj\nql1SryvDXcBejzL/Xv5L+PPkk09mwYIFpbmrzsa8+OKL+cUvflHKP8hMnjw5P/vZz/LQQw9l6dKl\nWbp0ad761rdm2rRpWbp0ael/hvv3759/+Id/yLJly9Za/thjj2Xo0KFVqqp3PfPMM/n9739fquf3\nQQcdtM5jumzZsj7xmA4fPjyNjY1rvc984YUXcv/995fyfeb06dPz05/+dM3r19KlS7PnnnvmvPPO\ny+23317t8qrGKWAl8v/+3//LlClTMmTIkPzpT3/KN77xjdxzzz254447ql1aIVasWJEnnnhizV+g\nnnzyySxdujS77LJL9t577ypX1/NmzJiR1tbWfPvb387222+/Jr0fNGjQVns70s1RqVRy3XXX5eST\nT05tbfkz65kzZ+bkk0/OuHHjMn78+MyZMycrV67MySefXO3Setx73/vefPazn83ee++dAw88MIsX\nL86cOXNy2mmnVbu0wtxxxx2pVCoZOXJkHn/88Zx33nk54IADSvP4bup1+Y9//GPa29vz61//OpVK\nJY8++mgqlUoaGxvXuSbB1mBj/e6666757Gc/m6OOOip77LFHOjs7c+WVV+bZZ5/NcccdV+XKX5+N\n9bvHHntk6tSpeeihh/Ld7343q1evXvN7apdddinNKUTnnntu3vve92bo0KH59a9/nU984hPp169f\nWlpaql1aj9t+++3Xuc7g9ttvn1133bU0F1Pd1GvWueeemxNOOCEHH3xwDjnkkNx222357ne/m3vu\nuafKlb8+G+t3l112yezZszN16tQ0NjbmiSeeyPnnn58RI0asderj1u6cc87JQQcdlIsvvjjHH398\n7r///nz5y1/ONddcU+3SesSmntNnn312PvOZz2S//fbLsGHDcuGFF2avvfbK0UcfXeXKX59N9fu3\nf4jo379/Ghsbs//++1ej3C1DL991jAKdeuqpleHDh1fq6uoqDQ0NlcMPP7yyYMGCapdVmLvvvrtS\nU1NTqa2tXWuccsop1S6tEOvrtba2tvK1r32t2qUV6o477qjU1tZWHn/88WqX0muuuuqqytChQyt1\ndXWViRMnVh588MFql1SIF198sXLOOedUhg0bVhk4cGBlv/32q1x00UWV1atXV7u0wtx0002Vfffd\nt1JXV1fZc889K2eddVblhRdeqHZZPWZTr8vXXXfder8/e/bsKlf++mys366ursr73ve+yl577VWp\nq6urDB48uHLMMcdUFi1aVO2yX7eN9furX/1qne/95et77rmn2qX3mBNOOKEyePDgSl1dXWXvvfeu\ntLS0VJ588slql9VrDjnkkFLdBn5z3kt+9atfrey///6VgQMHVsaMGVP5zne+U8WK/z4b63fVqlWV\n5ubmSkNDQ2W77barDB8+vPKhD32o8tvf/rbaZfe4W2+9tfKmN72pMmDAgMoBBxxQ+cpXvlLtknrM\n5jynP/GJT1T22GOPyoABAypHHHHEVv0e+7V+Hhw+fHifvw18TaVS8hN4AQAAAPq48p9PAQAAANDH\nCYAAAAAASk4ABAAAAFByAiAAAACAkhMAAQAAAJScAAgAAACg5ARAAAAAACUnAAIAAAAoOQEQAAAA\nQMkJgAAAAABKTgAEAAAAUHICIAAAAICS+//I21cE8QXIVQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x9d82240>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "%matplotlib inline\n",
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "from sklearn.ensemble import ExtraTreesClassifier\n",
    "\n",
    "# Build a classification task using 3 informative features\n",
    "\n",
    "# Build a forest and compute the feature importances\n",
    "forest = ExtraTreesClassifier(n_estimators=250,\n",
    "                              random_state=0)\n",
    "\n",
    "forest.fit(X, y)\n",
    "importances = forest.feature_importances_\n",
    "std = np.std([tree.feature_importances_ for tree in forest.estimators_],\n",
    "             axis=0)\n",
    "indices = np.argsort(importances)[::-1]\n",
    "\n",
    "# Print the feature ranking\n",
    "print(\"Feature ranking:\")\n",
    "\n",
    "for f in range(X.shape[1]):\n",
    "    print(\"%d. feature %d - %s (%f) \" % (f + 1, indices[f], features[indices[f]], importances[indices[f]]))\n",
    "\n",
    "# Plot the feature importances of the forest\n",
    "plt.figure(num=None, figsize=(14, 10), dpi=80, facecolor='w', edgecolor='k')\n",
    "plt.title(\"Feature importances\")\n",
    "plt.bar(range(X.shape[1]), importances[indices],\n",
    "       color=\"r\", yerr=std[indices], align=\"center\")\n",
    "plt.xticks(range(X.shape[1]), indices)\n",
    "plt.xlim([-1, X.shape[1]])\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 0.13860564,  0.13850845,  0.11390376,  0.083274  ,  0.08325078])"
      ]
     },
     "execution_count": 29,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "importances[indices[:5]]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "collapsed": false,
    "scrolled": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "1. feature 3 - Milk (0.138606)\n",
      "2. feature 1 - Feathers (0.138508)\n",
      "3. feature 2 - Eggs (0.113904)\n",
      "4. feature 7 - Toothed (0.083274)\n",
      "5. feature 0 - Hair (0.083251)\n"
     ]
    }
   ],
   "source": [
    "for f in range(5):\n",
    "    print(\"%d. feature %d - %s (%f)\" % (f + 1, indices[f], features[indices[f]] ,importances[indices[f]]))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "best_features = []\n",
    "for i in indices[:5]:\n",
    "    best_features.append(features[i])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAq8AAAINCAYAAAAQtZZ4AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAAPYQAAD2EBqD+naQAAIABJREFUeJzs3XtclGX+//H3DKAcRDyA4FnUPKfImId2NRUUNTNblW+Y\ni9jW4hfNFMvvpomHzNTcpVw11/xamkZWtrXVmtWYdjIzMXOTTMtDHphtNPWbiKLevz/4OdsEeChG\n5tLX8/GYR3DNdV/3556rgTe3132PzbIsSwAAAIAB7BVdAAAAAHC5CK8AAAAwBuEVAAAAxiC8AgAA\nwBiEVwAAABiD8AoAAABjEF4BAABgDMIrAAAAjEF4BQAAgDEIrwBQAfbt2ye73a7ly5dXdCkAYBTC\nKwCfW7Zsmex2e6mPiRMn+my/a9as0bRp03w2/q9ls9kquoRf5amnntKyZcsqugwA15nAii4AwPXB\nZrPpkUceUaNGjbza27Rp47N9/vOf/9TChQs1ZcoUn+3jl2rYsKFOnTqloKCgii7lF1u4cKGioqI0\nfPjwii4FwHWE8ArgqunTp4/i4+Ov2v4sy/LJuAUFBQoNDf3V41SqVKkcqrn6Tp06pZCQkIouA8B1\nimUDAPzKihUr1KFDB4WGhqpmzZpKSUnRgQMHvPp8+OGHSk5OVsOGDRUcHKwGDRooMzNThYWFnj4j\nRozQwoULJcmzRCEgIECStH79etntdr3//vte45a2DjUtLU3h4eH69ttv1a9fP1WtWlXDhg3zPL9p\n0yb16dNH1apVU1hYmLp3766PP/74ksd5sX1999136t+/v8LDw1WvXj3PcWzfvl0JCQmqUqWKGjVq\npJycHK8xLyzP+OCDD5Senq7IyEhFRERo+PDhOnbsWIkaFi5cqDZt2ig4OFh169bV6NGjdfz4ca8+\n3bt3V9u2bZWbm6tu3bopLCxMEydOVGxsrL788kvPa2m329WzZ09J0g8//KAHHnhAbdu2VXh4uCIi\nItSvXz998cUXXmNv2LBBdrtdL730kh599FHVr19fISEhSkxM1DfffFOi3k2bNqlfv36qUaOGqlSp\nonbt2mnevHlefXbu3KnBgwerZs2aCgkJ0U033aTXX3/dq8/Zs2c1bdo0NWvWTCEhIYqMjFTXrl3l\ndDovNW0A/ABnXgFcNcePH9eRI0e82mrWrOn5+tFHH1VWVpbuvPNO3Xvvvfr+++81b9483XLLLdq6\ndauqVq0qSXrppZd06tQpZWRkqGbNmvr000/117/+VQcPHtSqVaskSSNHjtShQ4f07rvvauXKlV5n\nYW0222WvN7XZbDp79qySkpLUtWtX/fnPf/acdV23bp369eunDh06aOrUqbLb7XrmmWfUs2dPffjh\nh+rQocMVvT42m03nz59X3759dcstt+jxxx/XypUrdd999yksLEyTJk3SsGHDNGjQIC1atEjDhw/X\nzTffrIYNG3qNM3r0aFWvXl3Tpk3Tzp07tXDhQu3fv1/vvfeep8/UqVM1ffp09e7dWxkZGZ5+n332\nmT766CNP0LfZbHK73erXr5/uvPNOpaamKjo6Wj169NDo0aMVHh6uhx9+WJZlKTo6WpL07bff6h//\n+IeGDBmi2NhYuVwu/e1vf1P37t21Y8cOxcTEeNU7a9YsBQQE6MEHH9Tx48c1e/ZsDRs2TBs3bvT0\neeedd3TbbbepTp06Gjt2rGJiYpSXl6c333xTY8aMkSR9+eWX+u1vf6t69erpoYceUlhYmF588UUN\nHDhQr7zyim6//XZJ0pQpUzRr1iz98Y9/1E033aQTJ07os88+U25urhISEq5ozgBUAAsAfOzZZ5+1\nbDZbiYfdbvf02bdvnxUYGGjNmjXLa9svv/zSCgoKsh577DFPW2FhYYl9zJo1ywoICLC+++47T9vo\n0aO99nHB+vXrLbvdbm3YsMGrfe/evZbNZrOWLVvmaUtLS7Psdrs1adKkEuM0a9bM6tevn1dbYWGh\n1bhxYyspKamsl+OS+5o9e7an7dixY1ZoaKgVEBBgvfTSS572nTt3WjabzZo2bZqn7cLr3LFjR+vs\n2bOe9scff9yy2+3W66+/blmWZX3//fdW5cqVrb59+3rVtGDBAstut1vPPvusp6179+6W3W63nn76\n6RLH0KZNG6tHjx4l2s+cOVOibd++fVZwcLA1Y8YMT9v69estm81mtW7d2qveefPmWXa73fryyy8t\ny7Ksc+fOWbGxsVbjxo2tEydOlBj7goSEBCsuLs4qKiryav/Nb35jNW/e3PN9XFycddttt5U5DgD/\nxrIBAFeFzWbTU089pXfffdfzeOeddzzPr169WpZlaciQITpy5IjnUatWLd1www1eZw0rV67s+bqg\noEBHjhxRly5ddP78eW3dutUn9Y8cOdLr+88//1y7du1SSkqKV73/93//p4SEhBJLEq7EH/7wB8/X\nERERat68ucLCwjR48GBPe7NmzVStWjV9++23Jbb/4x//6DlzKkn//d//rYCAAP3zn/+UVHwWs6io\nSGPHjvXa7t5771V4eLjefPNNr/bKlSsrLS3tsuv/6UVo58+f19GjRxUaGqrmzZsrNze3RP+7777b\nq96uXbvKsizPsW3dulV79+7V2LFjFR4eXuo+f/jhB7333nsaMmSI5wz/hUfv3r21a9cuHT58WJJU\nrVo1ffnll9q9e/dlHxMA/8GyAQBXzU033VTmBVu7d+/W+fPn1bRp0xLP2Ww2r4ubvvvuO02ePFmv\nv/66fvjhB69+P1+zWR4CAwNVr149r7Zdu3ZJklJTU0vdxm636/jx44qIiLiifQUHB3stpZCKA+zP\n93+h/afHLxW/Bj9/DcPCwlS7dm3t3btXkrR//35JxQH4p4KCgtS4cWPt27fPq71u3boKDLz8XxeW\nZemJJ57QU089pT179ujcuXOe2iIjI0v0r1+/vtf31atXlyTPsX3zzTey2Wxq3bp1mfvcvXu3LMvS\n5MmT9fDDD5d43maz6d///rdq166t6dOna+DAgWrWrJnatGmjPn366Pe//71uvPHGyz5GABWH8ArA\nL5w/f152u11vvfWW7PaS/yhUpUoVT7/ExEQdO3ZMDz30kOes5MGDBzV8+HCdP3/+kvsqa73rhZD1\ncz890/vTeiXpz3/+s9q1a1fqdhdqvhI/PQN5Oe2Wj+6o8FNXemeBC2uX77nnHs2YMUM1atSQ3W7X\n/fffX+r8lMexXRj3gQceUFJSUql9LoT6rl276ptvvtFrr72mt99+W//7v/+r7Oxs/e1vf9Pdd999\n2fsEUDEIrwD8QpMmTWRZlho1alTq2dcLtm/frl27dum5557TXXfd5Wl/9913S/QtK6RWr15dlmWV\nuAL/wpnJy61XksLDwz1X2fsDy7K0a9cu3XLLLZ62kydP6vDhw7r11lslyXOB186dO73uu1tUVKQ9\ne/aoV69el7Wvsl7f1atXq2fPnlq8eLFX+7FjxxQVFXUlhyPpP/9v/Otf/yrztW7cuLGk4rPHlzMf\n1apV0/DhwzV8+HAVFBSoa9eumjp1KuEVMABrXgH4hd/97ney2+1lfiLW0aNHJf3nLN3Pz+A98cQT\nJcJUWFiYJOnEiRNe7Q0bNlRAQECJdakLFy687LsQOBwONWnSRHPnztXJkydLPO92uy9rHF9YvHix\nzp496/l+4cKFOnfunPr16ydJSkxMVFBQUInbTC1ZskQnTpxQ//79L2s/YWFhpd6CKyAgoMRZ05de\nekkHDx680kORJMXHxys2NlZPPPFEmctCoqKi1L17d/3tb39Tfn5+ied/Oh8X/l+6IDQ0VE2bNtXp\n06d/UX0Ari7OvAK4Ki71T8CNGzfWjBkzNHHiRO3Zs0cDBw703F/11VdfVXp6ujIzM9WiRQs1adJE\n48eP14EDB1S1alWtXr261BDlcDhkWZbuu+8+JSUlKSAgQP/1X/+lqlWrasiQIZ7w1qRJE73xxhv6\n/vvvL/t4bDablixZon79+ql169YaMWKE6tatq4MHD+q9995TRESEXnvttSt7kcrJmTNnlJCQoOTk\nZH311Vd66qmn1LVrV08ojYyM1EMPPaTp06erT58+GjBggKdfx44dvc5oX4zD4dCiRYv06KOPqmnT\npqpVq5Z69Oih/v3765FHHtHdd9+tm2++Wdu3b9fKlSs9Z6uv1IWL/QYMGKC4uDiNGDFCtWvX1ldf\nfaUdO3ZozZo1kqQFCxaoa9euuvHGG3XvvfeqcePGcrlc2rhxow4ePOi5mK9Vq1bq3r27HA6HatSo\noc2bN+vll1/23HILgJ+rkHscALiuPPvss5bdbre2bNlyyb5///vfrW7dulnh4eFWeHi41apVK2vM\nmDHWrl27PH2++uorq3fv3lbVqlWtWrVqWSNHjrS2b99u2e12r1tPnTt3zrr//vut6OhoKyAgwOu2\nWW632xoyZIhVpUoVq2bNmlZGRoa1Y8eOEmOkpaVZVatWLbPebdu2WYMHD7aioqKskJAQKzY21rrz\nzjut995776LHuXfv3sveV/fu3a22bduWaI+NjbUGDBjg+f7C6/zBBx9YI0eOtGrWrGlVrVrVSk1N\ntX744YcS2y9cuNBq1aqVVblyZat27drW6NGjrePHj1/Wvi3Lslwul3XbbbdZERERlt1u99w26/Tp\n09aDDz5o1a1b1woLC7O6detmbdq0yerRo4fVs2dPz/YXblm2evXqS742lmVZH3/8sZWUlGRFRERY\n4eHhVlxcnLVw4UKvPnv27LHS0tKsOnXqWJUrV7bq169vDRgwwHrllVc8fWbOnGl17tzZqlGjhhUW\nFma1atXKmjVrltftugD4L5tlXYXV/gAAn1u2bJnuvvtubd68+ap+DC8AXE0+X/O6YMECxcbGKiQk\nRJ07d9bmzZvL7Pv3v/9dN910k6pXr64qVaqoffv2WrFiRYl+WVlZqlOnjkJDQ9WrVy/u1QcAAHCd\n8Gl4XbVqlcaPH69p06Zp69atateunZKSksq8kKFmzZp6+OGH9cknn2j79u0aMWKERowY4XUj89mz\nZ2v+/PlavHixPv30U4WFhSkpKUlnzpzx5aEAgBH4xzQA1zqfLhvo3LmzOnXqpCeffFJS8Q/V+vXr\na8yYMZowYcJljeFwONS/f3/PFch16tTRgw8+qHHjxkkqvoo4Ojpay5YtU3Jysm8OBAAMwLIBANcD\nn515LSoq0pYtW5SQkOBps9lsSkxM1MaNGy9rDKfTqa+//tpzv8I9e/YoPz/fa8yqVauqU6dOlz0m\nAFyrhg8frnPnzhFcAVzTfHarLLfbrXPnzik6OtqrPTo6Wjt37ixzuxMnTqhu3bo6ffq0AgMDtXDh\nQs8Np/Pz82Wz2Uods7T7+v20lrVr16pRo0ZX/EkxAAAA8L1Tp05p7969SkpKKvWjpC/wu/u8hoeH\na9u2bfrxxx/ldDo1btw4NW7cWN26dfvFY65du1bDhg0rxyoBAADgCytWrLjo/aZ9Fl4jIyMVEBAg\nl8vl1e5yuRQTE1PmdjabzfMxf23bttWOHTv02GOPqVu3boqJiZFlWXK5XF5nX10ul9q3b1/mmBc+\n/nDFihVq2bLlrzgq+MK4ceOUnZ1d0WWgFMyNf2N+/Bdz47+YG/+Vl5enYcOGeX1sdWl8Fl6DgoLk\ncDjkdDo1YMAAScUXbDmdziv6FJPz5897PrIvNjZWMTExcjqdatu2raTiZQabNm3SqFGjyhzjwlKB\nli1bshbMD+TkFD8kqbBQ2rIlQn/6U7yCg4vbUlKKH6h4ERERvGf8GPPjv5gb/8Xc+L9LLfH06bKB\nzMxMpaWlyeFwqGPHjsrOzlZBQYHS0tIkSampqapXr55mzpwpSZo1a5Y6dOigJk2a6PTp03rzzTe1\nYsUKLVq0yDPm2LFjNWPGDDVt2lSNGjXS5MmTVa9ePd1+++2+PBSUo5+G09xcyeGQZs2S+FkCAAAu\nxafhNTk5WW63W1lZWXK5XIqLi9PatWsVFRUlSTpw4IACA/9TwsmTJzVq1CgdOHBAISEhatGihVau\nXKnBgwd7+kyYMEEFBQVKT0/XsWPH1LVrV61Zs0aVKlXy5aEAAADAD/j8gq2MjAxlZGSU+ty6deu8\nvn/kkUf0yCOPXHLMqVOnaurUqeVRHgAAAAzi84+HBS6NBa7+KoXFx36N+fFfzI3/Ym7MR3iFH+AH\nib/ih7x/Y378F3Pjv5gb8xFeAQAAYAzCKwAAAIxBeAUAAIAxCK8AAAAwBuEVAAAAxiC8AgAAwBiE\nVwAAABiD8AoAAABjEF4BAABgDMIrAAAAjEF4BQAAgDEIrwAAADAG4RUAAADGILwCAADAGIRXAAAA\nGIPwCgAAAGMQXgEAAGAMwisAAACMQXgFAACAMQivAAAAMAbhFQAAAMYgvAIAAMAYhFcAAAAYg/AK\nAAAAYxBeAQAAYAzCKwAAAIxBeAUAAIAxCK8AAAAwBuEVAAAAxiC8AgAAwBiEVwAAABiD8AoAAABj\nEF4BAABgDMIrAAAAjEF4BQAAgDEIrwAAADAG4RUAAADGILwCAADAGIRXAAAAGIPwCgAAAGMQXgEA\nAGAMwisAAACMQXgFAACAMQivAAAAMAbhFQAAAMYgvAIAAMAYhFcAAAAYg/AKAAAAYxBeAQAAYAzC\nKwAAAIxBeAUAAIAxCK8AAAAwBuEVAAAAxvB5eF2wYIFiY2MVEhKizp07a/PmzWX2XbJkibp166Ya\nNWqoRo0a6tWrV4n+I0aMkN1u93r069fP14cBAAAAPxDoy8FXrVql8ePHa/HixerYsaOys7OVlJSk\nr7/+WpGRkSX6b9iwQUOHDtXNN9+s4OBgzZo1S71799aOHTtUu3ZtT7++ffvq2WeflWVZkqTKlSv7\n8jAAwC/k5BQ/JKmwUNq3T2rYUAoOLm5LSSl+AMC1zKfhNTs7W+np6UpNTZUkLVq0SG+++aaWLl2q\nCRMmlOj/3HPPeX2/ZMkSrV69Wk6nU8OGDfO0V65cWVFRUb4sHQD8zk/DaW6u5HAUh9n4+IqtCwCu\nJp8tGygqKtKWLVuUkJDgabPZbEpMTNTGjRsva4yTJ0+qqKhINWrU8Gpfv369oqOj1aJFC2VkZOjo\n0aPlWjsAAAD8k8/Cq9vt1rlz5xQdHe3VHh0drfz8/Msa43/+539Ut25dJSYmetr69u2r5cuXa926\ndZozZ442bNigfv36eZYQAAAA4Nrl02UDv8asWbP04osvasOGDapUqZKnPTk52fN169atdeONN6pJ\nkyZav369evToURGlAgAA4CrxWXiNjIxUQECAXC6XV7vL5VJMTMxFt507d67mzJkjp9Op1q1bX7Rv\nbGysIiMjtXv37kuG13HjxikiIsKrLSUlRSlc4QAAAHDV5OTkKOfCFaj/3/Hjxy9rW5+F16CgIDkc\nDjmdTg0YMECSZFmWnE6nxowZU+Z2c+bM0WOPPaa3335b7du3v+R+Dhw4oCNHjnjdjaAs2dnZiufK\nBgAAgApV2snD3NxcORyOS27r0/u8ZmZm6umnn9by5cv11VdfaeTIkSooKFBaWpokKTU1VRMnTvT0\nnz17trKysrR06VI1aNBALpdLLpdLJ0+elFR8AdeECRO0adMm7du3T06nUwMHDlSzZs2UlJTky0MB\nAACAH/Dpmtfk5GS53W5lZWXJ5XIpLi5Oa9eu9dzm6sCBAwoM/E8JixYtUlFRkQYPHuw1zpQpU5SV\nlaWAgAB98cUXWr58uY4dO6Y6deooKSlJ06dPV1BQkC8PBQAAAH7A5xdsZWRkKCMjo9Tn1q1b5/X9\nnj17LjpWcHCw3nrrrXKrDQAAAGbx+cfDAgAAAOWF8AoAAABjEF4BAABgDMIrAAAAjEF4BQAAgDEI\nrwAAADAG4RUAAADGILwCAADAGD7/kAIA5sjJKX5IUmGhtG+f1LChFBxc3JaSUvwAAKCiEF4BePw0\nnObmSg5HcZiNj6/YugAAuIBlAwAAADAG4RUAAADGILwCAADAGIRXAAAAGIPwCgAAAGMQXgEAAGAM\nwisAAACMQXgFAACAMQivAAAAMAbhFQAAAMYgvAIAAMAYhFcAAAAYg/AKAAAAYxBeAQAAYAzCKwAA\nAIxBeAUAAIAxCK8AAAAwBuEVAAAAxiC8AgAAwBiEVwAAABiD8AoAAABjEF4BAABgDMIrAAAAjEF4\nBQAAgDEIrwAAADAG4RUAAADGILwCAADAGIRXAAAAGIPwCgAAAGMQXgEAAGAMwisAAACMQXgFAACA\nMQivAAAAMAbhFQAAAMYgvAIAAMAYhFcAAAAYg/AKAAAAYxBeAQAAYAzCKwAAAIxBeAUAAIAxCK8A\nAAAwBuEVAAAAxgis6AIAAAB8JSen+CFJhYXSvn1Sw4ZScHBxW0pK8QPmILwCAIBr1k/DaW6u5HAU\nh9n4+IqtC78cywYAAABgDMIrAAAAjOHz8LpgwQLFxsYqJCREnTt31ubNm8vsu2TJEnXr1k01atRQ\njRo11KtXr1L7Z2VlqU6dOgoNDVWvXr20e/duXx4CAAAA/IRPw+uqVas0fvx4TZs2TVu3blW7du2U\nlJQkt9tdav8NGzZo6NChWr9+vT755BPVr19fvXv31uHDhz19Zs+erfnz52vx4sX69NNPFRYWpqSk\nJJ05c8aXhwIAAAA/4NPwmp2drfT0dKWmpqpFixZatGiRQkNDtXTp0lL7P/fccxo5cqTatm2rZs2a\nacmSJTp//rycTqenz5NPPqnJkyerf//+atOmjZYvX65Dhw7p1Vdf9eWhAAAAwA/4LLwWFRVpy5Yt\nSkhI8LTZbDYlJiZq48aNlzXGyZMnVVRUpBo1akiS9uzZo/z8fK8xq1atqk6dOl32mAAAADCXz8Kr\n2+3WuXPnFB0d7dUeHR2t/Pz8yxrjf/7nf1S3bl0lJiZKkvLz82Wz2X7VmAAAADCX397nddasWXrx\nxRe1YcMGVapUqVzGHDdunCIiIrzaUlJSlMLdiQEAAK6anJwc5Vz49Ij/7/jx45e1rc/Ca2RkpAIC\nAuRyubzaXS6XYmJiLrrt3LlzNWfOHDmdTrVu3drTHhMTI8uy5HK5vM6+ulwutW/f/pI1ZWdnK567\nEgMAAFSo0k4e5ubmyuFwXHJbny0bCAoKksPh8LrYyrIsOZ1O3XzzzWVuN2fOHD366KNau3ZtiUAa\nGxurmJgYrzFPnDihTZs2XXRMAAAAXBt8umwgMzNTaWlpcjgc6tixo7Kzs1VQUKC0tDRJUmpqqurV\nq6eZM2dKKr4N1pQpU5STk6MGDRp4ztpWqVJFYWFhkqSxY8dqxowZatq0qRo1aqTJkyerXr16uv32\n2315KAAAAPADPg2vycnJcrvdysrKksvlUlxcnNauXauoqChJ0oEDBxQY+J8SFi1apKKiIg0ePNhr\nnClTpigrK0uSNGHCBBUUFCg9PV3Hjh1T165dtWbNmnJbFwsAAAD/5fMLtjIyMpSRkVHqc+vWrfP6\nfs+ePZc15tSpUzV16tRfWxoAAAAM4/OPhwUAAADKC+EVAAAAxiC8AgAAwBiEVwAAABiD8AoAAABj\nEF4BAABgDMIrAAAAjEF4BQAAgDEIrwAAADAG4RUAAADGILwCAADAGIRXAAAAGIPwCgAAAGMQXgEA\nAGAMwisAAACMQXgFAACAMQivAAAAMAbhFQAAAMYgvAIAAMAYhFcAAAAYg/AKAAAAYxBeAQAAYAzC\nKwAAAIxBeAUAAIAxCK8AAAAwBuEVAAAAxiC8AgAAwBiEVwAAABiD8AoAAABjEF4BAABgDMIrAAAA\njEF4BQAAgDEIrwAAADAG4RUAAADGILwCAADAGIRXAAAAGIPwCgAAAGMQXgEAAGAMwisAAACMQXgF\nAACAMQivAAAAMAbhFQAAAMYgvAIAAMAYhFcAAAAYI7CiCwAAwHQ5OcUPSSoslPbtkxo2lIKDi9tS\nUoofAH49wisAAL/ST8Npbq7kcBSH2fj4iq0LuBaxbAAAAADGILwCAADAGIRXAAAAGIPwCgAAAGMQ\nXgEAAGAMwisAAACMQXgFAACAMQivAAAAMAbhFQAAAMbweXhdsGCBYmNjFRISos6dO2vz5s1l9t2x\nY4cGDx6s2NhY2e12zZs3r0SfadOmyW63ez1atWrly0MAAACAn/BpeF21apXGjx+vadOmaevWrWrX\nrp2SkpLkdrtL7V9QUKAmTZpo9uzZql27dpnjtmnTRi6XS/n5+crPz9eHH37oq0MAAACAH/FpeM3O\nzlZ6erpSU1PVokULLVq0SKGhoVq6dGmp/Tt06KDZs2crOTlZlSpVKnPcwMBARUVFqVatWqpVq5Zq\n1Kjhq0MAAACAH/FZeC0qKtKWLVuUkJDgabPZbEpMTNTGjRt/1di7du1S3bp11aRJEw0bNkzffffd\nry0XAAAABvBZeHW73Tp37pyio6O92qOjo5Wfn/+Lx+3cubOeffZZrV27VosWLdKePXvUrVs3nTx5\n8teWDAAAAD8XWNEFXKmkpCTP123atFHHjh3VsGFDvfjiixoxYkQFVgYAAABf81l4jYyMVEBAgFwu\nl1e7y+VSTExMue0nIiJCzZo10+7duy/Zd9y4cYqIiPBqS0lJUUpKSrnVAwAAgIvLyclRTk6OV9vx\n48cva1ufhdegoCA5HA45nU4NGDBAkmRZlpxOp8aMGVNu+/nxxx/1zTffKDU19ZJ9s7OzFR8fX277\nBgAAwJUr7eRhbm6uHA7HJbf16bKBzMxMpaWlyeFwqGPHjsrOzlZBQYHS0tIkSampqapXr55mzpwp\nqfgirx07dsiyLJ05c0YHDx7Utm3bVKVKFTVp0kSS9OCDD+q2225Tw4YNdfDgQU2ZMkWBgYGcPQUA\nALgO+DS8Jicny+12KysrSy6XS3FxcVq7dq2ioqIkSQcOHFBg4H9KOHTokNq3by+bzSZJmjt3rubO\nnatbbrlF69at82wzdOhQHTlyRFFRUfrtb3+rTz75RDVr1vTloQAAAMAP+PyCrYyMDGVkZJT63IVA\nekHDhg11/vz5i4738/URAAAAuH74/ONhAQAAgPJCeAUAAIAxCK8AAAAwBuEVAAAAxiC8AgAAwBiE\nVwAAABhQ9dLUAAAgAElEQVSD8AoAAABjEF4BAABgDMIrAAAAjOHzT9hCxdq/f7/cbndFl1GmvLwQ\nSS2Vl5cn6VRFl1OmyMhINWjQoFzHZG7Kjy/mBwDgnwiv17D9+/erZfPmKigsrOhSLqK9pFwNG3aX\npK0VXUyZQoODlbdzZ7kFJOamfJX3/AAA/Bfh9RrmdrtVUFioFZJaVnQxZciTNEzy/xoLC+V2u8st\nHDE35ccX8wMA8F+E1+tAS0nxFV3EJZhQoy+YcNwm1AgAuH5wwRYAAACMQXgFAACAMQivAAAAMAbh\nFQAAAMYgvAIAAMAYhFcAAAAYg/AKAAAAYxBeAQAAYAzCKwAAAIxBeAUAAIAxCK8AAAAwBuEVAAAA\nxiC8AgAAwBiEVwAAABiD8AoAAABjEF4BAABgDMIrAAAAjEF4BQAAgDEIrwAAADAG4RUAAADGILwC\nAADAGIRXAAAAGIPwCgAAAGMQXgEAAGAMwisAAACMQXgFAACAMQivAAAAMAbhFQAAAMYgvAIAAMAY\ngRVdAAD4m/3798vtdld0GReVlxciqaXy8vIknarocsoUGRmpBg0aVHQZAK4hhFcA+In9+/erZfPm\nKigsrOhSLqG9pFwNG3aXpK0VXUyZQoODlbdzJwEWQLkhvALAT7jdbhUUFmqFpJYVXcxF5EkaJvl1\nnXmShhUWyu12E14BlBvCKwCUoqWk+Iou4jKYUicAlBcu2AIAAIAxCK8AAAAwBuEVAAAAxiC8AgAA\nwBiEVwAAABiD8AoAAABjEF4BAABgDMIrAAAAjEF4BQAAgDEIrwAAADCGz8PrggULFBsbq5CQEHXu\n3FmbN28us++OHTs0ePBgxcbGym63a968eb96TAAAAFw7fBpeV61apfHjx2vatGnaunWr2rVrp6Sk\nJLnd7lL7FxQUqEmTJpo9e7Zq165dLmMCAADg2uHT8Jqdna309HSlpqaqRYsWWrRokUJDQ7V06dJS\n+3fo0EGzZ89WcnKyKlWqVC5jAgAA4Nrhs/BaVFSkLVu2KCEhwdNms9mUmJiojRs3+s2YAAAAMIfP\nwqvb7da5c+cUHR3t1R4dHa38/Hy/GRMAAADmCKzoAq6mcePGKSIiwqstJSVFKSkpFVQRAADA9Scn\nJ0c5OTlebcePH7+sbX0WXiMjIxUQECCXy+XV7nK5FBMTUyFjZmdnKz4+/hftGwAAAOWjtJOHubm5\ncjgcl9zWZ8sGgoKC5HA45HQ6PW2WZcnpdOrmm2/2mzEBAABgDp8uG8jMzFRaWpocDoc6duyo7Oxs\nFRQUKC0tTZKUmpqqevXqaebMmZKKL8jasWOHLMvSmTNndPDgQW3btk1VqlRRkyZNLmtMAAAAXLt8\nGl6Tk5PldruVlZUll8uluLg4rV27VlFRUZKkAwcOKDDwPyUcOnRI7du3l81mkyTNnTtXc+fO1S23\n3KJ169Zd1pgAAAC4dvn8gq2MjAxlZGSU+tyFQHpBw4YNdf78+V81JgAAAK5dPv94WAAAAKC8EF4B\nAABgDMIrAAAAjEF4BQAAgDEIrwAAADAG4RUAAADGILwCAADAGIRXAAAAGIPwCgAAAGMQXgEAAGAM\nwisAAACMQXgFAACAMQivAAAAMAbhFQAAAMYgvAIAAMAYgRVdAAAAV2L//v1yu90VXUaZ8vJCJLVU\nXl6epFMVXU6ZIiMj1aBBg3Idk7kpP76Yn2sF4RUAYIz9+/erZfPmKigsrOhSLqK9pFwNG3aXpK0V\nXUyZQoODlbdzZ7kFJOamfJX3/FxLCK8AAGO43W4VFBZqhaSWFV1MGfIkDZP8v8bCQrnd7nILR8xN\n+fHF/FxLCK8AAOO0lBRf0UVcggk1+oIJx21CjSgbF2wBAADAGIRXAAAAGIPwCgAAAGMQXgEAAGAM\nwisAAACMQXgFAACAMQivAAAAMAbhFQAAAMYgvAIAAMAYhFcAAAAYg/AKAAAAYxBeAQAAYAzCKwAA\nAIxBeAUAAIAxCK8AAAAwBuEVAAAAxiC8AgAAwBiEVwAAABiD8AoAAABjEF4BAABgDMIrAAAAjEF4\nBQAAgDEIrwAAADAG4RUAAADGILwCAADAGIRXAAAAGIPwCgAAAGMQXgEAAGAMwisAAACMQXgFAACA\nMQivAAAAMAbhFQAAAMYgvAIAAMAYhFcAAAAYg/AKAAAAYxBeAQAAYAyfh9cFCxYoNjZWISEh6ty5\nszZv3nzR/i+99JJatmypkJAQtWvXTmvWrPF6fsSIEbLb7V6Pfv36+fIQAAAA4Cd8Gl5XrVql8ePH\na9q0adq6davatWunpKQkud3uUvt//PHHGjp0qO699159/vnnuv322zVw4EDt2LHDq1/fvn3lcrmU\nn5+v/Px85eTk+PIwAAAA4Cd8Gl6zs7OVnp6u1NRUtWjRQosWLVJoaKiWLl1aav958+apb9++yszM\nVPPmzTV9+nTFx8dr/vz5Xv0qV66sqKgo1apVS7Vq1VJERIQvDwMAAAB+wmfhtaioSFu2bFFCQoKn\nzWazKTExURs3bix1m40bNyoxMdGrLSkpqUT/9evXKzo6Wi1atFBGRoaOHj1a/gcAAAAAv+Oz8Op2\nu3Xu3DlFR0d7tUdHRys/P7/UbfLz8y/Zv2/fvlq+fLnWrVunOXPmaMOGDerXr58syyr/gwAAAIBf\nCazoAq5UcnKy5+vWrVvrxhtvVJMmTbR+/Xr16NGjAisDAACAr/ksvEZGRiogIEAul8ur3eVyKSYm\nptRtYmJirqi/JMXGxioyMlK7d+++ZHgdN25cifWxKSkpSklJueh2AAAAKD85OTklLrg/fvz4ZW3r\ns/AaFBQkh8Mhp9OpAQMGSJIsy5LT6dSYMWNK3aZLly4lnn/nnXfUpUuXMvdz4MABHTlyRLVr175k\nTdnZ2YqPj7/CIwEAAEB5Ku3kYW5urhwOxyW39endBjIzM/X0009r+fLl+uqrrzRy5EgVFBQoLS1N\nkpSamqqJEyd6+t9///1666239Je//EU7d+7U1KlTtWXLFo0ePVqSdPLkSU2YMEGbNm3Svn375HQ6\nNXDgQDVr1kxJSUm+PBQAAAD4AZ+ueU1OTpbb7VZWVpZcLpfi4uK0du1aRUVFSSo+axoY+J8SunTp\noueff16TJk3SpEmTdMMNN+i1115Tq1atJEkBAQH64osvtHz5ch07dkx16tRRUlKSpk+frqCgIF8e\nCgAAAPyAzy/YysjIUEZGRqnPrVu3rkTboEGDNGjQoFL7BwcH66233irX+gAAAGAOn388LAAAAFBe\nCK8AAAAwBuEVAAAAxiC8AgAAwBiEVwAAABiD8AoAAABjEF4BAABgDMIrAAAAjEF4BQAAgDEIrwAA\nADAG4RUAAADGILwCAADAGIEVXQAA/5GjO5WjFElSoSqrmXbqT3pMwTotSUpRjlL0QkWWCAC4zhFe\nAXik6AXCKQDAr7FsAAAAAMYgvAIAAMAYhFcAAAAYg/AKAAAAYxBeAQAAYAzCKwAAAIxBeAUAAIAx\nCK8AAAAwBuEVAAAAxiC8AgAAwBiEVwAAABiD8AoAAABjEF4BAABgDMIrAAAAjEF4BQAAgDEIrwAA\nADAG4RUAAADGILwCAADAGIRXAAAAGIPwCgAAAGMQXgEAAGAMwisAAACMQXgFAACAMQivAAAAMAbh\nFQAAAMYgvAIAAMAYhFcAAAAYg/AKAAAAYxBeAQAAYAzCKwAAAIxBeAUAAIAxCK8AAAAwBuEVAAAA\nxiC8AgAAwBiEVwAAABiD8AoAAABjEF4BAABgDMIrAAAAjEF4BQAAgDEIrwAAADAG4RUAAADGILwC\nAADAGD4PrwsWLFBsbKxCQkLUuXNnbd68+aL9X3rpJbVs2VIhISFq166d1qxZU6JPVlaW6tSpo9DQ\nUPXq1Uu7d+/2VfkAAFxSju7UAL2mAXpNf9Jjaqad+pMe87Tl6M6KLhG4ZgT6cvBVq1Zp/PjxWrx4\nsTp27Kjs7GwlJSXp66+/VmRkZIn+H3/8sYYOHarZs2fr1ltv1cqVKzVw4EBt3bpVrVq1kiTNnj1b\n8+fP1/Lly9WoUSM9/PDDSkpKUl5enipVquTLwwEAoFQpekEpeqGiywCuCz4985qdna309HSlpqaq\nRYsWWrRokUJDQ7V06dJS+8+bN099+/ZVZmammjdvrunTpys+Pl7z58/39HnyySc1efJk9e/fX23a\ntNHy5ct16NAhvfrqq748FAAAAPgBn4XXoqIibdmyRQkJCZ42m82mxMREbdy4sdRtNm7cqMTERK+2\npKQkT/9vv/1W+fn5XmNWrVpVnTp1KnNMAAAAXDt8tmzA7Xbr3Llzio6O9mqPjo7Wzp07S90mPz+/\n1P75+fmSJJfLJZvNdtE+KCmvogu4iLyf/dcf+bI2fz5uU/jqNfT3ueG9g1/jep0bE943kv/XV9F8\nuubV34wbN04RERFebSkpKUpJSamginwrMjJSocHBGlZYWNGlXNKwii7gEkKDg0tdp/1LmTQ3JijP\n+TFtbnjv4Je6nufG3983UvnPj7/JyclRTk6OV9vx48cva1ufhdfIyEgFBATI5XJ5tbtcLsXExJS6\nTUxMzEX7x8TEyLIsuVwur7OvLpdL7du3v2RN2dnZio+Pv9JDMVaDBg2Ut3On3G53RZdSpry8EA0b\nJq1YsVItW56q6HLKFBkZqQYNGpTbeCbMjUnKc35MmRveO/49Pya4HufGlPeNVP7z429KO3mYm5sr\nh8NxyW19Fl6DgoLkcDjkdDo1YMAASZJlWXI6nRozZkyp23Tp0qXE8++88466dOkiSYqNjVVMTIyc\nTqfatm0rSTpx4oQ2bdqkUaNG+epQjNagQQMj/udv2bKlrqO/KySZMzfXI5PmhvcO/Ikpc3M9vm+u\nJT5dNpCZmam0tDQ5HA7PrbIKCgqUlpYmSUpNTVW9evU0c+ZMSdL999+v7t276y9/+YtuvfVW5eTk\naMuWLXr66ac9Y44dO1YzZsxQ06ZN1ahRI02ePFn16tXT7bff7stDAQAAgB/waXhNTk6W2+1WVlaW\nXC6X4uLitHbtWkVFRUmSDhw4oMDA/5TQpUsXPf/885o0aZImTZqkG264Qa+99prnHq+SNGHCBBUU\nFCg9PV3Hjh1T165dtWbNGu7xCgAAcB3w+QVbGRkZysjIKPW5devWlWgbNGiQBg0adNExp06dqqlT\np5ZHeQAAADCIzz8eFgAAACgvhFcAAAAYg/AKAAAAYxBeAQAAYAzCKwAAAIxBeAUAAIAxCK8AAAAw\nBuEVAAAAxiC8AgAAwBiEVwAAABiD8AoAAABjEF4BAABgDMIrAAAAjEF4BQAAgDEIrwAAADAG4RUA\nAADGILwCAADAGIRXAAAAGIPwCgAAAGMQXgEAAGAMwisAAACMQXgFAACAMQIrugBcf3Jyih+SVFgo\nNWsm/elPUnBwcVtKSvEDAADg5wivuOoIpwAA4Jdi2QAAAACMQXgFAACAMQivAAAAMAbhFQAAAMbg\ngi0AMAR36gAAwisAGINwCgAsGwAAAIBBCK8AAAAwBuEVAAAAxiC8AgAAwBiEVwAAABiD8AoAAABj\nEF4BAABgDMIrAAAAjEF4BQAAgDEIrwAAADAG4RUAAADGILwCAADAGIRXAAAAGIPwCgAAAGMQXgEA\nAGAMwisAAACMQXgFAACAMQIrugAAAABfyckpfkhSYaHUrJn0pz9JwcHFbSkpxQ+Yg/AKAACuWYTT\naw/LBgAAAGAMwisAAACMQXgFAACAMQivAAAAMAbhFQAAAMYgvKLC5Vy4hwn8DnPj35gf/8Xc+C/m\nxnw+C68//PCD7rrrLkVERKh69eq65557dPLkyYtuc/r0aY0aNUqRkZEKDw/X4MGD9e9//9u7YLvd\n6xEQEKAXX3zRV4eBq4AfJP6LufFvzI//Ym78F3NjPp+F16FDhyovL09Op1Nvvvmm3n//faWnp190\nm7Fjx+rNN9/U6tWr9f777+vQoUMaNGhQiX7Lli2Ty+VSfn6+Dh8+rIEDB/rqMAAAAOBHfPIhBV99\n9ZXWrl2rLVu2qH379pKkv/71r7r11ls1d+5cxcTElNjmxIkTWrp0qV544QXdcsstkqRnnnlGLVu2\n1KeffqqOHTt6+kZERCgqKsoXpQMAAMCP+eTM68aNG1W9enVPcJWkxMRE2Ww2bdq0qdRttmzZorNn\nzyohIcHT1rx5czVo0EAbN2706jtq1ChFRUWpU6dOeuaZZ3xxCAAAAPBDPjnzmp+fr1q1anm1BQQE\nqEaNGsrPzy9zm0qVKqlq1ape7dHR0V7bPPLII+rZs6dCQ0P19ttvKyMjQydPntTo0aPLrOfUqVOS\npLy8vF96SPCh48ePKzc3t6LLQCmYG//G/Pgv5sZ/MTf+60JOu5DbynJF4fWhhx7S7Nmzy3zeZrP5\nPCBOmjTJ83W7du30448/6vHHH79oeN27d68kadiwYT6tDb+cw+Go6BJQBubGvzE//ou58V/MjX/b\nu3evfvOb35T5/BWF1wceeEAjRoy4aJ/GjRsrJiamxF0Czp07p6NHj5a63lWSYmJidObMGZ04ccLr\n7KvL5SpzG0nq1KmTZsyYoaKiIgUFBZXaJykpSStWrFCjRo0UEhJy0foBAABw9Z06dUp79+5VUlLS\nRftdUXitWbOmatasecl+Xbp00bFjx7R161bPulen0ynLstSpU6dSt3E4HAoMDJTT6dQdd9whSdq5\nc6f279+vLl26lLmvrVu3qnr16mUGV0mKjIzUXXfddcm6AQAAUHEudsb1Ap+seW3RooWSkpJ07733\n6qmnntKZM2d03333KSUlxXMW9dChQ0pISNBzzz2nDh06qGrVqvrDH/6gzMxMVa9eXeHh4RozZox+\n85vfeO408MYbb8jlcqlz584KDg7W22+/rccee0wTJkzwxWEAAADAz/gkvErS888/r9GjRysxMVF2\nu12DBw/Wk08+6Xm+qKhIX3/9tQoKCjxt2dnZCggI0ODBg3X69Gn16dNHCxYs8DwfFBSkBQsWKDMz\nU5ZlqWnTpnriiSd0zz33+OowAAAA4EdslmVZFV0EAAAAcDl89glbwOXo0aOHMjMzPd/HxsZq3rx5\nnu/tdrv+8Y9/VERpkLRv3z7Z7XZ98cUXFV0KYLQuXbpo4sSJ5T7uQw89dNHrQnD5fv77CP6L8Ipy\nl5aWJrvdroyMjBLPjRo1Sna7XXfffbck6e9//7seeeSRq12ikUaMGCG73a6AgADZ7XbP199++225\njf+73/2uRLvNZiuX8YGK9PP3zk8fAQEBmj59ernsZ+3atbLb7Tpz5ky5jHc5rvf3aFk/uzZs2CC7\n3a4TJ05c1jj8PjIH4RXlzmazqUGDBnrhhRd0+vRpT/vp06eVk5Ojhg0betqqVaumsLCwiijTSH37\n9lV+fr7ncfjwYcXGxvp0n75YWVRUVFTuY5qorD9I+vXrV9GlXXMuvF/y8/P1xBNPKCIiQi6Xy9P+\nwAMPlMt+LMuSzWbzyfsGV+5Kgv2lfh/xc8t/EF7hE+3bt1f9+vX1yiuveNpeeeUVNWzY0Otjg6/0\nn2mmTJmiunXr6l//+le51muKypUrKyoqSrVq1fI8LvyifOyxx9S4cWOFhoaqffv2Wr16tWe78+fP\n65577vE836JFC6/lGdOmTdOyZcv02muveQLU+++/73n+m2++Uc+ePRUWFqa4uDh98sknXnV9+OGH\n6tatm0JDQ9WwYUPdf//9XhdjxsbGasaMGRo+fLgiIiKUnp6uoqIijR49WnXq1FFISIhiY2Mv+iEo\n16rS/iDJycmp6LKuOT99z0RERMhms3m9l0JDQyVJ7777rjp06KDg4GDVrVtXWVlZXkG0sLBQGRkZ\nqlWrlkJCQtS9e3d9/vnnkopv73jhD4+QkBAFBAR4/QvU2bNnPXfUqVu3rmbNmuVV49GjR5WWlqao\nqChVq1ZNvXv31o4dO7z6TJ8+XbVq1VK1atU0cuTIq3qG12RHjx7V0KFDVa9ePYWFhalt27Z64YUX\nvPqUtozt5z+34B8Ir/AJm82mu+++W0uXLvW0LV26VCNGjPjFZyTuu+8+rVixQh9++KHatGlTXqVe\nE2bOnKkVK1Zo8eLF2rFjh8aNG6ff//73+uCDDyQVh9f69etr9erVysvL05QpUzRp0iS9/PLLkoo/\ngCQ5OVl9+vSRy+XS4cOHdfPNN3vGf/jhhzVhwgRt27ZNzZo109ChQ3X+/HlJxcG2b9++GjJkiP71\nr39p1apV+uijj3Tfffd51fjnP/9ZcXFx+vzzzzV58mTNmzdPb7zxhl5++WV9/fXXWrlypRo1anR1\nXjA/UtofJBEREZKKw9Bvf/tbhYSEqE2bNnI6nSXWgX/88cdq3769QkJC1LFjR88fIBfWKR87dkx3\n3XWXJ6A1b95cy5Ytq5Bj9Xf79u3Tbbfdpu7du+uLL77Q/PnztWDBAj3++OOePvfff7/++c9/Kicn\nR7m5uapbt66SkpL0448/6oYbbtDzzz8vSdq/f78OHz6sOXPmeLZ9+umnFR0drc8++0zTp0/XxIkT\n9dFHH3mev+OOO1RQUKB3331Xn332mVq2bKnExET9+OOPkqTly5drzpw5ys7O1ubNmxUREaElS5Zc\npVfHPD//o6NDhw5as2aNvvzyS6Wnpys1NVWfffbZRcf4+c8t+AkLKGdpaWnWHXfcYX3//fdWcHCw\ntX//fmvv3r1WaGiodeTIEWvgwIHWiBEjLMuyrO7du1vjxo3zbNuoUSPrySef9Hxvs9msl19+2Ro6\ndKjVunVr6/Dhw1f9ePxFWlqaFRgYaFWpUsXzSE5Otk6fPm2FhYVZn3zyiVf/e+65x7rrrrvKHG/0\n6NHWkCFDvMa/4447vPrs3bvXstls1jPPPONp27Fjh2W3262dO3d69jNy5Eiv7T744AMrICDAOn36\ntGVZxfM6aNAgrz5jxoyxEhMTL/8FuAaV9ppfcO7cOat58+ZWnz59rO3bt1sfffSR1alTJ8tut1uv\nvfaaZVmWdeLECatmzZrW8OHDrby8POutt96ymjdvbtntdmvbtm2WZVnWqFGjrPj4eCs3N9fat2+f\n5XQ6rTfeeOOqHaM/evbZZ63q1auXaB8/frwVFxfn1faXv/zFioqKsizLsn744QcrMDDQevXVVz3P\nFxYWWrVq1bLmz59vWZZlvfXWW5bdbvf8v39B586drd69e3u1tW3b1po2bZplWZb1zjvvWFFRUdbZ\ns2c9z58/f96qX7++9dxzz1mWZVnx8fHWgw8+6DVGXFyc1aVLlys6/mtNaT8bq1SpYoWEhFh2u906\nfvx4qdv179/f6/Us7ffRz39uwT/47D6vQGRkpPr3769nnnlGlmXp1ltvVY0aNa54nHHjxik4OFif\nfPLJL9r+WtKzZ08tWrTIc0YhLCxMu3fvVkFBgXr16uV1pqGoqMhricaCBQv0zDPPaP/+/Tp16pTO\nnDnj9fzF3HjjjZ6va9euLcuy9O9//1vNmjXTtm3btH37dq1YscLT50Ide/bsUfPmzSWV/CzxtLQ0\n9erVS82bN1efPn3Uv39/9erV6wpfEfO9/vrrCg8P93xvs9k0ceJEtW/fXnv27NEHH3ygqKgoSdKj\njz7q9RqtXLlSdrtdixcvVqVKldTi/7V3vyFNfm0Ax79zkpYG/lJCizKNYWlKalGRSS9SLDINU1Nw\noPkHMTMxcWLZi5LC/kgUEr1URDGCItHyDyGoWSaZoc5pOhtBkkqWgY2y54W0p6nl7+nJanV9Xrmz\n49nZPe7d1859rnPWrSM7O5vk5GRTHYPBgK+vr+mzXr169U96Z5anp6fH7I4DTO/2Mzo6ysjICIOD\ng0xNTZnVsbGxwd/fn56ennnb9/HxMXvs4uJi2kq9s7OTsbExHBwczOpMTk6akjK1Wi25ublmz2/b\nts00beFvNvO7EaC1tZW4uDhg+u5TQUEB169f58WLFxiNRoxG47w5FzO/t8TvQYJXsaDi4+M5fPgw\nCoWC4uLi72ojODiY8vJy7ty5Q2xs7A/uoWWxs7OblaA1NDQEQHV1NStWrDB7zsbGBoCKigqys7Mp\nKipi69atLF26lMLCQh4+fPivXvfL7Zc/J0B8njYwMTFBSkoKGRkZs6aEfBkozbxI+Pr6otfrqamp\nob6+nqioKIKCgqisrPxXffpTzHXRXbZsGSUlJaxatcoUuAKm3QY/0+l0+Pj4sGjRoq/WSU1NJSIi\ngvb2doKDgwkPD5ellX6RmduYKxQKs/PIzc2N2traWefRP//889P6aKnm+m40GAymvwsLC7l8+TKX\nLl1iw4YN2NnZkZGRMe+cYUko/j1J8CoWVEhICEajEaVSSXBw8He1sW/fPkJDQ4mJiUGpVBIdHf2D\ne2nZPD09sbGxYWhoiICAgDnrtLS0sH37drOEg2fPnpnVWbRoER8/fpz1v/Nl6/r5+dHd3f1dqx7Y\n29sTGRlJZGQkERER7N69m9evX88affqTzXXR/ZFCQkJ4/vw51dXV1NXVsWvXLtLS0szmYopp69ev\np6GhwaysqakJR0dHnJycsLa2xsrKiubmZsLDw4HpkdH29nZCQ0MBTD8k5jqXvsXPz48zZ85ga2uL\ni4vLnHXWrVvHgwcPOHDggKmstbUVW1vb/+m1/kYtLS2EhYURExMDTN8d0ul0eHl5/eKeie8hCVti\nQVlZWaHVaunq6vq/1iIMCwujtLSUhIQEsyx6MR0AHjt2jMzMTEpKShgYGODx48dcuXKF0tJSAFQq\nFY8ePaK2tpa+vj7y8/Npa2sza2fNmjV0dnai0+kYHR3lw4cPwPxLZeXk5NDS0kJ6ejpPnjyhv7+f\nW7duzUrYmqmoqIiKigp6e3vR6XRUVlbi7Oz8VwWu3+Lh4YHBYODVq1emspkj5R4eHjx9+tRsCZ+5\nRtMdHR2Ji4ujpKSEoqIirl27tnAdt2Dp6en09vaSlZWFTqfjxo0bFBQUkJ2dDUwvpZSYmEhmZib1\n9S/LS4cAAAM8SURBVPV0dXWRkJCAQqFArVYDmJIOb9++zcjIiNmqG9+yZ88eNm7cSFhYGA0NDej1\nepqamtBoNKbVVTIyMrh69SplZWX09fWh0Whm/QgVc1OpVNTV1XH//n16enpISUlheHj4V3dLfCcZ\neRULzt7eflbZ1wLZmeVfPo6IiGBqagq1Wo1SqTSNfAg4deoUy5cv5+zZswwMDODg4ICfn59pR5+U\nlBQ6Ojo4ePAgCoWCmJgY0tLSqKmpMbWRlJREY2MjmzZt4t27d9y7dw9XV9c5P6svy7y9vWlsbCQv\nL4/AwEA+ffrE2rVrzUbI52rj89SF/v5+lEolmzdvprq6+kceFovw/v37WRdRa2trgoKCcHd3R61W\nU1hYyJs3bzhx4gQKhcJ0PGNjY8nLyyMpKQmNRsPQ0BAXLlwA/nvMT548ib+/P15eXkxOTlJVVYWn\np+fPfZMWwtXVlaqqKnJyciguLsbR0ZH09HSzNWAvXryIUqkkNjaWiYkJtmzZQm1tren2spubG3l5\neRw5coSRkRGSk5MpLi6e9zyysrKitraW3Nxc1Go1Y2NjODs7s3PnTtPUEbVajV6vJzMzE6PRSFRU\nFElJSbS0tCzwkbF8x48fZ3BwkJCQEJYsWUJycjL79+9nfHzcVOdb1x/xe1F8mm9YRQghxIKIj4+n\npKRkVrmHhwfd3d3odDoSExNpa2vD3d2dc+fOsXfvXu7evWtK3GptbSU1NRWtVou3tzdZWVnExsai\n1WpRqVQUFBRQXl6OXq9n8eLF7Nixg6KiIrPNQoQQwpJI8CqEEBaiubmZwMBA+vv7vzpPtqysjEOH\nDjE+Pm5K2BNCiD+JTBsQQojf1M2bN7G3t0elUtHX18fRo0cJCAgwC1xLS0txd3dn5cqVdHR0oNFo\niI6OlsBVCPHHkuBVCCF+U2/fviUnJweDwYCTkxNBQUGcP3/erM7Lly/Jz89neHgYFxcXoqOjOX36\n9C/qsRBCLDyZNiCEEEIIISyGLJUlhBBCCCEshgSvQgghhBDCYkjwKoQQQgghLIYEr0IIIYQQwmJI\n8CqEEEIIISyGBK9CCCGEEMJiSPAqhBBCCCEshgSvQgghhBDCYvwHWtj0UuEU55kAAAAASUVORK5C\nYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x86716a0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Plot the top 5 feature importances of the forest\n",
    "plt.figure(num=None, figsize=(8, 6), dpi=80, facecolor='w', edgecolor='k')\n",
    "plt.title(\"Feature importances\")\n",
    "plt.bar(range(5), importances[indices][:5], \n",
    "       color=\"r\",  yerr=std[indices][:5], align=\"center\")\n",
    "plt.xticks(range(5), best_features)\n",
    "plt.xlim([-1, 5])\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<hr>\n",
    "# Naive Bayes\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Naive Bayes algorithm is a simple yet powerful algorithm. The naive term comes from the fact that Naive Bayes takes a few shortcuts, which we would take a look over soon, to compute the probabilities for classification. It is flexible enough and can be used on different types of datasets easily and doesn't have constraints like only numerical features should be used. Hence it is a most appropriate for tasks like Text Classification. Naive Bayes works on a probabilistic model that is built upon a naive interpretation of Bayesian statistics. Despite the naive aspect, the method performs very well in a large number of contexts. \n",
    "\n",
    "### Bayes' theorem\n",
    "\n",
    "Approach to learning statistics is roughly divided into two parts : the frequentist\n",
    "approach and the Bayesian approach.\n",
    "\n",
    "Most of us have been familiar with the frequentist approach when we first encountered with Statistics. According to frequentist approach, the data is assumed to data come from some distribution and then our aim is to determine what the parameters are for that particular distribution. However, those parameters are assumed to be fixed (perhaps incorrectly). We use our model to\n",
    "describe the data, and then even test to ensure the data fits our model.\n",
    "\n",
    "Bayesian statistics instead model how people actually reason when given with some data. We have a set of data and we use that data to update our model about with the probability of how likely something is to occur. In Bayesian statistics, we use the data to describe the model rather than using a model first and confirming it later with data like the frequentist approach.\n",
    "\n",
    "Bayes' theorem computes the value of P(A|B), which denotes what is the probability of even A occurring, given that B has already occurred. In most cases, B would be an observed event for e.g. it has rained\n",
    "yesterday, and A would be a prediction like it will rain today. For data mining, B is usually what we refer to as our observed data for training our model and A would be finding out to what class a new data point belongs. We will see how Bayes'\n",
    "theorem can be used for data mining in the next section.\n",
    "The equation for Bayes' theorem is given as follows:\n",
    "\n",
    "<img src = \"images/bayes.png\">\n",
    "\n",
    "To understand Naive Bayes better, we would take our Zoo animal classification example, where we are classifying animals according to their type. For simplicity we assume we want to find the probability that an animal with a set of features X1 and X2 is of Type 1 i.e vertebrates.\n",
    "\n",
    "A, in this context, is the probability that this animal is a vertebrate. We can compute P(A),\n",
    "called the prior belief directly from a training dataset by computing the percentage\n",
    "of animals in our dataset that are vertebrates. If our dataset contains 30 vertebrates for\n",
    "every 100 animals, P(A) is 30/100 or 0.3.\n",
    "\n",
    "B, in this context, is this animal contains the features 'X1' and 'X2'. Likewise, we can compute P(B)\n",
    "by computing the percentage of animals in our dataset containing these specific features. If 10\n",
    "animals in every 100 of our training dataset contain the features 'X1' and 'X2', P(B) is 10/100 or\n",
    "0.1. Note that we don't care if the animal is vertebrate or not when computing this value.\n",
    "\n",
    "P(B|A) is the probability that an animal contains the features 'X1' and 'X2' if it is a vertebrate.\n",
    "It is also easy to compute from our training dataset. We look through our training\n",
    "set for vertebrate animals and compute the percentage of them that contain the features X1 and X2. Of our 30 vertebrates, if 6 contain the features 'X1' and 'X2', then P(B|A) is calculated as 6/30 or 0.2.\n",
    "\n",
    "From here, we use Bayes' theorem to compute P(A|B), which is the probability that\n",
    "a animal containg the particular features 'X1' and 'X2' is a vertebrate. Using the previous equation, we see the\n",
    "result is 0.6. This indicates that if an animal has the features 'X1' and 'X2' in it, there is a 60\n",
    "percent chance that it is vertebrate.\n",
    "\n",
    "Note how we calculated the probability in the preceding example. We used evidence directly\n",
    "from our training dataset, not from some presumed distribution. In contrast, a\n",
    "frequentist approach of this would rely on us creating a distribution of the probability of\n",
    "different features in animals to compute similar equations.\n",
    "\n",
    "<hr>\n",
    "### Naive Bayes algorithm\n",
    "\n",
    "As we found out, the Bayes' theorem equation can be used to compute the\n",
    "probability that a given sample belongs to a given class. Hence we can use the equation as a classification algorithm.\n",
    "\n",
    "Using C as a given class and D as a sample data-point in our dataset, we create the elements\n",
    "necessary for Bayes' theorem and Naive Bayes. Naive Bayes is a\n",
    "classification algorithm that utilizes Bayes' theorem to compute the probability\n",
    "that a new data sample belongs to a particular class.\n",
    "\n",
    "P(C) is the probability of a class, which is computed from the training dataset itself\n",
    "(as we did with the vertebrate example). We simply compute the percentage of samples\n",
    "in our training dataset that belong to the given class.\n",
    "\n",
    "P(D) is the probability of a given data-point. It might get difficult for us to compute this, as the sample can contain many different features, but since it is a constant across all classes and we don't need to compute it at all. We will see\n",
    "later how to work around this issue.\n",
    "\n",
    "P(D|C) is the probability of the data sample D belonging to the class C. This could also be difficult to compute due to the different features of D. However, this is where the naive part of the Naive Bayes algorithm comes into picture. Naive Bayes naively assume that each feature is independent of each other. Rather than computing the full probability of\n",
    "P(D|C), we compute the probability of each feature D1, D2, D3, … and so on. Then,\n",
    "we multiply them together:\n",
    "P(D|C) = P(D1|C) x P(D2|C).... x P(Dn|C) as if they were all independent from each other. \n",
    "Each of these values is relatively easy to compute; we simply compute the percentage of times it is equal in our sample dataset.\n",
    "\n",
    "In contrast, if we wanted to perform a non-Naive Bayes version for this part, we would\n",
    "need to compute the correlations between different features for each class. Such\n",
    "computation is too complex and hence infeasible, without vast amounts of data or sufficient language analysis models.\n",
    "From here, the algorithm is simple. We compute P(C|D) for each possible\n",
    "class, ignoring the P(D) term. Then we choose the class with the highest probability.\n",
    "As the P(D) term is constant across each of the classes, ignoring it has no impact on\n",
    "the final prediction.\n",
    "\n",
    "#### How it works\n",
    "\n",
    "As an example, suppose we have the following (binary) feature values from a\n",
    "sample in our dataset: [0, 0, 0, 1].\n",
    "Our training dataset contains two classes with 25 percent (1 out of 4) belonging to the class 1 and 75 percent (3 out of 4) of samples belonging to the class 0. The probabilities of the feature values for each class are as follows:\n",
    "\n",
    "For Class 0: [0.3, 0.4, 0.4, 0.7]\n",
    "\n",
    "For Class 1: [0.7, 0.3, 0.4, 0.9]\n",
    "\n",
    "Interpretation of these values would be: for feature 1, it is a 1 in 30 percent of cases for class 0.\n",
    "\n",
    "We can now compute the probability that this sample should belong to the class 0.\n",
    "P(C=0) = 0.75 which is the probability that the class is 0.\n",
    "P(D) isn't needed for the Naive Bayes algorithm. Let's take a look at the calculation:\n",
    "P(D|C=0) = P(D1|C=0) x P(D2|C=0) x P(D3|C=0) x P(D4|C=0)\n",
    "= 0.3 x 0.6 x 0.6 x 0.7\n",
    "= 0.0756\n",
    "\n",
    "The second and third values are 0.6, because the value of that feature\n",
    "in the sample was 0. The listed probabilities are for values of 1 for each\n",
    "feature. Therefore, the probability of a 0 is its inverse: P(0) = 1 – P(1).\n",
    "\n",
    "Now, we can compute the probability of the data sample belonging to this class.\n",
    "An important point to note is that we haven't computed P(D), so this isn't a real\n",
    "probability. However, it is good enough to compare against the same value for\n",
    "the probability of the class 1. Let's take a look at the calculation:\n",
    "\n",
    "P(C=0|D) = P(C=0) P(D|C=0)\n",
    "= 0.75 * 0.0756\n",
    "= 0.0567\n",
    "\n",
    "Now, we compute the same values for the class 1:\n",
    "\n",
    "P(C=1) = 0.25\n",
    "\n",
    "P(D) isn't needed for naive Bayes. Let's take a look at the calculation:\n",
    "\n",
    "P(D|C=1) = P(D1|C=1) x P(D2|C=1) x P(D3|C=1) x P(D4|C=1)\n",
    "= 0.7 x 0.7 x 0.6 x 0.9\n",
    "= 0.2646\n",
    "\n",
    "P(C=1|D) = P(C=1)P(D|C=1)\n",
    "= 0.25 * 0.2646\n",
    "= 0.06615\n",
    "\n",
    "The data point should be classified as belonging to the class 1. You may have\n",
    "guessed this while going through the equations anyway; however, you may have\n",
    "been a bit surprised that the final decision was so close. After all, the probabilities\n",
    "in computing P(D|C) were much, much higher for the class 1. This is because we\n",
    "introduced a prior belief that most samples generally belong to the class 0.\n",
    "\n",
    "If the classes had been equal sizes, the resulting probabilities would be much\n",
    "different. Try it yourself by changing both P(C=0) and P(C=1) to 0.5 for equal class\n",
    "sizes and computing the result again.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now that we understand the theory, implementing Naive Bayes classifier is identical to implementations of other classifiers and very simple:\n",
    "    \n",
    "We follow the same steps :\n",
    "\n",
    "1. Create a NaiveBayesClassifier object. (Here we use the BernoulliNB classifier)\n",
    "2. We fit our model on our training sets\n",
    "3. We print the Accuracies calculated on the test sets."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "NaiveBayes\n",
      "Acurracy:  0.878048780488\n",
      "time elapsed:  0.5022096633911133\n"
     ]
    }
   ],
   "source": [
    "t4=time()\n",
    "print (\"NaiveBayes\")\n",
    "nb = BernoulliNB()\n",
    "clf_nb=nb.fit(X_train,y_train)\n",
    "print (\"Acurracy: \", clf_nb.score(X_test,y_test))\n",
    "t5=time()\n",
    "print (\"time elapsed: \", t5-t4)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Thus the Accuracy is found to be 87% which is quite good for such limited data. However this accuracy might not be a perfect measure of our model efficiency. Hence we use Cross Validation :"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Cross-validation for Naive Bayes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "cross result========\n",
      "[ 0.97297297  0.94117647  0.9       ]\n",
      "0.93804981452\n",
      "time elapsed:  0.035601139068603516\n"
     ]
    }
   ],
   "source": [
    "tt4=time()\n",
    "print (\"cross result========\")\n",
    "scores = cross_validation.cross_val_score(nb, X,y, cv=3)\n",
    "print (scores)\n",
    "print (scores.mean())\n",
    "tt5=time()\n",
    "print (\"time elapsed: \", tt5-tt4)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Thus the overall accuracy using Cross Validation is 93 % which shows our Naive Bayes model is effective in classifying the Animal data."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<hr>\n",
    "### Summary\n",
    "                                                                               \n",
    "In this chapter, we looked at zoo animal clasification task which required us to preprocess that data before we actually train it using the Naive Bayes Classifier. We used a Naive Bayes classifier to perform our classification. This is built\n",
    "upon the Bayes' theorem that uses prior data to update the model, unlike the frequentist\n",
    "method that often starts with the model first. This allows the model to be flexible and and update new data, and incorporate a prior belief. In addition, the naive part allows to easily compute the probabilities without dealing with complex correlations\n",
    "between features (we used the animal features like milk, feathers, hair, eggs etc.). You can find that most text-based tasks, Naive Bayes can work pretty well. As another advantage, the Naive Bayes classifier doesn't have any parameters that need to\n",
    "be set (although there are some if you wish to do some tinkering). I suggest you take up any dataset and try to work around these parameters by the implementing the Naives Bayes algorithm. With Scikit-Learn, it should be pretty simple and fun too.\n",
    "___"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}