First release !

For the implemented rules, you must Visit Google details here: https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt

It include a simple API to manipulate robots.txt files.