This is a collection of miscellaneous scripts that I've written or modified for my use. Hopefully they may be of some use to others. When I get a chance, I'll try and update this readme with descriptions of all of the scripts.
Unless otherwise noted, these are distributed under the terms of the LICENSE file.
- add_team_to_github_org_repos.py - Python script to add a given GitHub Team to all of the specified Organization's repositories.
- apache_log_verify_site_move.py - Python script that parses Apache HTTPD access logs, finds all unique URLs, and compares the current HTTP response code to that of another server. Useful when moving a site.
- bigipcookie.pl - Perl script to de/encode F5 BigIp persistence cookies.
- check_url_list.py - Script to check a list of URLs (passed on stdin) for response code, and for response code of the final path in a series of redirects.
- cmd-wrapper.c - C wrapper for a setuid/gid command, to ensure that ONLY a certain command and args can be run.
- collectRsyslogInfo.php - Script to collect information on a crashed/hung rsyslogd process, and log it all somewhere.
- cookies_from_pdml.py - Script to parse http Cookie header field from WireShark PDML XML.
- dashsnap.py - script to snapshot a graphite dashboard at specified intervals in the past (i.e. the last 2,4,6 hours) or a single specified time range. Snapshots both PNG images and raw JSON data, builds directory with HTML files.
- disqus_backup.py - script to backup all Disqus comments for a site.
- dot_find_cycles.py - uses Pydot and NetworkX to find cycles in a dot file directed graph (i.e. the graph output of Puppet)
- dumpFirefoxSession.php - Script to dump all URLs from a Firefox3 sessionstore.js file as text or HTML
- dumpMysqlGrants.sh - Script to dump all grants from a MySQL server, for input into another.
- dump_skype_logs.py - Script to dump all Skype logs from a main.db file to HTML
- find_outdated_puppets.py - Script to look at a Puppet Dashboard unhidden-nodes.csv and extract the latest report time for each node, optionally, list nodes with runtime BEFORE a string.
- find_test_order_problems.py - Script to run tests multiple times and analyze JUnit results XML, to find tests with order-dependent failures.
- firefox_recovery_to_html.py - Script to convert Firefox profile sessionstore-backups/recovery.js to HTML links
- get_addons.py - Unmaintained script to download WoW addons from CurseForge.
- gist.py - Simple python script to upload a file as a private Gist on GitHub. Prompts interactively for Auth token, so usable from shared servers.
- git_repo_diff.py - uses GitPython to compare 2 git repo clones and report on branches that only exist in one, or have different head commits in the two repos
- github_clone_setup.py - script using github3.py to add upstream remote for any clone of a github fork, and add refs to check out pull requests from origin and upstream.
- har_urls.py - Script to dump all URLs and their status codes from a JSON HTTP Archive (HAR) file, such as those generated by the Firebug NetExport extension
- htmldata.py - Perl library to manipulate HTML or XHTML documents, required by mw2html-auth
- increment_zone_serial - This script updates/increments the bind zone file serial number in a file specified as the first argument
- ismerged - shell script that takes a git branch name, and tells if it is merged into master or not
- jira2trello.py - Python script to update a Trello board with some details from Jira.
- js2phpdoc.php - script to take comments and function prototypes from JS files and make them PHP-ish to be parsed by phpdoc
- kickRsyslog.php - script to restart rsyslog if it appears to have stopped logging
- libvirt_csv.py - Use libvirt python bindings to print CSV lists of dom0_host,domU_name,ID,state,UUID for all qemu+kvm VMs running on libvirt hosts passed in as arguments
- LICENSE - License for these files - GPLv3 with additional provisions
- linode_ddns_update.sh - simple script to use Linode's HTTP API to update Linode DNS for a dynamic IP
- linodeDnsToCsv.php - Script to pull DNS information for all of your Linode hosted zones, output as CSV
- linode_list_records.py - Simple script to list all records in Linode DNS via API, along with their type, DomainID and ResourceID
- list_github_org_repos.py - List information about an org's repositories using PyGithub (GitHub API library)
- make_puppet_param_markdown.py - # Python script to generate MarkDown docblock fragment for all parameters of a Puppet parameterized class or define. Simple, naive regex matching. Assumes you style your manifests properly.
- mw2html-auth - Produce an HTML version (standalone backup/export) of a MediaWiki site that's behind authentication
- nagios_log_problem_interval.pl - Chart intervals between problem and recovery from Nagios/Icinga logs
- nmap-xml-to-table.php - Script to transform multiple nmap XML output files (presumably of the same host/port range with different scan options) into a HTML table
- print-cmd.sh - Simple script to log environment variables and original command for forced ssh commands
- print-cmd-wrapper.c - C wrapper like cmd-wrapper.c, but just echoes back the command that was called
- pushover - script to wrap execution of a command and send Pushover and
notify-sendnotifications about its duration and exit code. - quick_cloudtrail.py - Python script to parse AWS CloudTrail log JSON files and search for a user, IP, request ID, etc.
- README.VCS - Note on my CVS/SVN to github migration
- rebuild_srpm.sh - Script to rebuild a SRPM 1:1, useful when you want to build a RHEL/CentOS 6 SRPM on a RHEL/CentOS 5 system that doesn't support newer compression (cpio: MD5 sum mismatch)
- reviewboard_reminder_mail.py - ReviewBoard - Script to send reminder emails for any open reviews, targeted at a specific group, not updated in more than X days.
- route53_ddns_update.sh - Bash script to update Route53 dynamic DNS
- rss_to_mail_config.py - sample configuration file for rss_to_mail.py
- rss_to_mail.py - Dead simple python script to find new entries in an RSS feed, and email listing of new entries matching a regex to you. Intended to be run via cron.
- rsync-wrapper.c - setuid/gid wrapper around rsync. Useful to allow members of a specified group to do rsync backups as root over SSH.
- rsyslogIsHung.php - script to investigate rsyslog hangs, write output, and send mail
- rsyslogPstats.php - script to parse rsyslog impstats output and generate a simple report
- savescreen.py - Python script to save screen windows and titles, and write a screenrc to recreate them.
- scrape_domain.py - Python script using requests and BeautifulSoup4 to request all URLs/links/images/CSS/feeds/etc. found on a domain.
- show_cf_template_params.py - Show all parameters and their defaults for a CloudFormation template
- show_dhcp_fixed_ACKs.pl - script to show the most recent DHCP ACKs per IP address for ISC DHCPd, from a log file. Originally written for Vyatta routers that just show the dynamic leases
- simpleLCDproc.py - Simple LCDproc replacement in Python. Uses LCDd server.
- skeleton.py - Skeleton of a one-off Python CLI script, including optparse and logging.
- sync_git_clones.sh - WIP / Alpha - Script to sync all local git clones in a list of paths with origin (and upstream, if configured). If present, uses github_clone_setup.py to setup upstream branches for any GitHub forks, and set refs to check out pull requests from origin and upstream.
- sync_git_clones.conf - config file for sync_git_clones.sh
- syslogAgeChecker.php - script to check timestamp of last syslog line in some files, and send mail if >= X seconds
- syslogDatesGraph.php - script to help visualize time distribution of syslog messages. This is the graph host part.
- syslogDatesToArray.php - script to help visualize time distribution of syslog messages. This is the log host part.
- syslogDatesToArray-sample.ser - example serialized data for syslogDatesGraph.php
- test_libvirt.py - some tests using the libvirt python bindings, for qemu+kvm hosts accessed over SSH
- timeout - shell script to execute a command with a timeout
- tomtom_tsp.py - Script to take a list of TomTom WoW addon coordinates and output them in the optimal order.
- twitter_find_followed_not_in_list.py - Simple script to list anyone whom you're following but isn't in one of your lists.
- ubiquiti-mac-acl/ - PHP script and MySQL schema to manage the MAC ACL on Ubiquiti AirOS2 devices.
- VipToInternalHosts.pl - script to take F5 BigIp VIP address and display the members of the pool it is served by
- watch_cloudformation.py - Python script to watch a CloudFormation stack's events, and exit when the CF stack update or create finishes. Optional notification via PushOver.
- watch_elasticsearch.py - Python script to watch an ElasticSearch cluster's status and exit/notify when the status changes. Optional notifivation via PushOver.
- watch_jenkins.py - Python script using python-jenkins (https://pypi.python.org/pypi/python-jenkins) to watch a job (specified by URL), and exit 0 on success or 1 on failure. Optional notification via PushOver.
- wiki-to-deckjs.py - simple, awful script to change markdown-like (very restricted markup set) markup to deck.js-ready html
- wordpress_daily_post.php - Script to publish the oldest post with a given status, if no other post has been published in 24 hours. Intended to be run via cron on weekdays