planning.md

High-level package planning

2016-12-23

• Package vision
  • Purpose
  • Questions to resolve
  • Priorities

This page is for planning the janitor package, at a high level. More-finite questions and ideas can be handled via GitHub issues. This is for say, articulating what the package does or doesn't do, and how it should be organized. If it turns out we need a more discussion- and comment-friendly format, we can move to Google Docs, but let's try commenting and editing here.

Package vision

Purpose

Provide a framework and associated functions for checking and cleaning dirty data. There are two kinds of checks: interactive checks, like tabyl, and programmatic checks that say, confirm in production that some variables contain no duplicate records, or contain no missing values.

In scope:

Out of scope:

• A thorough set of alerting functions for assertive data cleaning in production (instead, recommend assertr or other package)

Questions to resolve

1. Where should the organizing framework go - vignette? Bookdown? Main page?

Priorities

Big items

1. Establish organizing framework for the package

   1. Write up documentation/vignette showing check/clean iterative cycle
   2. Figure out new names for functions to fit schema, and rename them
   3. Redo vignette
   4. Redo homepage

2. New function: fuzzy dupes

3. New function family: bindability issues

Smaller items

1. get_dupes should have an option for returning with or without Ns as a column (it's so much faster without)