Following discussions on #871 (on here and IRL with @fpagnoux) we've identified a few "sticks" that should be moved out of the way before implementing some performance optimizations that seem quite promising (split-and-combine, and possibly later taking advantage of static analysis to prune the computation tree ahead of time).

These include #885 and #886 to warm up. The next significant bit is to make the caching API explicit.