Handle .unwrap()s gracefully

[fjarri]

As a temporary measure, there's a number of unwrap() throughout the code base. These need to be removed and replaced with error propagation. When it's done, warn(clippy::unwrap_used) in lib.rs should be enabled (or even changed to deny). Also look for assert!.