Brian pointed out my previous commit had a typo in the test configuration file, shouldn't have been committed either way. We then noted that errors in the option config were never reported, only ignored.