Turns out what also breaks it is what might be a bug in Bash causing
HIST* vars in Debian's .bashrc trim the history immediately, before wwe
get a chance to set it to a huge number.
The workaround -- which cannot be done safely within bashum -- is to
comment any HIST* variables in your .bashrc.