[#4090] Fix the run_mode for certs and put tests on the applications to assert their run_mode

Also cleanup of an unecessary puts line, make master tests run when
on their own, and moving a require to a more usual spot.