(PUP-753) Remove duplicate calls to setup

There were two different places calling setup for the benchmarker. This
consolidates it down to one. Unfortunately, the setup method depends on
the generate method having been run already and so it not analogous to
the setup task. This meant that setup is actually called in the
generate task.