perf: don't discover tests for "Run in Terminal" option

When there a lot of tests, it can take a long time to discover all of them. 

Someone may be OK with this for the UI, but if they click "Run in terminal" it shouldn't need to discover tests at all. This should be much faster. 