20% of openshift tests are not run

I realized Openshift builds only run ~ 337 tests via tycho, but we have about 411 tests to run.
This is caused by that stupid tycho-surefire setting that only runs testsuites. Guess what? Some of those test classes are not added to any test suite.
As a developer I just write my test class and expect the build to pick it up automatically