Significant portions of testmon have been rewritten for v 1.0.1. Although the UI is mostly the same, there are some significant differences.
Testmon requires python 3.6 or higher and pytest 5 or higher.
–testmon-singleprocess was removed (because it’s the only option now)
It’s not easy to automate the setup of subprocess measurement and therefore to automate testing it. We’re not sure if it worked outside of our environment and if anybody used it. If you miss subprocess measurement, please let us know.
--testmon-offhas been renamed to
run_variant_expression, which can be specified in pytest configuration file to distinguish different environments was renamed to
environment_expression, as it better describes it’s meaning.
Old versions of testmon got confused if you deselected some tests through other means than testmon itself. If there are bugs in this they will be squashed with priority.
Testmon reorders the test files according to tests per second average so that the quickest tests go first, but the order within the test file or test class is not changed.
Last but not least, we developed a new algorithm and database schema used for selecting tests affected by changes. It will allow us to add new functionality and continue to improve testmon. If there are not many changes determining affected tests should take hundreds of milliseconds at most. If you have to wait for testmon to find out nothing has changed, it’s a bug. Please report it. Now also whitespace and comments are taken into account when detecting changes. We hope to improve this in the future and make them insignificant.