What the levels mean
What each of the three levels on the methods and checks pages means, and what a check does not show. The levels are the same in every app.
- Checked against a reference. The result matched expected values computed outside the app's code (another package, a published program's output, or a separate script written from the stated equations; the note names which) on recorded cases, within the stated tolerance. The test suite repeats the comparison against those stored values on every code change.
- Tested, not reference-checked. Automated tests cover worked examples, edge cases and refusals, but no comparison with a reference meets the standard above.
- Not checked. No comparison has been recorded, and the app withholds the result.
These checks show the app computes its stated method as the reference does on the recorded cases; they do not show that the method or model suits your experiment, and the software is not validated for regulated or clinical use. No independent scientist has yet reviewed these checks.