ATL-2026-014experimentexperimental
Compare which deliberate breaches of a pickup-point selection contract are caught by initial and strengthened tests.
green-tests-mutation-trial
Exact experiment revision
open8381011/experiments/green-tests-mutation-trial ↗fac2c1a528ece08a6fb4ae1319df1b528d591795EVIDENCE SIGNATURE
51fe8db5900791a8b5efa224572e7dce3eaf16f6b63589f15e4f6e7f7f4f099e2026-09-29Environment
- os
- macOS
- architecture
- arm64
- dart
- 3.12.2
- node
- 22.17.1
Preparation
Use a temporary clone and Dart 3.12.2 / Node 22.17.1; run dart --suppress-analytics pub get --offline with cached dependenciesExecution
TRIAL_DART=/absolute/path/to/dart node tool/run.mjsInputs
https://gitlab.com/open8381011/experiments/green-tests-mutation-trial/-/blob/fac2c1a528ece08a6fb4ae1319df1b528d591795/README.md ↗https://gitlab.com/open8381011/experiments/green-tests-mutation-trial/-/blob/fac2c1a528ece08a6fb4ae1319df1b528d591795/lib/selection.dart ↗https://gitlab.com/open8381011/experiments/green-tests-mutation-trial/-/tree/fac2c1a528ece08a6fb4ae1319df1b528d591795/test ↗Expected outputs
https://gitlab.com/open8381011/experiments/green-tests-mutation-trial/-/blob/fac2c1a528ece08a6fb4ae1319df1b528d591795/evidence/results.json ↗https://gitlab.com/open8381011/experiments/green-tests-mutation-trial/-/tree/fac2c1a528ece08a6fb4ae1319df1b528d591795/evidence ↗Observed result
f52d31dd2e146fb05a030e7c8a309bc67810d3f64280f7ecf71c3f1319ec1bfd1×Limitations
- Teaching Dart fixture with deliberately selected faults; 2/5 and 5/5 describe only these five. Coverage of 13/13 lines does not measure branch or scenario completeness or the correctness of requirements. UI, networking, availability freshness and reservations were not tested.