What needs to be clarified
The task is to test whether the difference is reproducible and connect observed behaviour to specific input data and agreed requirements.
Materials to prepare
- The specification and change history
- Application versions and agreed test data
- Logs and examples from before and after the update
What to compare
- Compare versions, settings and input values in each example.
- Check repeatability on an agreed test copy without altering production data.
- Distinguish an implementation defect, a changed requirement and insufficient preserved evidence.
Possible outcome of the analysis
A technical document can record reproduction conditions, compare results and answer whether the tested function matches the specification.
Limits of the conclusions
Findings concern the examined versions and scenarios; a technical discrepancy alone does not establish breach of contract or the amount of loss.