← MIROIR

What we tested, and what failed

We wrote the pass/fail rules and committed them before running these tests. Neither test measures whether a colour season is correct. That would need trained colour analysts, and we have not done it. These tests ask whether the reading is stable, and whether the app warns you when it isn't.

Main finding: the season depends on the photo

Five photos of the same person gave 5 different seasons. The app's confidence did not always warn about it: two of these photos, labelled as poor capture conditions, still showed 88%. Treat a single scan as a starting point, not an answer.

PhotoConditionSeasonConfidence
indoorindoorTrue Spring81%
backlitstressSoft Summer50%
dimstressDeep Winter88%
low-anglestressDeep Autumn88%
processedstressBright Spring50%

Lighting stress test

We applied seven simulated lighting changes to 7 selfies of one person (49cases), and compared each result with that photo's own reading. The colour correction helps a lot, but the season still changed too often.

RuleResultNeededVerdict
L1 Correction helpsMedian ΔE 4.2 corrected, 20.4 uncorrectedLower with correctionPassed
L2 Colour stays closeMedian ΔE 4.210 or lowerPassed
L3 Season holds77.6% of 49 casesAt least 80%Failed
L4 No large jumps77.6% of 49 casesAt least 90%Failed
L5 Season changes are flagged81.8% of 11 changesAt least 80%Passed

Live pilot: 15 scans, 5 photos, 1 person

With one person, this is a pilot, so our rules don't allow any rule to be reported as passed.

Limits

Check it