Matched Pairs Analysis

Analyzes how consistently different models rank the same brands when answering the same question. A "matched pair" occurs when two models both mention the same brand for a given question.

Analyzing all matched pairs across all questions and models

Cross-Model Agreement

5214
Total Brand Pairs
1644
Exact Rank Matches
31.5%
Agreement Rate
1.67
Avg Rank Difference
± 1.97
Std Deviation

Model Pair Comparisons

Model A Model B Pairs Exact Matches Match Rate Avg Diff Correlation
Google Claude 2001 552 27.6% 1.78 0.297 weak
Google ChatGPT5 1657 577 34.8% 1.57 0.309 weak
ChatGPT5 Claude 1556 515 33.1% 1.65 0.264 weak

Rank Difference Distribution

1644
0 (exact)
1486
1
824
2
534
3
325
4
145
5
103
6
57
7
33
8
23
9
16
10