长期知识工作

AA-Briefcase

AA-Briefcase 公开评测榜单:面向多步骤、长周期知识工作的专有评测。本站保留来源口径,不合成新的综合评分。

数据快照:2026-09-18T01:47:51.384Z查看原始来源 ↗
主要指标Elo
快照日期2026-09-18T01:47:51.384Z
169 / 169 个模型
公开评测完整榜单
排名机构模型Elo95% CI发布日期
1AnthropicClaude Fable 5.1 (Adaptive Reasoning, Xhigh Effort, Default Fallback)1,650
裁判协议 v4.3.1
-9 / +9Sep 2026
2AnthropicClaude Fable 5.1 (Adaptive Reasoning, Max Effort, Default Fallback)1,646
裁判协议 v4.3.1
-8 / +8Sep 2026
3AnthropicClaude Opus 5 (Adaptive Reasoning, Max Effort)1,633
裁判协议 v4.3.1
-6 / +7Jul 2026
4AnthropicClaude Opus 5 (Adaptive Reasoning, Xhigh Effort)1,625
裁判协议 v4.3.1
-7 / +8Jul 2026
5AlibabaQwen3.8 Max (0902)1,610
裁判协议 v4.3.1
-10 / +10Sep 2026
6MetaMuse Spark 1.3 (max)1,589
裁判协议 v4.3.1
-11 / +11Sep 2026
7AlibabaQwen3.8-Flash-Next1,587
裁判协议 v4.3.1
-10 / +11Aug 2026
8AnthropicClaude Fable 5.1 (Adaptive Reasoning, High Effort, Default Fallback)1,578
裁判协议 v4.3.1
-8 / +9Sep 2026
9OpenAIGPT-6 Astra (max)1,562
裁判协议 v4.3.1
-9 / +10Sep 2026
10AnthropicClaude Opus 5 (Adaptive Reasoning, High Effort)1,557
裁判协议 v4.3.1
-7 / +7Jul 2026
11SpaceXAIGrok 4.6 (xhigh)1,545
裁判协议 v4.3.1
-6 / +7Aug 2026
12SpaceXAIGrok 4.6 (high)1,534
裁判协议 v4.3.1
-6 / +7Aug 2026
13OpenAIGPT-6 Astra (xhigh)1,534
裁判协议 v4.3.1
-9 / +10Sep 2026
14AnthropicClaude Fable 5.1 (Adaptive Reasoning, Medium Effort, Default Fallback)1,531
裁判协议 v4.3.1
-8 / +9Sep 2026
15AnthropicClaude Fable 51,530
裁判协议 v4.3.1
-6 / +6Jun 2026
16Z AIGLM-5.3 (max)1,504
裁判协议 v4.3.1
-7 / +8Aug 2026
17OpenAIGPT-6 Astra (high)1,494
裁判协议 v4.3.1
-9 / +10Sep 2026
18SpaceXAIGrok 4.6 (medium)1,491
裁判协议 v4.3.1
-6 / +7Aug 2026
19KimiKimi K3 (max)1,488
裁判协议 v4.3.1
-5 / +6Jul 2026
20AnthropicClaude Fable 5.1 (Adaptive Reasoning, Low Effort, Default Fallback)1,484
裁判协议 v4.3.1
-8 / +8Sep 2026
21MetaMuse Spark 1.3 (xhigh)1,483
裁判协议 v4.3.1
-10 / +11Sep 2026
22OpenAIGPT-5.6 Sol (max)1,463
裁判协议 v4.3.1
-6 / +7Jul 2026
23OpenAIGPT-6 Astra (medium)1,451
裁判协议 v4.3.1
-9 / +9Sep 2026
24Z AIGLM 5.3 Flash1,449
裁判协议 v4.3.1
-9 / +9Aug 2026
25AnthropicClaude Opus 5 (Adaptive Reasoning, Medium Effort)1,439
裁判协议 v4.3.1
-6 / +7Jul 2026
26AlibabaQwen3.8 2.4T A95B1,439
裁判协议 v4.3.1
-7 / +8Aug 2026
27OpenAIGPT-5.6 Sol (xhigh)1,435
裁判协议 v4.3.1
-8 / +9Jul 2026
28DeepSeekDeepSeek V4 Flash Vision (Reasoning, Max Effort)1,432
裁判协议 v4.3.1
-9 / +10Aug 2026
29DeepSeekDeepSeek V4.1 Flash (Reasoning, Max Effort)1,424
裁判协议 v4.3.1
-10 / +10Sep 2026
30AlibabaQwen3.8 27B (xhigh)1,398
裁判协议 v4.3.1
-7 / +7Aug 2026
31AlibabaQwen3.8 Max1,388
裁判协议 v4.3.1
-6 / +7Aug 2026
32AlibabaQwen3.8 27B (medium)1,376
裁判协议 v4.3.1
-9 / +9Aug 2026
33OpenAIGPT-5.6 Sol (high)1,361
裁判协议 v4.3.1
-8 / +9Jul 2026
34AnthropicClaude Sonnet 5 (Adaptive Reasoning, Max Effort)1,355
裁判协议 v4.3.1
-6 / +6Jun 2026
35MetaMuse Spark 1.2 (xhigh)1,344
裁判协议 v4.3.1
-6 / +7Aug 2026
36OpenAIGPT-5.6 Terra (xhigh)1,337
裁判协议 v4.3.1
-9 / +9Jul 2026
37OpenAIGPT-5.6 Luna (max)1,333
裁判协议 v4.3.1
-6 / +6Jul 2026
38OpenAIGPT-5.6 Terra (max)1,330
裁判协议 v4.3.1
-7 / +7Jul 2026
39AnthropicClaude Opus 4.8 (Adaptive Reasoning, Max Effort)1,316
裁判协议 v4.3.1
-6 / +6May 2026
40Institute of Foundation ModelsK2 Horizon 375B A23B1,298
裁判协议 v4.3.1
-8 / +8Sep 2026
41SpaceXAIGrok 4.6 (low)1,293
裁判协议 v4.3.1
-7 / +7Aug 2026
42SpaceXAIGrok 4.5 (high)1,283
裁判协议 v4.3.1
-6 / +7Jul 2026
43AlibabaQwen3.8 27B (low)1,277
裁判协议 v4.3.1
-10 / +10Aug 2026
44AnthropicClaude Sonnet 5 (Adaptive Reasoning, Xhigh Effort)1,273
裁判协议 v4.3.1
-6 / +6Jun 2026
45OpenAIGPT-5.6 Luna (xhigh)1,268
裁判协议 v4.3.1
-9 / +9Jul 2026
46DeepSeekDeepSeek V4 Pro 0813 (Reasoning, Max Effort)1,265
裁判协议 v4.3.1
-6 / +7Aug 2026
47OpenAIGPT-6 Astra (low)1,253
裁判协议 v4.3.1
-9 / +9Sep 2026
48DeepSeekDeepSeek V4 Flash 0731 (Reasoning, Max Effort)1,253
裁判协议 v4.3.1
-6 / +7Jul 2026
49AnthropicClaude Opus 4.7 (Adaptive Reasoning, Max Effort)1,252
裁判协议 v4.3.1
-6 / +6Apr 2026
50OpenAIGPT-5.6 Sol (medium)1,237
裁判协议 v4.3.1
-7 / +7Jul 2026
51Z AIGLM-5.2 (max)1,231
裁判协议 v4.3.1
-6 / +7Jun 2026
52AnthropicClaude Opus 5 (Adaptive Reasoning, Low Effort)1,216
裁判协议 v4.3.1
-6 / +7Jul 2026
53GoogleGemini 3.8 Flash (high)1,202
裁判协议 v4.3.1
-8 / +9Sep 2026
54OpenAIGPT-5.6 Terra (high)1,201
裁判协议 v4.3.1
-9 / +9Jul 2026
55Sapiens AIAgnes 2.5 Pro Alpha1,195
裁判协议 v4.3.1
-9 / +9Jul 2026
56AnthropicClaude Sonnet 5 (Adaptive Reasoning, High Effort)1,178
裁判协议 v4.3.1
-6 / +6Jun 2026
57GoogleGemini 3.8 Flash (medium)1,177
裁判协议 v4.3.1
-10 / +10Sep 2026
58OpenAIGPT-5.6 Luna (high)1,173
裁判协议 v4.3.1
-8 / +8Jul 2026
59Institute of Foundation ModelsK2 Horizon MoVA 36B A4B1,170
裁判协议 v4.3.1
-10 / +11Sep 2026
60OpenAIGPT-5.5 (xhigh)1,136
裁判协议 v4.3.1
-6 / +7Apr 2026
61Multiverse ComputingQuasar 438B (max, based on GLM-5.2)1,123
裁判协议 v4.3.1
-10 / +10Aug 2026
62GoogleGemini 3.7 Flash (high)1,116
裁判协议 v4.3.1
-6 / +7Aug 2026
63MiniMaxMiniMax-M31,096
裁判协议 v4.3.1
-6 / +7Jun 2026
64OpenAIGPT-5.5 (high)1,089
裁判协议 v4.3.1
-6 / +6Apr 2026
65OpenAIGPT-5.5 Instant (June 2026)1,082
裁判协议 v4.3.1
-9 / +10Jun 2026
66AnthropicClaude Opus 4.7 (Non-reasoning, High Effort)1,071
裁判协议 v4.3.1
-6 / +6Apr 2026
67AnthropicClaude Sonnet 4.6 (Adaptive Reasoning, Max Effort)1,065
裁判协议 v4.3.1
-6 / +6Feb 2026
68GoogleGemini 3.8 Flash (low)1,056
裁判协议 v4.3.1
-9 / +9Sep 2026
69AnthropicClaude Sonnet 5 (Adaptive Reasoning, Medium Effort)1,054
裁判协议 v4.3.1
-6 / +6Jun 2026
70DeepSeekDeepSeek V4 Flash 0420 (Reasoning, High Effort)1,052
裁判协议 v4.3.1
-11 / +10Apr 2026
71OpenAIGPT-5.6 Sol (low)1,042
裁判协议 v4.3.1
-8 / +9Jul 2026
72OpenAIGPT-5.6 Terra (medium)1,041
裁判协议 v4.3.1
-8 / +8Jul 2026
73Institute of Foundation ModelsK2 Horizon 7B1,021
裁判协议 v4.3.1
-10 / +10Sep 2026
74OpenAIGPT-5.6 Sol (Non-reasoning)1,015
裁判协议 v4.3.1
-7 / +8Jul 2026
75OpenAIGPT-5.6 Terra (low)1,014
裁判协议 v4.3.1
-9 / +8Jul 2026
76OpenAIGPT-5.5 (medium)1,000
裁判协议 v4.3.1
-0 / +0Apr 2026
77InclusionAILing-3.0-flash-VL986
裁判协议 v4.3.1
-10 / +10Sep 2026
78KimiKimi K3 (low)985
裁判协议 v4.3.1
-8 / +8Jul 2026
79InclusionAILing-3.0-flash-Fin967
裁判协议 v4.3.1
-10 / +10Sep 2026
80Z AIGLM-5.1 (Reasoning)964
裁判协议 v4.3.1
-6 / +6Apr 2026
81GoogleGemini 3.6 Flash (high)953
裁判协议 v4.3.1
-7 / +7Jul 2026
82TencentHy3950
裁判协议 v4.3.1
-10 / +10Jul 2026
83OpenAIGPT-5.6 Terra (Non-reasoning)948
裁判协议 v4.3.1
-8 / +8Jul 2026
84OpenAIGPT-5.6 Luna (medium)935
裁判协议 v4.3.1
-8 / +8Jul 2026
85AnthropicClaude Sonnet 5 (Adaptive Reasoning, Low Effort)927
裁判协议 v4.3.1
-7 / +7Jun 2026
86DeepSeekDeepSeek V4 Pro 0424 (Reasoning, Max Effort)925
裁判协议 v4.3.1
-6 / +6Apr 2026
87AlibabaQwen3.7 Max918
裁判协议 v4.3.1
-6 / +6May 2026
88AlibabaQwen3.7 Plus913
裁判协议 v4.3.1
-9 / +9Jun 2026
89Thinking MachinesInkling Small912
裁判协议 v4.3.1
-7 / +8Jul 2026
90XiaomiMiMo-V2.5-Pro883
裁判协议 v4.3.1
-7 / +7Apr 2026
91NVIDIANemotron 3 Ultra 550B A55B (Reasoning)878
裁判协议 v4.3.1
-7 / +7Jun 2026
92GoogleGemini 3.5 Flash (medium)871
裁判协议 v4.3.1
-7 / +7May 2026
93GoogleGemini 3.5 Flash (high)870
裁判协议 v4.3.1
-7 / +6May 2026
94OpenAIGPT-5.3 Codex (xhigh)866
裁判协议 v4.3.1
-7 / +6Feb 2026
95MetaMuse Spark 1.1 (xhigh)860
裁判协议 v4.3.1
-8 / +8Jul 2026
96KimiKimi K2.7 Code856
裁判协议 v4.3.1
-10 / +9Jun 2026
97Thinking MachinesInkling (xhigh)836
裁判协议 v4.3.1
-8 / +7Jul 2026
98DeepSeekDeepSeek V4 Flash 0420 (Reasoning, Max Effort)833
裁判协议 v4.3.1
-6 / +6Apr 2026
99KimiKimi K2.6824
裁判协议 v4.3.1
-6 / +6Apr 2026
100AlibabaQwen3.6 27B (Reasoning)812
裁判协议 v4.3.1
-7 / +7Apr 2026
101InclusionAILing 3.0 Flash802
裁判协议 v4.3.1
-8 / +7Aug 2026
102Institute of Foundation ModelsK2 Horizon 3.7B793
裁判协议 v4.3.1
-11 / +10Sep 2026
103SpaceXAIGrok 4.3 (high)762
裁判协议 v4.3.1
-7 / +7Apr 2026
104XiaomiMiMo-V2.5751
裁判协议 v4.3.1
-9 / +9Apr 2026
105OpenAIGPT-5.6 Luna (low)744
裁判协议 v4.3.1
-9 / +9Jul 2026
106LongCatLongCat 2.0739
裁判协议 v4.3.1
-10 / +10Jun 2026
107SpaceXAIGrok 4.3 (Non-reasoning)724
裁判协议 v4.3.1
-10 / +10Apr 2026
108OpenAIGPT-5.4 mini (xhigh)719
裁判协议 v4.3.1
-7 / +7Mar 2026
109MiniMaxMiniMax-M2.7715
裁判协议 v4.3.1
-9 / +10Mar 2026
110AnthropicClaude 4.5 Sonnet (Reasoning)712
裁判协议 v4.3.1
-10 / +9Sep 2025
111AlibabaQwen3.6 35B A3B (Reasoning)711
裁判协议 v4.3.1
-9 / +8Apr 2026
112OpenAIGPT-5.6 Luna (Non-reasoning)710
裁判协议 v4.3.1
-8 / +8Jul 2026
113OpenAIGPT-5.4 nano (xhigh)670
裁判协议 v4.3.1
-10 / +10Mar 2026
114InclusionAIRing-2.6-1T654
裁判协议 v4.3.1
-10 / +9May 2026
115GoogleGemini 3.5 Flash-Lite645
裁判协议 v4.3.1
-8 / +8Jul 2026
116MetaMuse Spark644
裁判协议 v4.3.1
-7 / +7Apr 2026
117AnthropicClaude 4.5 Haiku (Reasoning)614
裁判协议 v4.3.1
-7 / +7Oct 2025
118KwaiKATKAT-Coder-Pro V1602
裁判协议 v4.3.1
-8 / +8Nov 2025
119AlibabaQwen3.5 397B A17B (Reasoning)563
裁判协议 v4.3.1
-8 / +7Feb 2026
120MistralMistral Medium 3.1538
裁判协议 v4.3.1
-9 / +8Aug 2025
121MistralMistral Medium 3.5524
裁判协议 v4.3.1
-8 / +7Apr 2026
122NVIDIANemotron 3.5 Lightning509
裁判协议 v4.3.1
-10 / +10Aug 2026
123AlibabaQwen3.5 122B A10B (Reasoning)499
裁判协议 v4.3.1
-9 / +9Feb 2026
124MistralDevstral Small 2496
裁判协议 v4.3.1
-10 / +9Dec 2025
125MistralDevstral 2483
裁判协议 v4.3.1
-11 / +11Dec 2025
126InclusionAILing 3.0 Tiny481
裁判协议 v4.3.1
-10 / +9Aug 2026
127MetaMuse Glimmer (high)481
裁判协议 v4.3.1
-9 / +8Aug 2026
128DeepSeekDeepSeek V3.1 Terminus (Reasoning)464
裁判协议 v4.3.1
-10 / +9Sep 2025
129GoogleGemini 3.1 Pro Preview459
裁判协议 v4.3.1
-8 / +8Feb 2026
130OpenAIGPT-5 mini (high)438
裁判协议 v4.3.1
-10 / +9Aug 2025
131OpenBMBMiniCPM5-2B434
裁判协议 v4.3.1
-11 / +11Sep 2026
132AlibabaQwen3 Coder Next414
裁判协议 v4.3.1
-10 / +10Feb 2026
133GoogleGemma 4 31B (Reasoning)377
裁判协议 v4.3.1
-8 / +8Apr 2026
134CohereCommand A+366
裁判协议 v4.3.1
-10 / +9May 2026
135MistralMistral Small 3.1325
裁判协议 v4.3.1
-10 / +9Mar 2025
136IBMGranite 4.2 8B320
裁判协议 v4.3.1
-10 / +9Aug 2026
137GoogleGemini 2.5 Pro315
裁判协议 v4.3.1
-10 / +9Jun 2025
138InceptionMercury 2280
裁判协议 v4.3.1
-9 / +9Feb 2026
139Arcee AITrinity Large Thinking271
裁判协议 v4.3.1
-10 / +9Apr 2026
140MistralMistral Small 4 (Reasoning)256
裁判协议 v4.3.1
-10 / +10Mar 2026
141Multiverse ComputingHyperNova 60B 2605 (high, based on gpt-oss-120b)249
裁判协议 v4.3.1
-10 / +10May 2026
142MistralMistral Large 3246
裁判协议 v4.3.1
-9 / +9Dec 2025
143CohereNorth Mini Code234
裁判协议 v4.3.1
-10 / +8Jun 2026
144GoogleGemini 3.1 Flash-Lite226
裁判协议 v4.3.1
-9 / +8Mar 2026
145AlibabaQwen3 235B A22B 2507 (Reasoning)190
裁判协议 v4.3.1
-12 / +10Jul 2025
146CelerisCeleris-1172
裁判协议 v4.3.1
-10 / +9Jul 2026
147OpenAIo3-mini (high)161
裁判协议 v4.3.1
-10 / +10Jan 2025
148MistralMinistral 3 14B150
裁判协议 v4.3.1
-10 / +9Dec 2025
149DeepSeekDeepSeek R1 (Jan '25)150
裁判协议 v4.3.1
-10 / +10Jan 2025
150UpstageSolar Pro 3122
裁判协议 v4.3.1
-9 / +9Apr 2026
151IBMGranite 4.2 3B121
裁判协议 v4.3.1
-11 / +10Aug 2026
152NVIDIANVIDIA Nemotron 3 Nano 30B A3B (Reasoning)100
裁判协议 v4.3.1
-11 / +9Dec 2025
153DeepSeekDeepSeek V3 (Dec '24)100
裁判协议 v4.3.1
-12 / +11Dec 2024
154MistralMinistral 3 8B99
裁判协议 v4.3.1
-11 / +10Dec 2025
155DeepSeekDeepSeek V3 032492
裁判协议 v4.3.1
-11 / +10Mar 2025
156Institute of Foundation ModelsK2 Think V234
裁判协议 v4.3.1
-9 / +9Dec 2025
157AlibabaQwen3 30B A3B 2507 (Reasoning)32
裁判协议 v4.3.1
-12 / +11Jul 2025
158MistralMinistral 3 3B16
裁判协议 v4.3.1
-11 / +9Dec 2025
159AlibabaQwen3 32B (Reasoning)9
裁判协议 v4.3.1
-9 / +10Apr 2025
160NVIDIANemotron 3 Super 120B A12B (Reasoning)0
裁判协议 v4.3.1
-0 / +0Mar 2026
161OpenAIgpt-oss-120b (high)0
裁判协议 v4.3.1
-0 / +0Aug 2025
162MetaLlama 4 Maverick0
裁判协议 v4.3.1
-0 / +0Apr 2025
163OpenAIgpt-oss-20b (high)0
裁判协议 v4.3.1
-0 / +0Aug 2025
164MistralMistral Small 3.20
裁判协议 v4.3.1
-0 / +0Jun 2025
165MetaLlama 4 Scout0
裁判协议 v4.3.1
-0 / +0Apr 2025
166AlibabaQwen3 14B (Reasoning)0
裁判协议 v4.3.1
-0 / +0Apr 2025
167AlibabaQwen3 8B (Reasoning)0
裁判协议 v4.3.1
-0 / +0Apr 2025
168Institute of Foundation ModelsK2 Horizon 0.9B0
裁判协议 v4.3.1
-0 / +0Sep 2026
OpenAIGPT-6 Astra (Non-reasoning)
本轮来源未列出,保留上次观测
1,471
历史参考 2026-09-12
-8 / +9
历史参考 2026-09-12
Sep 2026

实时 Elo 的裁判协议与可比边界

AA-Briefcase 与 GDPval-AA v2 的当前成对比较使用裁判协议 v4.3.1,原评测名称与任务版本不变,Intelligence Index 仍为 v4.3。未区分裁判协议的旧 Elo 保留原始观测,仅作历史参考,不与当前协议混排。

指数中的 Elo 贡献在模型加入时冻结;实时榜单分数不能用于重算指数。来源未给出逐模型重跑日期,不能把裁判更新或跨协议分数差解释成新的模型运行或能力变化。

查看裁判、核验时间与完整方法边界 →查看 AA 原始方法 ↗

这个评测关注什么

面向多步骤、长周期知识工作的专有评测。

阅读时注意

评测结果受任务集合、评分方法和模型版本影响。本站保留原始口径,不用它生成新的综合排名。

适用场景

用于回答一个明确的问题:模型在这一类任务上的相对表现如何,而不是“哪个模型绝对最好”。