SWE-gen 进度看板

最后更新时间:2026-05-13 16:15:09 BJT | 下次刷新:2026-05-13 17:15:10 BJT | 刷新间隔:3600 秒

收集 PR 总数
424,653
1h +720 / 24h +921
有效 SWE 总数
28,801
1h +24 / 24h +216
整体处理成功率
47.5%
Valid SWE / 已处理目录 60,677
difficulty_score 均值
5.77
median 5.7,count 28,754

语言进度

语言收集 PR过去 1h过去 24h有效 SWE过去 1h过去 24h已处理目录处理成功率
Cc28,202007,7340010,431
74.1%
C++cpp43,066001,907+6+544,249
44.9%
Gogo88,022+414+5054,449+2+4210,962
40.6%
Javajava59,923+34+402,631+11+276,432
40.9%
JavaScriptjs30,941+155+1553,667+1+17,877
46.6%
Pythonpy68,0830+512,518007,949
31.7%
Rustrust50,455+19+692,5040+355,426
46.1%
TypeScriptts55,961+98+1013,391+4+577,351
46.1%

运行参数

语言评估模型 (OPENAI)填充模型 (ANTHROPIC)并发数min_source_filesmax_source_files
Cgpt-5.4claude-sonnet-4-616215
C++gpt-5.4claude-sonnet-4-616215
Gogpt-5.4claude-sonnet-4-616210
Javaclaude-haiku-4-5-20251001claude-sonnet-4-616210
JavaScriptglmmoedsaglmmoedsa16210
PythonMiniMax-M2.7MiniMax-M2.716315
Rustgpt-5.4claude-opus-4-616210
TypeScriptgpt-5.4claude-sonnet-4-616210

失败原因统计

语言已处理成功失败trivial_prvalidationinfra_errortimeoutworkflow_error其他
C39,7988,22031,57813,8092,26412,7306801,855240
C++23,4912,09521,3965,05558014,883224381273
Go30,1576,52923,62810,5332,1966,5831,5881,1781,550
Java14,7572,98511,7724,7271,5913,2152573681,614
JavaScript16,9725,11411,8587,3861,7945293596371,153
Python22,9152,63020,2858,8592,5348,204238317133
Rust17,5372,94414,5934,4051,1555,5426371,6201,234
TypeScript36,9773,39333,5846,65788622,8561812,899105

fix.patch 复杂度

语言Valid SWE CountAvg fix.patch linesAvg fix.patch hunksAvg fix.patch files
C7,734281.2215.404.93
C++1,907330.9311.464.53
Go4,449271.2114.934.97
Java2,631171.0510.944.47
JavaScript3,66773.306.212.76
Python2,518135.789.993.44
Rust2,504257.0812.864.06
TypeScript3,391159.629.094.09

统计方法说明

难度打分 difficulty_score

读取每个有效任务目录的 solution/fix.patchtests/instruction.md,由 src/swegen/scoring.py 使用零 API 静态评分。

当前公式采用 log-scale 连续评分,避免中等规模 patch 过早变成 hard。权重为:patch_scope 38%logic_complexity 32%context_breadth 15%test_complexity 10%instruction_complexity 5%

label 阈值:easy <= 4.0medium <= 7.0hard > 7.0

Tags 生成与展示

tags 不是看板现场计算的,而是在 swegen 构建任务时由 LLM 根据 PR 信息生成,并写入 task.toml[metadata].tags

prompt 要求 tags 按三段式生成:编程语言、项目层级/领域、框架/库名或具体主题。看板只读取已有 task.toml 并统计每个语言的 tag 出现次数和占比。

fix.patch 统计

patch 统计来自每个有效任务的 solution/fix.patch,并按语言扩展名过滤代码文件,口径与 upload_march_swe_to_hf.py 的 code-only 统计保持一致。

Avg fix.patch lines 统计代码文件 diff 中新增/删除行数;Avg fix.patch hunks 统计 @@ hunk 数;Avg fix.patch files 统计涉及的代码文件数。

difficulty_label 分布

语言easy / medium / hardeasymediumhard
C
735 / 5189 / 1802
7355,1891,802
C++
321 / 1190 / 392
3211,190392
Go
370 / 3278 / 795
3703,278795
Java
349 / 1673 / 606
3491,673606
JavaScript
593 / 2725 / 348
5932,725348
Python
211 / 1724 / 560
2111,724560
Rust
260 / 1465 / 777
2601,465777
TypeScript
346 / 2570 / 475
3462,570475

difficulty_score 概览

语言countminp25medianmeanp75max
C7,7262.44.95.95.917.09.2
C++1,9032.54.45.65.636.89.0
Go4,4432.64.95.85.816.79.1
Java2,6282.84.75.95.816.99.2
JavaScript3,6662.64.45.25.286.19.2
Python2,4952.64.95.85.906.98.9
Rust2,5022.74.96.26.117.49.0
TypeScript3,3912.74.65.55.586.58.9

全局 Top Tags

library13,005 (45.2%)
backend8,866 (30.8%)
cli4,019 (14.0%)
frontend1,704 (5.9%)
testing1,239 (4.3%)
react917 (3.2%)
http906 (3.1%)
framework778 (2.7%)
embedded567 (2.0%)
cpp396 (1.4%)
networking360 (1.3%)
async328 (1.1%)
kubernetes260 (0.9%)
graphql231 (0.8%)
postgresql226 (0.8%)
eslint217 (0.8%)
parsing207 (0.7%)
aws182 (0.6%)
angular174 (0.6%)
kernel173 (0.6%)
compiler172 (0.6%)
firmware170 (0.6%)
quic166 (0.6%)
git165 (0.6%)
json162 (0.6%)
redis154 (0.5%)
aem147 (0.5%)
security142 (0.5%)
rust141 (0.5%)
tls138 (0.5%)

每语言 Tags 分布

C c

library4,080 (52.8%)
backend1,884 (24.4%)
cli938 (12.1%)
embedded562 (7.3%)
cpp395 (5.1%)
networking287 (3.7%)
testing213 (2.8%)
postgresql186 (2.4%)
kernel173 (2.2%)
framework172 (2.2%)
firmware170 (2.2%)
quic161 (2.1%)
http146 (1.9%)
rust131 (1.7%)
bluetooth121 (1.6%)
tls119 (1.5%)
ruby113 (1.5%)
scheduler110 (1.4%)
cryptography102 (1.3%)
python88 (1.1%)

C++ cpp

library1,404 (73.8%)
backend308 (16.2%)
testing244 (12.8%)
cli151 (7.9%)
boost92 (4.8%)
framework76 (4.0%)
http70 (3.7%)
async63 (3.3%)
compiler41 (2.2%)
parsing38 (2.0%)
serialization36 (1.9%)
templates29 (1.5%)
actor-framework28 (1.5%)
arrayfire28 (1.5%)
formatting27 (1.4%)
redis22 (1.2%)
logging21 (1.1%)
audio20 (1.1%)
sparql20 (1.1%)
iceberg19 (1.0%)

Go go

backend2,358 (53.1%)
cli1,197 (26.9%)
library992 (22.3%)
http337 (7.6%)
kubernetes228 (5.1%)
testing137 (3.1%)
docker98 (2.2%)
aws80 (1.8%)
framework71 (1.6%)
grpc70 (1.6%)
aws-sdk56 (1.3%)
dns45 (1.0%)
git45 (1.0%)
database44 (1.0%)
aws-lambda38 (0.9%)
security37 (0.8%)
blockchain36 (0.8%)
terraform36 (0.8%)
prometheus34 (0.8%)
templ34 (0.8%)

Java java

backend1,322 (50.3%)
library1,168 (44.4%)
aem147 (5.6%)
testing133 (5.1%)
spring106 (4.0%)
framework77 (2.9%)
http77 (2.9%)
android72 (2.7%)
json63 (2.4%)
sling57 (2.2%)
flink47 (1.8%)
cli40 (1.5%)
concurrency40 (1.5%)
grpc37 (1.4%)
nacos34 (1.3%)
mybatis33 (1.3%)
maven29 (1.1%)
parsing27 (1.0%)
sql-parser27 (1.0%)
websocket27 (1.0%)

JavaScript js

library1,797 (49.0%)
backend762 (20.8%)
frontend486 (13.3%)
cli436 (11.9%)
testing204 (5.6%)
react180 (4.9%)
eslint178 (4.9%)
framework176 (4.8%)
fastify118 (3.2%)
http105 (2.9%)
mongoose97 (2.6%)
webpack71 (1.9%)
typescript69 (1.9%)
express67 (1.8%)
lighthouse61 (1.7%)
svelte61 (1.7%)
aframe53 (1.4%)
async50 (1.4%)
apostrophecms48 (1.3%)
nodejs47 (1.3%)

Python py

backend1,095 (43.9%)
library916 (36.7%)
cli418 (16.7%)
ansible98 (3.9%)
fastapi78 (3.1%)
testing77 (3.1%)
framework66 (2.6%)
aiohttp62 (2.5%)
aws56 (2.2%)
django54 (2.2%)
http52 (2.1%)
click46 (1.8%)
dbt41 (1.6%)
black40 (1.6%)
async39 (1.6%)
openai39 (1.6%)
jinja235 (1.4%)
pipx34 (1.4%)
litellm31 (1.2%)
pytorch31 (1.2%)

Rust rust

library1,409 (56.3%)
cli578 (23.1%)
backend457 (18.3%)
testing166 (6.6%)
http92 (3.7%)
git88 (3.5%)
async77 (3.1%)
compiler59 (2.4%)
graphql57 (2.3%)
parsing55 (2.2%)
datafusion53 (2.1%)
substrate48 (1.9%)
actix-web45 (1.8%)
macros45 (1.8%)
sql44 (1.8%)
framework41 (1.6%)
parquet39 (1.6%)
blockchain31 (1.2%)
clap28 (1.1%)
sqlparser28 (1.1%)

TypeScript ts

library1,239 (36.5%)
frontend1,081 (31.9%)
react733 (21.6%)
backend680 (20.1%)
cli261 (7.7%)
angular173 (5.1%)
graphql133 (3.9%)
framework99 (2.9%)
electron94 (2.8%)
fullstack86 (2.5%)
testing65 (1.9%)
github-actions59 (1.7%)
vue55 (1.6%)
express48 (1.4%)
javascript45 (1.3%)
nextjs42 (1.2%)
eslint39 (1.2%)
xstate37 (1.1%)
react-native36 (1.1%)
zod36 (1.1%)