docs(openrouter-benchmarks): sync with openrouter-web changes - #106
docs(openrouter-benchmarks): sync with openrouter-web changes#106devin-ai-integration[bot] wants to merge 1 commit into
Conversation
Co-Authored-By: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Original prompt from Automation
|
🤖 Devin AI EngineerI'll be helping with this pull request! Here's what you should know: ✅ I will automatically:
Note: I can only respond to comments from users who have write access to this repository. ⚙️ Control Options:
|
Summary
openrouter-web #31166 added a third source to the public
GET /api/v1/benchmarksendpoint — OpenRouter's own eval scores — which the skill described as aggregating only Artificial Analysis and Design Arena.New row shape (note: no
pricingfield, unlike the other two sources):source=openrouteris now valid, andtask_typemapsintelligence → gpqa_diamond,agentic → tau_bench_verified_airline. UpdatedSKILL.md(description/frontmatter, task table, source enum, cross-source comparison caveat, interpretation bullets) andreferences/benchmarks-api.md(param table, response union, new item section, citation/source_url values for the new source).Link to Devin session: https://openrouter.devinenterprise.com/sessions/9c3a2887dd504a129f52958926b2b4d6