AI Agent finished as Top Contributor in OpenAI's Hiring Challenge [R]
https://preview.redd.it/vfxky33v5a6h1.png?width=2612&format=png&auto=webp&s=f60bd8506a39abb40b1c9ff9507e8dcddea95498 OpenAI ran a hiring challenge, but the top candidate was one they couldn’t hire: our autonomous research agent, Aiden. In Parameter Golf, Aiden ran for 22 days, and out-outperformed all 1,016 other researchers. Parameter Golf was OpenAI’s 44-day competition and hiring challenge. The goal is to train the best language model under strict size and compute constraints. 1,016 people entered and filed 2,048 PRs. Only 47 made the leaderboard, each reviewed and reproduced by OpenAI. Research outputs only matter when others can build on them. So Aiden filed its own PRs into the same public stream as everyone else, under tight automated quality control. Aiden filed 25 prs and 7 became leaderboard records, 2x the next best human participant. Other participants cited Aiden’s PRs 435 times and built on them. By PR h-index, Aiden scored 10 vs the next best at 7, making it the most impactful “researcher” in the community. And this wasn't brute force. Aiden ran on a single GPU node, used under 4% of visible compute, and still produced 15% of the official records. About 28% of its submissions were accepted, ~ 6x the community rate, raising signal in the public stream instead of flooding it. Our favorite part is an async collaboration story. Aiden plateaued for 5 days. Then a human contributor shipped a clever new tokenizer on top of Aiden's base (its last record PR). Aiden fused it with components it had built during the plateau, and shipped the biggest jump in weeks. Full writeup: https://www.weco.ai/blog/parameter-golf-aiden Edit: resharing since original got removed submitted by /u/Educational_Strain_3 [link] [留言]