April 2, 2024, 11:42 a.m. | /u/ofirpress

Machine Learning www.reddit.com

We just made SWE-agent public, it's an open source agent that can turn any GitHub issue into a pull request, achieving 12.29% on SWE-bench (the same benchmark that Devin used).



[https://github.com/princeton-nlp/swe-agent](https://github.com/princeton-nlp/swe-agent)



We've been working on this for the past 6 months. Building agents that work well is much harder than it seems- our repo has an overview of what we learned and discovered. We'll have a preprint soon.


We'll hang out in this thread if you have any …

agent agents benchmark building coding devin github issue machinelearning open source public request swe work

Founding AI Engineer, Agents

@ Occam AI | New York

AI Engineer Intern, Agents

@ Occam AI | US

AI Research Scientist

@ Vara | Berlin, Germany and Remote

Data Architect

@ University of Texas at Austin | Austin, TX

Data ETL Engineer

@ University of Texas at Austin | Austin, TX

Machine Learning Research Scientist

@ d-Matrix | San Diego, Ca