Sakana AI

MIT and Sakana AI developed SIFT, an LLM judge that ranks proposed coding-agent improvements before spending compute on full benchmark runs, reducing evaluation cost while achieving 35.1% accuracy on coding tasks with substantially less compute than previous search approaches.