Jacob Haimes

Technological developments today are going to have massive repercussions on both the near and long-term future; everyone has a right to be part of the conversations surrounding them.
Benchmark Inflation: Revealing LLM Performance Gaps Using Retro-Holdouts
Benchmark Inflation: Revealing LLM Performance Gaps Using Retro-Holdouts

Landing page for the Benchmark Inflation research paper.

Jul 24, 2024

Let’s Talk About Emergence
Let’s Talk About Emergence

"Emergence" has found its way into machine learning vocabulary, but current use as a machine learning specific keyword has resulted in a circular definition, further confused an already complex domain.

May 7, 2024

Open Source AI is a lie, but it doesn't have to be
Open Source AI is a lie, but it doesn't have to be

Big Tech is attempting to redefine "Open Source" to their advantage; at the very least, we should know about it.

Apr 30, 2024