AI labs have staked their reputations on model benchmarking — the supposedly neutral and accurate system of evaluations that are designed to measure whether one AI product is better than another. However, the methods behind these evaluations are complicated and still maturing, said Irene Solaiman, Hugging Face’s chief policy officer, during a discussion at TechCrunch […]
Embedded AI evaluators won’t be an easy solution, Hugging Face’s policy chief says
Source: TechCrunch
Original reporting
TechCrunch: read the full reportRelated stories
TechCrunch
Nscale and Anthropic are reportedly in talks for yet another $45 billion compute deal
In August, Nscale and Anthropic announced a $45 billion compute deal. The two companies are reportedly discussing yet another deal of the same magnitude.
Ars Technica
Pennsylvania issues alert on congenital measles—something US hasn't seen for decades
Congenital measles can be fatal, and survivors require monitoring for years.
The Verge
Elon Musk’s proposed SpaceX stock giveaway would go into ‘Trump Accounts’
President Donald Trump announced this afternoon that Elon Musk's SpaceX shares for children will be given through Trump Accounts. Musk said earlier today that he would give one of his SpaceX shares to "every kid in America" sometime next year. Musk had thanked Trump Account booster Brad Gerstner for "helping enable this," and Trump appeared […]
TechCrunch
Microsoft says AI agents are like insider threats as ‘frontier models can’t be trusted’
Microsoft wants enterprises to closely watch the agents employees use with systems not controlled by AI labs like OpenAI and Anthropic.
The Verge
The fossil fuel comeback is here
The US is building more fossil fuel infrastructure than it has in a decade while renewable energy growth slows down, a new report shows. Electricity demand is also climbing faster than it has in more than a decade with more data centers, factories, and electric vehicles plugging into the grid. Despite those growing demands, the […]
The Verge
CoreWeave’s debt is becoming the whole AI industry’s problem
CoreWeave had a bad week last week. Its bonds slipped into distressed territory by a common definition - when investors demand 1,000 basis points more in yield than they'd get from government bonds. Last Tuesady Chamath "SPAC King" Palihapitiya noticed the distressed debt, and also asked whether the AI buildout was a private credit bubble. […]