From Memorization to Reasoning in the Spectrum of Loss Curvature
Abstract:We characterize how memorization is represented in transformer models and show that it can be disentangled in the weights of both language models (LMs) and vision transformers (ViTs) using a decomposition based on the loss landscape curvature. This insight is based on prior theoretical and empirical work showing that the curvature for memorized training points […]
Meta projected 10% of 2024 revenue came from scams
Meta has been making billions of dollars per year from scam ads and sales of banned goods, according internal Meta documents seen by Reuters. The new report quantifies the scale of fraud taking place on Meta’s platforms, and how much the company profited from them. Per the report, Meta internal projections from late last year […]
Show HN: I made a better DOM morphing algorithm
When you render HTML on the backend — e.g. with Phlex — how do you get it to the browser? One way is to have the user click a link, submit a form or reload the page. Alternatively, in response to some user interaction or push event, you could have JavaScript fetch new HTML and […]
Sweep (YC S23) is hiring to build autocomplete for JetBrains
We’re building an AI coding assistant for JetBrains IDEs. You’ll work with great builders on some of the hardest and most user-facing problems in AI today. Whether an internship or full-time position, you’ll work from our office in Dogpatch five days a week in-person.
Craft Chrome Devtools Protocol (CDP) commands with the new command editor
Hadrien Jaubert Note: Interested in helping improve DevTools? Sign up to participate in Google User Research here. Chrome DevTools Protocol (CDP) is a remote debugging protocol (API) that lets developers communicate with a running Chrome browser. Chrome DevTools uses CDP to help you inspect the browser’s state, control its behavior, and collect debugging information. You […]
A startup’s quest to store electricity in the ocean
When Manuele Aufiero was a child, his parents would take him hiking along a reservoir in northern Italy. It wasn’t a typical reservoir, though. This one drained and refilled constantly, with pumps raising the water level when electricity was cheap. When nearby cities needed electricity, the pumps would reverse, turning into generators as the water […]
The R47: A new physical RPN calculator released today in 2025
The next RPN scientific The R47 is a powerful, RPN-based programmable scientific calculator with an extensive feature set. Its software has been refined over many years, born from the vision of a dream calculator developed by a team of engineers and mathematicians, all dedicated calculator enthusiasts. Background and lineage Community-developed and manufactured by SwissMicros, the […]
Lessons from Growing a Piracy Streaming Site
There are some contemporary piracy services that run ads—for marketing and, well, advertising purposes. This ranges from PPC to social media campaigns. I opted not to, mostly because I didn’t think I could do it tastefully, and because I’d probably attract users who wouldn’t be great customers. Instead, my marketing relied entirely on word-of-mouth—which meant […]
Photoroom (YC S20) Is Hiring a Senior AI Front End Engineer in Paris
You need to enable JavaScript to run this app.
Leaving Meta and PyTorch
**Leaving Meta and PyTorch** It’s finally time… November 6th, 2025 [https://soumith.ch/blog.html](https://soumith.ch/blog.html) Eleven years at Meta. Nearly all my professional life. Making many friends for life. Almost eight years leading PyTorch, taking it from nothing to 90%+ adoption in AI. Walking away from this was one of the hardest things I’ve ever done. But I’m leaving […]