~www_lesswrong_com | Bookmarks (702)

Published on December 19, 2024 6:17 PM GMTI always used to think that character was hard to build; that it required Herculean feats of self-restraint, sacrifice, and discipline to maintain and uphold. Others always seemed to be able to do the right thing far more consistently than I did, and it felt like it required tremendous effort for me to summon the courage and...

Published on December 19, 2024 6:15 PM GMTAs 2024 draws to a close, we want to thank you for your continued support for AI safety and review what we’ve been able to accomplish. In this special-edition newsletter, we highlight some of our most important projects from the year.The mission of the Center for AI Safety is to reduce societal-scale risks from AI. We focus...

Published on December 19, 2024 3:59 PM GMTTL;DR: Matryoshka SAEs are a new variant of sparse autoencoders that learn features at multiple levels of abstraction by splitting the dictionary into groups of latents of increasing size. Earlier groups are regularized to reconstruct well without access to later groups, forcing the SAE to learn both high-level concepts and low-level concepts, rather than absorbing them in...

Published on December 19, 2024 3:47 PM GMTThis is a follow-up to my previous post about hidden serial reasoning (but you don't need to have read it). There, I focused on serial reasoning happening internally in the model. Jozdien pointed out that a model could also use it's chain-of-thought for hidden serial reasoning, by using steganography. So I adapted my setup to test this...

Published on December 19, 2024 3:10 PM GMTA lot happened this week. We’re seeing release after release after upgrade. It’s easy to lose sight of which ones matter, and two matter quite a lot. The first is Gemini Flash 2.0, which I covered earlier this week. The other is that o1, having turned pro, is now also available in the API. This was obviously...

Published on December 19, 2024 8:14 AM GMTTLDR:ENAIS is teaming up with community builders from Paris to seed AIS France. You can read about the role below, and if you would be interested in founding such an organisation, fill out this expression of interest form. We are currently in discussions with funders about seeding city and national groups across the world, so we would like...