Chris Olah on what the hell is going on inside neural networks 80,000 Hours: “Big machine learning models can identify plant species better than any human, write passable essays, beat you at a game of Starcraft 2, figure out how a photo of Tobey Maguire and the word ‘spider’ are related, solve the 60-year-old ‘protein folding problem’, diagnose some diseases, play romantic matchmaker, write solid computer code, and offer questionable legal advice.
Humanity made these amazing and ever-improving tools. So how do our creations work? In short: we don’t know. Today’s guest, Chris Olah, finds this both absurd and unacceptable. Over the last ten years he has been a leader in the effort to unravel what’s really going on inside these black boxes.
As part of that effort he helped create the famous DeepDream visualisations at Google Brain, reverse engineered the CLIP image classifier at OpenAI, and is now continuing his work at Anthropic, a new $100 million research company that tries to “co-develop the latest safety techniques alongside scaling of large ML models”. Despite having a huge fan base thanks to his tweets and lay explanations of ML, today’s episode is the first long interview Chris has ever given. It features his personal take on what we’ve learned so far about what ML algorithms are doing, and what’s next for this research agenda at Anthropic. His decade of work has borne substantial fruit, producing an approach for looking inside the mess of connections in a neural network and back out what functional role each piece is serving.
Among other things, Chris and team found that every visual classifier seems to converge on a number of simple common elements in their early layers — elements so fundamental they may exist in our own visual cortex in some form…”
Popular Science: “There’s a new AI on the block, and it can mimic someone’s voice from just a short audio clip of them speaking. If it sounds like there are a lot of wacky AIs out there right now that can generate things, including both images and words, you’re right! And because it can get confusing, we wrote you a quick guide. Here are some of the most prominent AIs to surface over the past 12 months.”
Ars Technica: “Moderna is considering raising the price of its COVID-19 vaccine by over 400 percent—from $26 per dose to between $110 and $130 per dose—according to a report by The Wall Street Journal [Moderna Considers Price of $110-$130 for Covid-19 Vaccine Commercial price is similar to Pfizer’s plans for after government contracting ends
The Binance Scam Chain Dirty Bubble Media
NFT Marketplace SuperRare Cuts 30% of Staff: ‘We Over-Hired’ Decrypt