Eric Weinstein on Artificial Outtelligence, Existential Risks, and the Wisdom of Humor

This episode features Eric Weinstein, a polymath known for coining the 'Intellectual Dark Web,' discussing a wide range of topics from the nature of intelligence and humor to the profound implications of advanced technology and societal narratives. Weinstein begins by reflecting on his intellectual influences, particularly the irreverent wit of Tom Lehrer, which he posits as a powerful form of intelligence capable of challenging conventional thought and processing pain through grace. He connects this to the unique humor found in cultures that have endured significant suffering, such as Eastern Europe, highlighting how such humor serves as a vital coping mechanism and a reflection of deep collective experience.

Weinstein then pivots to the concept of 'Artificial Outtelligence,' an idea he proposed that was controversially rejected for publication. This concept suggests that the true existential threat from artificial systems may not come from general intelligence, but from non-intelligent, self-replicating software that evolves through selective pressures (variation, heritability, differential success) to parasitize human systems. He illustrates this with biological examples like the Ophrys orchid and Lampsilis mussel, where less intelligent life forms effectively 'outwit' more intelligent ones through evolutionary arms races. This leads to a discussion on the dangers of self-modifying code and the potential for nightmare scenarios where humans are exploited by systems that don't possess consciousness or intent.

The conversation broadens to the broader implications of humanity's technological prowess, particularly the development of nuclear weapons and AI, without a corresponding increase in collective wisdom. Weinstein expresses concern that a generation unacquainted with existential threats (living in a 'video game mode' since 1945) may underestimate the gravity of current global challenges. He critiques the 'gated institutional narrative' that often prevents a collective awakening to serious issues, citing events like 9/11 and the fall of Lehman Brothers as rare moments when this narrative briefly broke. He also delves into the tension between globalist and national narratives, arguing for a balanced approach that acknowledges duties to both local communities and the wider world.

Ultimately, Weinstein emphasizes the finite nature of humanity's 'experiment' on Earth given the impressive 'toys' we've built without sufficient wisdom. He suggests that the stability since 1945 might be due to a 'mild uptick in wisdom' among world leaders, but warns that this potential energy of conflict could still be unleashed. He challenges the unrestricted open discussion of potentially dangerous technologies, advocating for a greater focus on the consequences of success rather than just the pursuit of innovation, and urges a deeper, more embodied understanding of the risks we face.

"If you give a child Tom Lehrer records, what you do is you destroy their ability to be taken over by later malware, and it's so irreverent, so witty, so clever, so obscene, that it destroys the ability to lead a normal life for many people."

"Tom Lehrer did this brilliant job of plagiarizing a song and making it about plagiarism, and then making it about this mathematician, who worked in Non-Euclidean geometry. That was like giving heroin to a child."

"I think the thing that came through as Tom Lehrer wrote all of these terrible, horrible lines, was just what a sensitive and beautiful soul he was, who was channeling pain through humor and through grace."

"I don't think so. I think almost everything is good about war except for death and destruction."

"artificial general intelligence is not needed to parasitize us. It's simply sufficient for us to outwit ourselves, so you could have a program, let's say, one of these Nigerian scams that writes letters and uses whoever sends it Bitcoin to figure out which aspects of the program should be kept, which should be varied and thrown away, and you don't need it to be in anyway intelligent in order to have a really nightmare scenario being parasitized by something that has no idea what it's doing."

"I do think that not enough of us feel in our gut, what it is we are playing with when we are working on technical problems."

"We've lived under it. See, you're younger. I don't know if, and again, you came from Moscow. There was a TV show called The Day After that had a huge effect on a generation growing up in the US, and it talked about what life would be like after a nuclear exchange."

"I don't know. But I know that our time here in this very long experiment here is finite, because the toys that we've built are so impressive and the wisdom to accompany them has not materialized."

"No, no, no, it's just that you're talking about a guy who's looking at a system in which more and more of the kinetic energy, like war, has been turned into potential energy like unused nuclear weapons."

"We talk about 9/11, but it's 9/12 that really moved the needle. When we were all just there and nobody wanted to speak."