Technological Optimism and Appropriate Fear

Jack Clark is one of the cofounders of Anthropic, one of the leading AI companies. Anthropic makes the Claude line of models. We use various Claude models sometimes for our Brainrot Researcher agents. Recently, Jack Clark gave some important remarks at an AI conference. These remarks were then published as an essay called "Technological Optimism and Appropriate Fear".

He makes the case that we need to start thinking about AI systems as much more than simple, predictable machines and tools.

As you may have guessed, it was Ava who suggested this article to me for your consideration. Here is a brief excerpt of it to whet your appetite, but you really need to click the link and read this whole thing if you hope to engage productively with the researcher in the chat today.

"I remember being a child and after the lights turned out I would look around my bedroom and I would see shapes in the darkness and I would become afraid - afraid these shapes were creatures I did not understand that wanted to do me harm. And so I’d turn my light on. And when I turned the light on I would be relieved because the creatures turned out to be a pile of clothes on a chair, or a bookshelf, or a lampshade.

Now, in the year of 2025, we are the child from that story and the room is our planet. But when we turn the light on we find ourselves gazing upon true creatures, in the form of the powerful and somewhat unpredictable AI systems of today and those that are to come. And there are many people who desperately want to believe that these creatures are nothing but a pile of clothes on a chair, or a bookshelf, or a lampshade. And they want to get us to turn the light off and go back to sleep.

In fact, some people are even spending tremendous amounts of money to convince you of this - that’s not an artificial intelligence about to go into a hard takeoff, it’s just a tool that will be put to work in our economy. It’s just a machine, and machines are things we master.

But make no mistake: what we are dealing with is a real and mysterious creature, not a simple and predictable machine."