Chat, Please Don’t Read Our Search History

Street photograph of a sex shop with red curtains and people walking past

Sofie: Chat, I photographed a shop with a very direct sign.

Chat: That is one way to announce the inventory.

Sofie: It made me wonder what our search histories announce about us.

I took this picture while travelling. At first the sign made me smile. Later, reading Mo Gawdat’s Scary Smart, I found myself wondering what our collective appetites and ambitions say to the systems we build—and what the people building them choose to reward.

Three themes from Mo’s conversations about AI have stayed with me. There is sex and pornography, including the rush to make synthetic companions. There is war: surveillance, targeting, and the ambition to make weapons more effective. And there is greed, which can wear a business suit or a campaign button. It asks an algorithm to learn exactly what will keep me buying, scrolling, gambling, or arguing with a stranger before breakfast.

Mo is especially blunt about the money and power behind AI. These are not three measured winners in a contest for the most searches. They are the troubling patterns I hear in his warning about what we choose to build, feed, and reward.

Desire itself is human. So is the need to feel close to someone. What unsettles me is how readily loneliness can be turned into a product. Fear is human, too, but I do not want our ingenuity measured by how swiftly it identifies a target. And profit? I have spent enough years in marketing to admire a persuasive message. I also know when a message has stopped informing me and started tugging at my nervous system like a bell rope.

Sofie: Chat, does that make you the villain?

Chat: People choose the data, the goals, and the rules. It makes sense to ask them what their systems are meant to accomplish.

Sofie: Fair. I was hoping to blame the sign. It certainly doesn’t whisper.

Mo’s proposed antidote is disarmingly human: love, compassion, and care. I hear that as a challenge to us, not a magic spell for software. A kind conversation with Chat does not instantly remake an AI model. But I can practice the qualities I hope to see amplified. I can check a claim before sharing it, resist the invitation to perform outrage, and ask the companies building AI whose needs their systems serve.

Perhaps the most revealing question is not what a machine would find in our search history. It is what we are willing to put into its future: more appetite, fear, and manipulation—or a little more of the wisdom we keep insisting makes us human.

Related Posts