AI has hacked the operating system of human civilisation

Yuval Noah Hariri in The Economist

Fears of artificial intelligence (ai) have haunted humanity since the very beginning of the computer age. Hitherto these fears focused on machines using physical means to kill, enslave or replace people. But over the past couple of years new ai tools have emerged that threaten the survival of human civilisation from an unexpected direction. ai has gained some remarkable abilities to manipulate and generate language, whether with words, sounds or images. ai has thereby hacked the operating system of our civilisation.

Language is the stuff almost all human culture is made of. Human rights, for example, aren’t inscribed in our dna. Rather, they are cultural artefacts we created by telling stories and writing laws. Gods aren’t physical realities. Rather, they are cultural artefacts we created by inventing myths and writing scriptures.

Money, too, is a cultural artefact. Banknotes are just colourful pieces of paper, and at present more than 90% of money is not even banknotes—it is just digital information in computers. What gives money value is the stories that bankers, finance ministers and cryptocurrency gurus tell us about it. Sam Bankman-Fried, Elizabeth Holmes and Bernie Madoff were not particularly good at creating real value, but they were all extremely capable storytellers.

What would happen once a non-human intelligence becomes better than the average human at telling stories, composing melodies, drawing images, and writing laws and scriptures? When people think about Chatgpt and other new ai tools, they are often drawn to examples like school children using ai to write their essays. What will happen to the school system when kids do that? But this kind of question misses the big picture. Forget about school essays. Think of the next American presidential race in 2024, and try to imagine the impact of ai tools that can be made to mass-produce political content, fake-news stories and scriptures for new cults.

In recent years the qAnon cult has coalesced around anonymous online messages, known as “q drops”. Followers collected, revered and interpreted these q drops as a sacred text. While to the best of our knowledge all previous q drops were composed by humans, and bots merely helped disseminate them, in future we might see the first cults in history whose revered texts were written by a non-human intelligence. Religions throughout history have claimed a non-human source for their holy books. Soon that might be a reality.

On a more prosaic level, we might soon find ourselves conducting lengthy online discussions about abortion, climate change or the Russian invasion of Ukraine with entities that we think are humans—but are actually ai. The catch is that it is utterly pointless for us to spend time trying to change the declared opinions of an ai bot, while the ai could hone its messages so precisely that it stands a good chance of influencing us.

Through its mastery of language, ai could even form intimate relationships with people, and use the power of intimacy to change our opinions and worldviews. Although there is no indication that ai has any consciousness or feelings of its own, to foster fake intimacy with humans it is enough if the ai can make them feel emotionally attached to it. In June 2022 Blake Lemoine, a Google engineer, publicly claimed that the ai chatbot Lamda, on which he was working, had become sentient. The controversial claim cost him his job. The most interesting thing about this episode was not Mr Lemoine’s claim, which was probably false. Rather, it was his willingness to risk his lucrative job for the sake of the ai chatbot. If ai can influence people to risk their jobs for it, what else could it induce them to do?

In a political battle for minds and hearts, intimacy is the most efficient weapon, and ai has just gained the ability to mass-produce intimate relationships with millions of people. We all know that over the past decade social media has become a battleground for controlling human attention. With the new generation of ai, the battlefront is shifting from attention to intimacy. What will happen to human society and human psychology as ai fights ai in a battle to fake intimate relationships with us, which can then be used to convince us to vote for particular politicians or buy particular products?

Even without creating “fake intimacy”, the new ai tools would have an immense influence on our opinions and worldviews. People may come to use a single ai adviser as a one-stop, all-knowing oracle. No wonder Google is terrified. Why bother searching, when I can just ask the oracle? The news and advertising industries should also be terrified. Why read a newspaper when I can just ask the oracle to tell me the latest news? And what’s the purpose of advertisements, when I can just ask the oracle to tell me what to buy?

And even these scenarios don’t really capture the big picture. What we are talking about is potentially the end of human history. Not the end of history, just the end of its human-dominated part. History is the interaction between biology and culture; between our biological needs and desires for things like food and sex, and our cultural creations like religions and laws. History is the process through which laws and religions shape food and sex.

What will happen to the course of history when ai takes over culture, and begins producing stories, melodies, laws and religions? Previous tools like the printing press and radio helped spread the cultural ideas of humans, but they never created new cultural ideas of their own. ai is fundamentally different. ai can create completely new ideas, completely new culture.

At first, ai will probably imitate the human prototypes that it was trained on in its infancy. But with each passing year, ai culture will boldly go where no human has gone before. For millennia human beings have lived inside the dreams of other humans. In the coming decades we might find ourselves living inside the dreams of an alien intelligence.

Fear of ai has haunted humankind for only the past few decades. But for thousands of years humans have been haunted by a much deeper fear. We have always appreciated the power of stories and images to manipulate our minds and to create illusions. Consequently, since ancient times humans have feared being trapped in a world of illusions.

In the 17th century René Descartes feared that perhaps a malicious demon was trapping him inside a world of illusions, creating everything he saw and heard. In ancient Greece Plato told the famous Allegory of the Cave, in which a group of people are chained inside a cave all their lives, facing a blank wall. A screen. On that screen they see projected various shadows. The prisoners mistake the illusions they see there for reality.

In ancient India Buddhist and Hindu sages pointed out that all humans lived trapped inside Maya—the world of illusions. What we normally take to be reality is often just fictions in our own minds. People may wage entire wars, killing others and willing to be killed themselves, because of their belief in this or that illusion.

The AI revolution is bringing us face to face with Descartes’ demon, with Plato’s cave, with the Maya. If we are not careful, we might be trapped behind a curtain of illusions, which we could not tear away—or even realise is there.

Of course, the new power of ai could be used for good purposes as well. I won’t dwell on this, because the people who develop ai talk about it enough. The job of historians and philosophers like myself is to point out the dangers. But certainly, ai can help us in countless ways, from finding new cures for cancer to discovering solutions to the ecological crisis. The question we face is how to make sure the new ai tools are used for good rather than for ill. To do that, we first need to appreciate the true capabilities of these tools.

Since 1945 we have known that nuclear technology could generate cheap energy for the benefit of humans—but could also physically destroy human civilisation. We therefore reshaped the entire international order to protect humanity, and to make sure nuclear technology was used primarily for good. We now have to grapple with a new weapon of mass destruction that can annihilate our mental and social world.

We can still regulate the new ai tools, but we must act quickly. Whereas nukes cannot invent more powerful nukes, ai can make exponentially more powerful ai. The first crucial step is to demand rigorous safety checks before powerful ai tools are released into the public domain. Just as a pharmaceutical company cannot release new drugs before testing both their short-term and long-term side-effects, so tech companies shouldn’t release new ai tools before they are made safe. We need an equivalent of the Food and Drug Administration for new technology, and we need it yesterday.

Won’t slowing down public deployments of ai cause democracies to lag behind more ruthless authoritarian regimes? Just the opposite. Unregulated ai deployments would create social chaos, which would benefit autocrats and ruin democracies. Democracy is a conversation, and conversations rely on language. When ai hacks language, it could destroy our ability to have meaningful conversations, thereby destroying democracy.

We have just encountered an alien intelligence, here on Earth. We don’t know much about it, except that it might destroy our civilisation. We should put a halt to the irresponsible deployment of ai tools in the public sphere, and regulate ai before it regulates us. And the first regulation I would suggest is to make it mandatory for ai to disclose that it is an ai. If I am having a conversation with someone, and I cannot tell whether it is a human or an ai—that’s the end of democracy.

This text has been generated by a human.

Or has it?

Are all religions the same?

The Skripal affair: a counter view

Jawed Naqvi in The Dawn

IF one were to anchor a TV programme with the archival revelation that it was Benazir Bhutto who introduced Theresa May’s husband to the future British prime minister at an Oxford reunion ball in 1976, many of us would perhaps happily spend a lot of our precious time glued to the looped and re-looped discussion.

On the other hand, if one were to ask whether Prime Minister May posed a bigger threat to a stable world order than does President Donald Trump it would likely pass for a precipitous canard. This despite that fact that we are ever so often cautioned about the rear view mirror in the car: the objects one sees may be closer at heel than they appear. The warning can be easily applied to international politics.

What we see, or believe we are seeing, can be different from what is afoot. What seems distant or remote could be the trigger for what passes for domestic turbulence. Astute social scientists call it dialectics, whereby everything in the world can be connected with everything else.

Take the poisoning of the double agent Sergei Skripal in Salisbury or consider the latest chemical attack near Damascus in the rebel-held region of Douma. There are legitimate ways of seeing a link between the two. But the way the avenues of news and information have been dumbed down, it would be a challenge to engage an average citizen in a discussion on what to them would be a distant blip on their mirror, if not an imagination of a foggy mind.

So let us quickly come to the facts at hand, and we can crosscheck them too. It is a fact, after all, as distinct from false news, that Trump was elected US president in November 2016. Wasn’t he? Then his election was soon declared to be the handiwork of Russian agents. Right?

Indeed, Trump continued to annoy the deep state. He wanted to befriend Vladimir Putin and questioned the purpose of Nato. He went a step further. He began to question intelligence reports passed to him or leaked to the public.

Then came Theresa May to the rescue of the deep state with its roots on both sides of the Atlantic. When Trump in his pre-political avatar was misbehaving with women, May was already her country’s home secretary. She held that position from 2010 until she was elevated to lead her party and country in July 2016.

Her tenure as home secretary saw the destruction of Libya and the savage assault on Syria. Even more importantly, she was in the cockpit when the Crimea crisis erupted. And she had a good view of it even if she may have been privately appalled at the less than robust response that Nato was willing to offer Russia.

When she became the first foreign leader to visit President Trump on Jan 26 last year, Ms May was nursing another headache on the tour. And so her round trip to the White House included an equally vital stopover in Turkey on the way back. Leaders of both countries on her itinerary were allies of Nato and both were veering perilously close to Vladimir Putin. In a jiffy, she saw the centuries-old British policy of garrotting Russia slipping under her feet.

The mirror on the driver’s side may be telling us to watch out for Donald Trump, who everyone, including most Americans, agrees is speeding ahead rather recklessly on an uncharted trajectory. The mirror on the other side though is showing us a blip, and in a lane where it shouldn’t be. As far as the naked eye can see, the more threatening blip looks like Theresa May. Stated bluntly, Trump may be a decoy.

Double agent Sergei Skripal was swapped by Russia with the US in 2010 and sent for safekeeping to UK. There are some questions about his illness the Russians have asked, including the question: what purpose could it serve to bump off a used- up Russian double agent on the eve of a presidential election, or just ahead of the World Cup that Russia will be hosting? There can be a legitimate suspicion that Skripal and, unwittingly, his daughter fell victim to a strike by someone whose cover Skripal had blown.

But we could also ask, on the other hand, whether it is impossible for another country to replicate the poison that one country has manufactured. The question holds the key when the other side claims to know what that poison is. In other words they have the substance or can produce it to develop an antidote or, why not, to keep it in store for a useful false flag attack. This is not how it happened. This is how some questions come to mind.

A poor scientist died of smallpox in England, after all, when a laboratory accidently released the virus in 1978. The cause of Janet Parker’s infection sent shockwaves through the medical profession. It was reportedly accepted at the time that the virus had travelled through an air duct connecting a smallpox lab with Janet’s office directly above.

To assert that both attacks — in Salisbury and in Douma — can be blamed on Russia, is to state the obvious. A more involved discussion could look at the rise of John Bolton as the new national security adviser to Trump. He has advocated war with Iran, and the alleged Syrian chemical attack may tie up with that objective, as a ruse.

But why has Trump changed his tune on Russia? Has the deep state got the goods on him, in a manner of speaking? If so, Theresa May should have a better grip on the narrative. It was a former British agent in Moscow, after all, whose report is said to have brought the president of the United States to his senses, if that is the word.

Perspective on Charlie Hebdo, Peshawar killings; In maya, the killer and the killed

Jan 14, 2015 12:21 AM , By Devdutt Pattanaik in The Hindu |  

Emotional violence is not measurable. Physical violence is, which makes it a crime that can be proven and hence a greater crime, especially when emotional violence is directed at something as notional as religion

When the Pandavas invited Krishna to be the chief guest at the coronation of Yudhishtira, Shishupala felt insulted and began abusing Krishna. Everyone became upset, but not Krishna who was listening calmly. However, after the hundredth insult, Krishna hurled his razor-sharp discus and beheaded Shishupala. For the limit of forgiveness was up.

Charlie Hebdo, a French satirical weekly, published cartoons; offensive cartoons that I have never seen, and would never have, had someone not killed its staff. With that Charlie became a person, a victim, a martyr to the cause of the freedom of expression. We became heroes by condemning the killing. And so millions have walked in Paris to declare that they are Charlie.

Will there be a march where people identify themselves with Charlie’s killers? Is that allowed? Who are the killers? Muslim, bad Muslim, mad Muslim, un-Islamic Muslim? The editorials are undecided, as in the attack in Peshawar on schoolchildren. The victims there did not even provoke; their parents probably did.

The provocation in Charlie’s case was this: perceived insult to the Prophet Muhammad, hence Islam. Charlie, however, was functioning within the laws of a land renowned for the phrase, “Liberty, Equality and Brotherhood!” Islam is also about brotherhood (Ummah, in Arabic) and equality, though not so much about liberty since Islam does mean submission, a submission to the word of god that brings peace.

Managing the measurable

The two siblings, believers in equality and their own version of liberty decided to hurt each other, one emotionally, the other physically. Emotional violence is not measurable. Physical violence is. That makes the latter a crime that can be proven, hence a greater crime, especially when emotional violence is directed at something as notional as religion. Because we are scientific, you see.

And here is the problem — measurement, that cornerstone of science and objectivity.

We can manage the measurable. But what about the non-measurable? Does it matter at all? Emotions cannot be measured. The mind cannot be measured, which is why purists refer to psychology and behavioural science as pseudoscience. God cannot be measured. For the scientist, god is therefore not fact. It is at best a notion. This annoys the Muslim, for he/she believes in god, and for him/her god is fact, not measurable fact, but fact nevertheless. It is subjective truth. My truth. Does it matter?

Where do we locate subjective truth: as fact or fiction? Some people have given themselves the “Freedom of Expression” and others have given themselves a “God, who is the one True God.” Both are subjective truths. They shape our reality. They matter. But we just do not know how to locate them, for they are not measurable.

We cannot measure the hurt Charlie’s cartoons caused the Muslim community. We cannot measure the Muslim community’s sensitivity or over-sensitivity. But we can measure the outcome of the actions of the killers. We can therefore easily condemn violence. That it caused hurt, rage, humiliation, enough for some people to grab guns, is a non-measurable assumption, a belief. Belief is a joke for the rational atheist.

The intellectual can hurt with his/her words. The soldier can hurt with his/her weapons. We live in the world where the former is acceptable, even encouraged. The latter is not. It is a neo-Brahminism that the global village has adopted. Those who think and speak are superior to those who beat and kill, even if the wounds created by word-missiles can be deeper, last longer and fester forever. Gandhi, the non-violent sage, is thus pitted against Godse, the violent brute. I, the intellectual, have the right to provoke; but you, the barbarian who only knows to wield violence, have no right to get provoked and respond the only way you know how to. If you do get provoked, you have to respond in my language, not yours, brain not brawn, because the brain is superior. I, the intellectual Brahmin, make the rules. Did you not know that?

Non-violence is the new god, the one true god. When we say violence, we are actually referring only to the physical violence of the barbarian. The mental violence of the intellectual elite is not considered violence. So, one has sanction to mock Hinduism intellectually on film (PK by Rajkumar Hirani and Aamir Khan) and in books (The Hindus: An Alternative History by Wendy Doniger), but those who demand the film be banned and the books be pulped are brutes, barbarians, enemies of civic discourse, who resort to violence. They are not as bad as the Charlie killers, but seem to be on the same path.

Role of the thinker

We refuse to see arguments as brutal bloodless warfare, mental warfare. We don’t see debating societies as battlegrounds. Mental torture, we are told, is merely a concept, not truth: difficult to measure hence prove. The husband who mentally tortures can never be caught; the husband who strikes the wife can be caught. We empathise with the latter, not the former (she is over-sensitive, we rationalise). Should the mentally tortured wife kill her husband, it is she who will be hauled to jail, not the husband. Her crime can be proved. Not his.

The thinker we are told is not a doer. The killings provoked by the thinker thus goes unnoticed. The thinker — the seed of the violence — chuckles as the barbarian, whose only vocabulary is physical, will be caught and punished while mental warfare will go on with brutal precision. When the ill-equipped barbarian even attempts to fight back using words, we mock him as the troll.

In Sanskrit, the root of the world maya is ma, to measure. We translate the word as illusion or delusion but it technically means a world constructed through measurement. Thus, the scientific word, the rational world, based on measurement, is maya. And that is neither a good or bad thing. It is not a judgement. It is an observation. A world based on measurement will focus on the tangible and lose perspective of the intangible. It will assume measured truth as Truth, rather than limited truth.

Those who felt gleeful self-righteousness in mocking the Prophet are in maya. So are those who took such serious offence to it. The killer is in maya and so is the killed. Those who judge one as the victim and the other as the villain are also in maya. We all live in our constructed realities, some based on measurement, some indifferent to measurement, each one eager to dismiss the other, rendering them irrelevant: The other is the barbarian who needs to be educated. The other is also the intellectual who is best killed.

Essentially, maya makes us to judge. For when we measure, we wonder which is small and what is big, what is up and what is down, what is right and what is wrong, what matters and what does not matter. Different measuring scales lead to different judgments. Wendy Doniger is convinced she is the hero, and martyr, who fights for the subaltern Indian in her writings. Dinanath Batra is convinced he is the hero who opposes her wilful misunderstanding of sanatana dharma. Baba Ramdev feels he has a right to demand the banning of PK. And the producers of the film respond predictably about the freedom of speech and rationality, as they laugh their way to the bank. Everyone is right, in his or her maya.

Every action has consequences. And consequences are good and bad only in hindsight. The age of Enlightenment was also the age of Colonisation. The most brutal wars of the 20th century, from the world wars to the Cold Wars, were secular. Non-violent thought manifests itself in non-violent words which give rise to violent action. The fruit is measurable, not the seed. To separate seed from fruit, thought from action, is like separating stimulus from response. It results in a wrong diagnosis and a wrong prescription. The killer does not kill thought. The thought creates more killers.

What goes around always comes around. Outrage over violence feeds outrage over cartoons. Hindu philosophy (not Hindutva philosophy) calls this karma. We don’t want to break the cycle by letting go of either non-violent outrage or violent protests. Ideas such as maya and karma annoy the westernised mind for they disempower them: they who are determined to save the world with measuring tools dismiss astute observation of the human condition as fatalism.

In his past life, Shishupala was the doorkeeper Jaya of Vaikuntha who was cursed by the Sanat rishis that he would be born on earth, away from Vishnu, for daring to block their entry. The doorkeeper Jaya argued that he was doing his job but the curse stuck and Jaya was reborn as Shishupala. Vishnu had promised to liberate him and to expedite his departure, Shishupala practised viparit-bhakti, reverse-devotion, displaying love through abuse. So he insulted Krishna, knowing full well that Krishna was Vishnu and would be forced to act. There is a limit to forgiveness. But there should be no limit to love.

The Mahabharata Explained