All hail our computer overlords

34 comments on “All hail our computer overlords ”

• Comments are now closed

1. Andre 1

   24 February 2019 at 9:20 am

   What’s missing from the comparison is an expert human assisted by the instant database searchability and recall capabilities of the computer.
2. Tiger Mountain 2

   24 February 2019 at 9:34 am

   Dir. Stanley Kubrick ahead of his time too, matte and models, and silent space, still aces a number of CGI laden, zap ’em space films

   “Open the Pod bay doors, HAL”–sod off Dave…

   no need to go totally trepidatious on AI, well unless your scooter or driverless car loses the plot perhaps! But AI under capitalist ownership and development will likely be horrendous indeed
3. RedLogix 3

   24 February 2019 at 9:44 am

   Yes. That’s my leaning as well. I base my sense of this on three premises:

   One the AI community is deeply divided on whether we can ever produce a conscious machine. We happen to live with a Professor of AI systems at present (a whole other story) and his sense is that given we understand almost nothing about the nature of consciousness in our own biological systems, it’s hard to imagine we could reproduce it in a machine.

   There is the argument that self-awareness might arise in machines in an endogenous, spontaneous manner without humans even being aware of it happening. This is an interesting possibility with some deep consequences we must guard against.

   Two is that I asked a question the other day “who are you going to trust”. This remains one of the core problems of computing; trust-ability. We already have enough problems determining what information we can trust on the internet that is generated by fellow humans that we share a great deal in common with. How then could we possibly hope to trust sentient machines we don’t understand at all?

   Thirdly I fall back on my all time favourite author Vernor Vinge. He was a Professor of Computer Science at San Diego University and published a number of short stories and a solid core of brilliant hard sf novels:

   https://en.wikipedia.org/wiki/Vernor_Vinge

   Vinge’s core themes returned to the exact problem of the OP many, many times. And in a remarkably diverse number of forms. He was famously writing about the internet in the 80’s before it was invented. He also anticipated blogs, social media and virtual realities long before they became a reality. Critically he also foresaw the many unintended consequences of these things. In one novel he memorably constructed a galactic web colloquially called the “Net of a Billion Lies”.

   And in another thread he called AI “one of the great failed dreams”.

   Yet his novels are full of sentient life deeply entangled and enhanced by AI machines. In one story he has his High Tech humans each accompanied by a ‘robot’ which hovered about 1km above them, permanently linked to their human serving multiple layers of purposes, sensory, pre-processing, threat evaluation and defense.

   This seems to me the most benign of the possible technological Singularities (another term Vinge coined) one where AI systems remain essentially the servants of humanity, not the other way around.
4. Jenny - How to get there? 4

   24 February 2019 at 9:47 am

   Computers will never be our overlords. They have no free will. In fact they have no will all.

   It is said that good computer can beat any human chess champion but even the greatest current chess playing engines cannot move a single piece on the board, they require a human being to do that.
   I suppose you could build a movable robot arm and program a chess computer to move it’s pieces. But would that chess playing robot drive across town to attend a chess conference?

   No. The computer and its arm would still have to be loaded into trucks and driven to the chess venue.

   But what if you had a fully autonomous robot able to drive across town to get to the venue and move pieces on a chess board?

   Why would it do that?

   It requires a human to want a chess playing computer to get to a venue to play chess.

   A computer has no will. It doesn’t want to do anything, neither does it want for anything. It feels no pain, it feels no hunger, it has no desire, (for anything).

   Only humans have desires and wants and ambitions and dreams and wishes.

   Not only do computers not have free will, they have no will at all.
5. KJT 5

   24 February 2019 at 9:53 am

   On the one hand. How can a bunch of on/off switches ever be anything other than a machine.

   On the other. The human brain is a huge bunch of neural switches.
   • Chris T 5.1

     24 February 2019 at 4:59 pm

     Get your point, but the brain is more chemical synapses than electrical.

     Different levels to different parts and then the electrical side just joining the pathways.

     Which is why psychoactive drugs work.

     If it was all on off everybody would be the same logic conclusion and life would frankly be very boring
6. RedLogix 6

   24 February 2019 at 10:01 am

   It’s an interesting problem Jenny. The AI community is pretty deeply divided on this. A large part of the problem is that we don’t really understand the true nature of ‘free will’ even in humans.

   For instance using biomedical scanning techniques it can be shown that there are definite signals occurring within the brain some fraction of a second before we are ever conscious of a decision to act. We are very complex creatures indeed.

   Much of this rests on what we might call the religious proposition. If we take the view that life is an entirely materialistic affair, then it’s easy to accept the idea that we might build entirely material machines which can fully emulate biological ones.

   If on the other hand we accept there is a domain of the abstract or non-material … and that our consciousness is the link between the world of facts and values … then constructing a material machine that can operate in the non-material domain seems a much harder problem. Impossible even.

   This whole discussion may seem a bit fanciful, yet it holds some very real and rapidly encroaching implications for us all. Within a decade or so.
7. Incognito 7

   24 February 2019 at 11:19 am

   Good topic for a post, Micky. In fact, it’s been on my mind for some time now to write about this too. I’ll keep my powder dry for now 😉
8. Dukeofurl 8

   24 February 2019 at 11:33 am

   jenny , robots in factories do plenty of physical tasks. A Chess game can be played on a screen or tablet by humans, doesnt require a physical chessboard.

   I understand the newer AI chess computers arent programmed to do so, but use AI to learn how to play and very quickly play very very well. But of course thats a multi million dollar AI computer not an app on a phone.

   https://www.theguardian.com/technology/2017/dec/07/alphazero-google-deepmind-ai-beats-champion-program-teaching-itself-to-play-four-hours
   • Jenny - How to get there? 8.1

     25 February 2019 at 7:57 pm

     My point is that a machine has no will to want to play chess, or any other activity, whether it be in the real world, or the virtual world. No matter how smart they are.

     All their tasks and goals are set by humans. And, as far as I can envisage, they always will be. Even if the goals and tasks set for computers by human beings far exceed human abilities. In many applications computers already exceed human abilities, I can only see this trend continuing.

     Whether computers will one day want to be our overlords?

     Computers don’t want for anything.

     Only human beings would want to enslave other human beings.

     A supercomputer that one day had the ability to be our overlord, will never be more than a tool used by another human being or group of human beings who ‘want’ to enslave the rest of us. Hopefully by that time, ‘the rest of us’ will also have the use of machines of equal computing power able to resist the impulses of the other human beings who want to enslave us, using their machine.

     A computational arms race of sorts.

     Those days are far off. So we probably won’t have to worry about it.

     If that time does arrive, hopefully also by that time, humanity will also be much more emotionally advanced, beyond such backward, primitive impulses.
     • Jenny - How to get there? 8.1.1

       25 February 2019 at 8:29 pm

       Not every ‘thing’, wants to rule the world.
9. rata 9

   24 February 2019 at 11:37 am

   When electricity first came in suspicious older folks
   would peer fearfully at the miracle magic installation
   wary of the evil gremlins lurking inside 🙂
   • Jenny - How to get there? 9.1

     25 February 2019 at 8:18 pm

     The ghost in the machine.

     Even before the invention of machines, people used to attribute animals and trees, and even natural forces like the weather, with human motivations,

     https://en.wikipedia.org/wiki/Anthropomorphism

     Anthropomorphism
     From Wikipedia, the free encyclopedia

     Anthropomorphism is the attribution of human traits, emotions, or intentions to non-human entities.[1] It is considered to be an innate tendency of human psychology.[2]

     Personification is the related attribution of human form and characteristics to abstract concepts such as nations, emotions, and natural forces, such as seasons and weather…..

     …..In science fiction, an artificially-intelligent computer or robot, even though it has not been programmed with human emotions, often spontaneously experiences those emotions anyway: for example, Agent Smith in The Matrix was influenced by a “disgust” toward humanity. This is an example of anthropomorphism: in reality, while an artificial intelligence could perhaps be deliberately programmed with human emotions, or could develop something similar to an emotion as a means to an ultimate goal if it is useful to do so, it would not spontaneously develop human emotions for no purpose whatsoever, as portrayed in fiction.[59]…
10. AB 10

    24 February 2019 at 11:49 am

    Chomsky – “I have been hearing this for 60 years”
    The threat of supercomputers
    So the only threat from supercomputers comes from the people who will own the technology. Most likely they will use it to enrich themselves and impoverish the rest of us.
11. Drowsy M. Kram 11

    24 February 2019 at 12:46 pm

    Can you have intelligence without curiosity?

    Can you have intelligence without empathy?

    Intelligence is often linked to other (human) traits, but could general ideas about what intelligence is, and how it develops, be the products of tunnel vision? Might there be some types of ‘intelligence’ that we won’t/can’t recognise?

    Second Genesis, by David Moffitt (1986)

    Many centuries ago, an alien race known as the Nar were able to recreate human beings from genetic code, broadcast from Earth into outer space by a beleaguered humanity. Although the Nar are kind and benevolent masters to the humans, discontent leads the humans to revolt, and the Nar realize that they do not yet fully understand their rebellious creations.

    They allow a group of humans to travel millions of light years through the galaxy, in order to discover what has happened to the original occupants of planet Earth. However, none of the human participants of the expedition are prepared for what awaits them at the completion of their journey…
    • ropata 11.1

      28 February 2019 at 9:08 pm

      Asimov wrote a number of short stories about “Multivac“, a fictional supercomputer that was given the task of governing humanity. Asimov pointed out a number of weaknesses in this solution, among them our tendency to cheat the system, and to want autonomy.

      A short piece in The Atlantic notes that Silicon Valley thinks a technocratic utopia is the answer but that’s pie in the sky and the reality is that a proper functioning democracy needs a virtuous society in which civic education is valued.
12. RedLogix 12

    24 February 2019 at 1:00 pm

    @AB

    Chomsky’s put down “I’ve been hearing about this for 60 years” is only partly founded in reality. In one sense he may be right, that AI will always be one of the failed dreams.

    Yet in another sense it’s entirely possible that AI will become sufficiently capable and diverse that the difference becomes a meaningless question. We are already seeing this with Google, Facebook and other big data enterprises, we are already seeing disturbing political implications in China’s ubiquitous surveillance rollout.

    Most likely they will use it to enrich themselves and impoverish the rest of us.

    This has been true of every single technology humans have ever invented; from fire sticks onward. But none of us would discard every single human technology on that basis alone. (Or if you are really determined to do so, please check with any women in your life first to see if they want to permanently go back to the Stone Age.)

    We always have this problem, that some people will naturally be better or quicker at implementing a new technological advantage, and that the rewards for doing so will flow disproportionately towards those who already have the most resource.

    This is a basic law of nature; the more resource you already have, the more opportunity you will have, the faster you will grow that opportunity and the more dominant socially you will become. This isn’t necessarily about politics, greed or a lack of empathy … it’s fundamental to all natural systems.

    What is remarkable about human social structures is that over time we’ve gotten better at extending the advantages of new technologies to more and more people. 200 years ago almost all people lived in absolute poverty; now almost a billion of us live extraordinary lives of comfort and security unimaginable to our great grandparents. Another five billion are catching up rapidly and only one billion, mostly in India and Nigeria remain in absolute poverty.

    As an automation engineer what I’m seeing the so called “Internet of Things” (IOT) rapidly climbing over the peak of the hype curve, from an over-egged idea into reality. This will prove one of the crucial tools to enable the Third Industrial revolution, it should greatly improve our energy efficiencies and open the door to a new sharing economy. Services like Uber are just a glimpse of what will become possible.

    Railing against this AI transition is pointless and counterproductive; it will happen whether we like it or not. What we can do is pay attention to it’s potentials, it unintended consequences and continuously ask the hard questions. To what purposes is this new technology being used? Is it enslaving us collectively, or is it being used to liberate the potential of each individual?

    Probably both will be true at the same time, but we do need to know which direction we want to head in, and ensure we get there sooner.

    PS It seems the reply function isn’t working on this thread for some reason.
13. Poission 13

    24 February 2019 at 1:15 pm

    PS It seems the reply function isn’t working on this thread for some reason.

    Irony due to complexity.

    http://www.scholarpedia.org/w/images/thumb/4/48/Complexity_figure1.jpg/300px-Complexity_figure1.jpg
14. RedLogix 14

    24 February 2019 at 1:32 pm

    @Poission

    Yes I’ve encountered encounter over-complexity many times in my life; yet looking back it’s also obvious that the curve is not fixed in concrete, it moves with time toward the right. ie what was over-complex ten years ago, becomes good practice today.

    In general the way we solve the complexity problem is to break down large problems into smaller layers, and over time these layers become better understood, more generalised, more capable and more trusted. This in turn enables more layers to be reliably combined and bigger problems to be solved.

    In the IT world the usual order of priority is authentication, confidentiality and then availability. In my world of big machines and processes the order is the other way around … determinism and availability tops all. For instance once I had a system fully commissioned and verified (online in real-time with the physical process), assuming no-one fiddled with it in the meantime, I’d expect to come back 20 years later and still find the system working, no reboots, no updates … just quietly gathering dust in a cabinet somewhere doing it’s thing.
15. AB 15

    24 February 2019 at 1:43 pm

    @RL
    Chomsky’s point (as I understand it) is that humans cannot reproduce in machine form something, the workings of which, we do not even comprehend in ourselves. And will never comprehend in ourselves because it is beyond the cognitive limits of the human organism to do so.

    No doubt we can get machines to do complex tasks in a way that on the surface looks like human intelligence in a narrow sense.
    Therefore if we need to be concerned about technology – it is not the technology in itself, it is who owns it and how they use it.
    Our battles are primarily political. Being concerned about sentient machines taking over the earth is the idle indulgence of a de-politicised populace. It’s a highly irritating distraction.
    • soddenleaf 15.1

      25 February 2019 at 11:01 am

      Agreed. Building a machine that mimics humans is impossible because we won’t understand how it works. arah, but, building a machine that mimics humans, well thats like building a human, as humans are the great mimics, it wont matter that the computer mimic undersrands itself. Most humanity doesnt even notice how religious belief is essentially stalking an internal idealized other, though no doubt a computing mimic AI will prove the non-existance of deities if it only does come to understand itself.
16. KJT 16

    24 February 2019 at 1:51 pm

    “Another five billion are catching up rapidly and only one billion, mostly in India and Nigeria remain”.

    Swallowed the cool aid, Red?
    https://tinyurl.com/y5aq54fx

    “The global population as a whole hasn’t gained more wealth in the last 200 years, he wrote—instead, “the world went from a situation where most of humanity had no need of money at all to one where today most of humanity struggles to survive on extremely small amounts of money,” with much of the world having endured “a process of dispossession that bulldozed people into the capitalist labor system.”
17. Stuart Munro 17

    24 February 2019 at 1:58 pm

    They wouldn’t be much worse than the net effects of governments in my lifetime – which fell more than a little short of enlightened democracy. But if we take Michel’s law seriously, it would not be computer overlords, but IT folk, who, though many are pleasantly geeky, run as full a range of human foibles as any other rough sample of our species.
18. RedLogix 18

    24 February 2019 at 2:01 pm

    @AB

    Yes that does seem a reasonable approach to the question. Peterson interestingly goes one step further and suggests that the notion of a ‘disembodied intelligence’ is a non-sequitur; that consciousness arises from the link between the material and non-material domains … but critically depends on both.

    In other words the way we perceive the world is dependent on our bodies as much as the way our mind makes abstractions of reality. This doesn’t close the door on AI; maybe the sensory embodiment of a vast networked system will generate it’s own form of awareness we have trouble recognising.

    Yet I tend to agree, sentient AI that ‘takes over the world’ is probably the wrong way to look at the problem. A more challenging prospect is that highly capable AI forms will create a new class of humans who are the first and most adept to exploit it. Given we don’t yet understand the potential advantage this will give them (and it could be enormous), we must not regard this as an annoying distraction.

    As with all new tech it will have it’s unintended consequences; this one could come with some dramatic new blessings and curses all at the same time.
19. Macro 19

    24 February 2019 at 2:03 pm

    hmmmm let me guess. The answer was 42?
    
20. RedLogix 20

    24 February 2019 at 2:24 pm

    @ KJT

    And here some rebuttals of Hickel’s romantic notion that we all lived better lives before the Industrial Revolution.

    https://capx.co/bill-gates-is-right-the-world-really-is-getting-better/

    https://capx.co/the-romantic-idea-of-a-plentiful-past-is-pure-fantasy/

    https://www.humanprogress.org/article.php?p=1745

    And the idea that the masses of non-Western people lived noble lives of subsistence peasantry, free from disease, want and oppression is equally fanciful.

    In one sense you are correct, my views have changed; the idea the world is a better place now than even 40 years ago is something my partner doggedly argued to me for a very long time. Many of us who were influenced heavily by the 60’s and 70’s grew up with a deep suspicion of the modern world, pained at it’s cavalier treatment of the planet, and disturbed by the gross inequalities it seemed to tolerate.

    Yet alongside that vision there is another way to look at what is happening; and in particular the past five years or so I’ve been fortunate to work in many different countries and seen for myself the very dramatic changes in the lives of people all over the planet. It’s not even, it remains patchy and arbitrary … but the fact is that fully half the people in the world now live moderately middle class lives:

    Explaining the significance of what they are describing, Kharas and Hamel do not mince their words: “For the first time since agriculture-based civilization began 10,000 years ago, the majority of humankind is no longer poor or vulnerable to falling into poverty.”

    https://capx.co/bourgeoisie-of-the-world-unite/
    • KJT 20.1

      24 February 2019 at 3:08 pm

      Tell that to a foxcon worker, or an African farmer now starving in a city slum.
      Money is not wealth.
      And averages are not indicative of the whole.
21. RedLogix 21

    24 February 2019 at 4:00 pm

    @KJT

    The transition from subsistence poverty to the middle class is not always pretty or easy. The Victorian era industrialisation is evidence of that. But by 1900 few people in Europe would have chosen to revert back to life 100 years prior.

    And you can argue all you want that averages are meaningless from the perspective of the individual, but they still clearly indicate which direction we are heading in.
    • KJT 21.1

      24 February 2019 at 4:50 pm

      The direction we are all heading in, is environmental collapse, followed by mass deaths and displacement of people.
      Not to worry. We will be replaced by computers.
22. Chris T 22

    24 February 2019 at 5:02 pm

    Just a heads up with this thread to iPrent

    The reply function works on a phone (android, at least), but not a PC/laptop

    Cheers!
23. Poission 23

    24 February 2019 at 5:17 pm

    rl

    Yes I’ve encountered encounter over-complexity many times in my life; yet looking back it’s also obvious that the curve is not fixed in concrete, it moves with time toward the right.

    No with complex problems say newton third law, there is a reflection of the concrete and the arrow of time (That one should be aware of)

    https://www.ngssphenomena.com/arrow-vs-concrete/
24. Sam 24

    25 February 2019 at 2:36 am

    She’s way to human. You don’t want a sentient being with no biological frailties and human emotions. Way to dangerous. No.
25. KJT 25

    25 February 2019 at 9:15 am

    Interesting scientists are finding levels of intelligence and traits in animal intelligence, previously thought to be unique to humans.
    Not news to those of us who have pets or work with animals, though.
    I’ve known for years that cats have a sense of irony.
26. Jenny - How to get there? 26

    27 February 2019 at 6:17 am

    Despite all its stunning progress and sophistication, AI is not intelligence, nowhere near it.

    According to Scientific American if we are to ever to develop intelligent machines we would practically have to ignore all the progress made in developing working neural networks to go right back to first principles

    https://blogs.scientificamerican.com/observations/ais-big-challenge1/

    …. current technology exhibits no convincing demonstration of anything remotely approaching “intelligence.”

    …..It is difficult to imagine a more searing indictment of deep learning than the inability to learn by analogy. Essentially all cognitive development rests on learning and abstracting the principles underlying a set of concrete examples. The failure, thus far, of deep learning to do so reveals the emptiness behind the facade of intelligence presented by current A.I. systems.

• Comments are now closed

• Log in
• Donate
• Contribute post

• Articles RSS