web analytics

Algorithms are threatening our democracy

Written By: - Date published: 9:00 am, May 9th, 2018 - 36 comments
Categories: China, community democracy, Deep stuff, democracy under attack, democratic participation, facebook, internet, interweb, Politics, twitter - Tags:

When the Minister for Information Technology finally appoints a Chief Technology Officer I want them to address the risk to our democracy from algorithms.

If we follow the natural flow of algorithmic logic in the modern world that we inhabit, we are going to see the scope of ordinary analogue politics of real leaders in central and local government elections shrink to something so small and inconsequential to our behaviour that we head straight out of autonomous citizenship.

If anyone has today used used Uber, Google, Facebook, Baidu, Twitter, dating sites, a credit card, or Trademe, bought an air ticket or a train ticket, used eftpos, swiped an airpoints card, or looked at the internet on your phone, you’re currently inside an almighty set of largely unregulated algorithms that describe you better than you know yourself.

And when that perpetual identity about me gets in the hands of a central government, such as China, there’s no chance democracy will emerge.

iThis steady transfer of autonomy is not inevitable, and it is not destiny. We shape it before it shapes us. Policy leaders and business leaders can develop and deploy systems the way they want according to institutional needs. The government has just set up a cheerleader group for perpetually greater digital access.

But my question is: does that group of cheerleaders know that they aren’t promoting a utility like a road; they are promoting a form of ever-more pervasive control from which there is no return?

Only a year ago the previous governments’ MSD Minister was continuing to proudly boast that they were transforming the lives of social welfare recipients with the “investment approach” of intensive algorithmic analytics.

Fortunately the new government has rejected that.

It is within our power to cast privacy nets around sensitive areas of human life, to protect people from the harmful uses of data, and to require that algorithms balance predictive accuracy against other values such as fairness, accountability, and transparency. Those values are absent in governments who have oversight over corporate and public algorithms.

Maybe we need to be louder about rejecting the anti-democratic mature of meritocracy which is inherent in analytic-based distribution. It’s reminiscent of Daniel Bell’s “The China Model” and Zhang Weiwei (back in 2012) who have already started to speak that unspeakableness to English-speaking audiences.

Liberal democracies like ours are of course highly unlikely to ever shift to such a system. Unlikely in our legislature, at least, but those algoriythms fully guide our lives in every other sphere involving choices, entertainment, public or private services, or products: in 95% of our lives. For example in the public realm it is not yet clear what will replace the full data collection and life-mapping of the previous
government as a result of the new social security legislation going through Parliament now.

Though as the Minister for the Security Intelligence Services Andrew Little noted a month ago, some algorythmic grounding is always necessary because our threats are real and they are growing.

If such trends in business and consumer culture continue, we might soon have a culture more in common with Chinese meritocratic and communitarian traditions than with our own history of individualism and liberal democracy, in all but Parliament and City Hall.

China is using is spectacular data capture and its algorithms to form a totalising population wide societal purity programme in which you get points for doing heroic and kind acts, and a negative social credit rating for everything from spitting to jaywalking. That’s where this goes folks.

If we want to change course, we will have to put our own political imperatives before those of our technologies.

36 comments on “Algorithms are threatening our democracy ”

  1. Chris T 1

    No offence, but I totally disagree with your thinking

    An algorithm is just a tool that uses a set of rules or methods to solve a problem or get an answer to a question

    They are hardly a new thing

    They have been used since the time of the ancient greeks.

    I would agree with you though that they can be used in ways that are detrimental.

    I think your issue with algorithms seems to be more to do with the type of algorithms, who is creating them and their motives

    It is a bit like blaming money for money laundering

    • Gosman 1.1

      Exactly.

    • tracey 1.2

      Algorithms dont kill. Guns do. No wait.

    • dukeofurl 1.3

      Algorithm isnt Greek

      “the term algorithm itself derives from the 9th Century mathematician Muḥammad ibn Mūsā al’Khwārizmī, latinized ‘Algoritmi’.

      A partial formalization of what would become the modern notion of algorithm began with attempts to solve the Entscheidungsproblem (the “decision problem”) posed by David Hilbert in 1928- “Wikipedia

      1928 !
      https://en.wikipedia.org/wiki/Entscheidungsproblem

  2. One Two 2

    That’s a good article, Ad…

    The digital world is the antethesis of the biological, natural world…which is analogue…

    The so called digital economy is undefined and will remain so…

    As with all ‘things’…there are various outcomes on a spectrum…

    For example…the same digital technology which can be used to entrap humanity through greater centralization can also enable decentralization…

    A key issue as I see it is this…

    The current available technology and knowledge is already sufficient to fix the major issues faced by humanity today…but the tech is not currently being used to achieve such outcomes…more tech is not a solution our planet or species requires…

    More technology is not going to fix those major issues,…human beings and the natural analogue world, is and always will be the solutions required…

  3. Gosman 3

    Except there is strong evidence to suggest that early intervention social programmes in people’s lives can make a huge difference and the best way to identify at risk people is to use algorithms based on known risk factors.

    • Ad 3.1

      The question of my post is not efficacy, but whether it is worth the tradeoff in human rights, human privacy, and human autonomy.

      Here’s what it’s like inside China’s behavioural adjustment programme.

      It’s more Minority Report or Gattica than either of them.

      http://foreignpolicy.com/2018/04/03/life-inside-chinas-social-credit-laboratory/

      • Gosman 3.1.1

        There are dangers inherent in any system that attempts to make other people’s lives better. It inevitably involves a certain amount of trade offs between individual liberty and societal engagement. The question is whether these trade offs are acceptable or not. Using algorithms on their own is not necessarily a bad thing and won’t always lead to negative outcomes.

        • tracey 3.1.1.1

          No but based on the almost total lack of ethics displayed by our most powerful politicians algorithms are already in the wrong hands

        • lprent 3.1.1.2

          Let me put this simply. I have no interest in anyone having more information about me than I choose to give. I have no interest in coercing others to do differently to myself.

          I am also perfectly willing to disrupt arseholes who try to do that – for any reason
          well intentioned or not.

          I can do that politically, with algorithms, with social education, legally, or if required with violence. Those are some of MY choices.

          The last governments disregard for individual rights to privacy and coercive actions towards beneficiaries along with a callous disregard for the damage to people they were inflicting was steadily moving me towards stronger and more effective means of showing my concern.

          Generally I prefer algorithmic approaches. I use them to find people who vote the arseholes back to obscurity.

    • tracey 3.2

      Can you post the evidence of where states used algorithms to improve the lives of those at risk?

    • dukeofurl 3.3

      Where is the algorithm in the early intervention social program. More like a priority ranking where limited resources ( from budget cuts) are made to ‘young people’ in crisis.

      Actually a good example where it all went wrong
      https://www.stuff.co.nz/national/health/70647353/children-not-labrats–anne-tolley-intervenes-in-child-abuse-experiment

      So no algorithm as they couldnt treat kids like lab rats

  4. Draco T Bastard 4

    And when that perpetual identity about me gets in the hands of a central government, such as China, there’s no chance democracy will emerge.

    Same goes for corporations who get to lobby government and sit down to lunch with ‘our’ elected officials.

    And who’d be the ones getting all the government moneys for developing this and then administering it.

  5. David Mac 5

    I think it will be interesting see how far China HQ push. They staunchly enforced their ‘Just 1 kid everyone’ policy.

    There are all sorts of ways folk can be steered via algorithms. eg: If my doctor has deemed I’m overweight and a diabetes risk my EFTPOS card might no longer buy fizzy drink, if I have a history of drunken violence, can’t buy alcohol etc.

    If it starts emptying Chinese jails and hospitals etc I can see Governments like ours nuzzling up to the idea of extending access and control via the info that floats around about all of us….

    “It’s for your own good Mr Mac.”

  6. greywarshark 6

    I understand that it is algorithms that are being used for decision making about people’s entitlements to ACC. Machines checking through applications. Any that don’t fit the boxes don’t pass.

    We will have to insist that people be involved in work and decision making at every level or this sort of thing is going to be rolled out over the broad population. Our freedom to think and do and be treated fairly as people will be under the ‘iron will or the iron fist’ or factually, some sort of polymer and our ability to be ourselves will be constantly encroached on.

    Meanwhile people go on their complacent way and seem unaware or too accommodating for their own good, of this constant invasion into their lives.

  7. greywarshark 7

    I have a facebook page but I have given it the least information, mainly my name. It has picked up bits from my family and put them up and I haven’t corrected it. If someone used that info to provide information for a business purpose instead of approaching me personally, could I be accused of having false information about me on my page? So many people seem to regard Facebook as gospel but I don’t go out of my way to put up anything that doesn’t serve an immediate purpose, and is limited in its detail.

    Perhaps some lonely people are communicating with some avatar as if it is a real person already. Little monkeys brought up away from their mother, will cling to a wire frame covered in soft material. They draw comfort from the feel of the softness, the concept of caring and touch. I hope we can have a more meaningful future with real people and not just the make-believe or the words flying between people like this!

  8. Cold Hard Truth 8

    “And when that perpetual identity about me gets in the hands of a central government, such as China, there’s no chance democracy will emerge.”

    What makes you think democracy is so wonderful? Its democracy that makes the spying possible, its democracy that lets private corporations claim our personal data, its democracy that lets this turd of a Labour govt piss away our right to self determination signing the CP-TPPA.

    If you go on line say “goodbye” to your privacy. Until climate change destroys organised human existence and eliminates “democratic institutions” nothing will change. Sorry about that.

    • McFlock 8.1

      Do you have a better system than democracy? lol

      As for the destruction of organised human existence, not gonna happen from climate change. If anything it will make societies even more organised and draconian than democracy.

  9. DB Brown 9

    This is an incredible historical phenomenon we’re all witness to. Sure algorithms have been around a while but their applications today are astounding.

    In the capacity of science I always want more data. The caveat being, if the data is corrupt, it is worthless (for working towards truths, not agendas). Big data in areas like microbiology is so damn exciting in its potential, it’d require a book to get me started just how useful it could be (imagine efficiencies down to a microscopic scale)…

    It’s a real catch 22. Algorithms capture data. Data is very useful, like science: but in the hands of corporates and non-benign governance it seems to spell the end of many freedoms. As for data in the hands of politicians, well, it’s rarely ever used correctly. Stats in a hat is what I call it (Sorry Dr Suess).

    A family member runs a business on an algorithm. It spies on visitors to a whole sectors websites and exchanges information between vendors. So you think you have never ‘met’ a retailer, but they know already what you’ve been looking at elsewhere, and what the price range is. They can bump a price up if they know you’ve got the money. His take is if it’s legal (grey area = not illegal) who cares.

    Trying to stop algorithms is going to be like trying to stop Oil or Tobacco. They’ll resist with everything they’ve got as the potential revenue is astonishing.

    It’s not going to be they’ll know what you want before you do, instead, they’ll be able to convince you you want what they’ve got. (how to swing votes is the same as how to swing preferences in other fields).

    I opted out of social media (FB) two years ago. It became obvious my thoughts were sent to advertisers. And the way they divided my feed down to angry lefties and tragedy to greet me each day… what a horror show.

    While everyone is entitled to their opinions, I found the bulk of them (FB feed) were misguided. By algorithms?

    • dukeofurl 9.1

      Trouble with that is they are continuing to profile you. Twitter and Facebook cookies are ubiquitous on many many websites.
      Answer is to check in your browser search bar and the little padlock. Click on that and will show how many cookies, just block FB and twitter ones ( and then delete)

  10. Philg 10

    Algos, like hammers or guns can b weaponised. This is the crux of the issue. Do we regulate and enforce laws on guns, hammers? AI justice is just round the corner.

  11. ropata 11

    Nothing wrong with “algorithms” in general, they are ubiquitous in everything electronic. Algorithms started off as mathematical abstractions, but now they are having widespread social impact, they need an ethical framework.

    Europe passed its wide ranging data privacy legislation in 2016 and it comes into force on 25 May 2018. Companies worldwide are scrambling to comply or be subject to considerable fines or sanctions in Europe.
    https://en.wikipedia.org/wiki/General_Data_Protection_Regulation

    New Zealand should do the same.

  12. tangello 12

    Best bet for tracker-blocking (without doing any extensive networking or security) is 1) clear all caches thoroughly
    2) delete Chrome and get Firefox
    3) turn on all privacy blockers and options, enable ‘do not send’ requests, get uBlock Origin extension etc
    4) get the ‘facebook container’ extension which boxes fb’s access to only its own tab while browsing.

    These should largely be repeatable for mobile too, although Firefox has made it a lil easier with their security-oriented browser Firefox Focus, which is rad.

Recent Comments

Recent Posts

  • Government's response to preliminary referendums' results
    Minister of Justice Andrew Little has acknowledged the provisional results of the two referendums voted on in the 2020 General Election. New Zealanders were asked whether they supported the proposed Cannabis Legalisation and Control Bill, and whether they supported the End of Life Choice Act 2019 coming into force. On ...
    BeehiveBy beehive.govt.nz
    19 hours ago
  • New testing requirements for international maritime crew arriving in NZ
    The Government is moving to provide further protection against the chance of COVID-19 entering New Zealand through the maritime border.  “Yesterday I instructed officials to consult with the maritime sector around tightening of the requirements for international maritime crew entering the country,” Health Minister Chris Hipkins said.  “Ultimately, this will ...
    BeehiveBy beehive.govt.nz
    21 hours ago
  • Fast-tracked Northland water project will accelerate economic recovery
    The Government has welcomed the decision to approve a new water storage reservoir in Northland, the first of a number of infrastructure projects earmarked for a speedy consenting process that aims to accelerate New Zealand’s economic recovery from Covid-19.  The Matawii Water Storage Reservoir will provide drinking water for Kaikohe, ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Tokelau Language Week reminds us to stay united and strong
    Staying strong in the face of challenges and being true to our heritage and languages are key to preserving our cultural identity and wellbeing, is the focus of the 2020 Tokelau Language Week. Minister for Pacific Peoples, Aupito William Sio, says this year’s theme, ‘Apoapo tau foe, i nā tāfea ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • NZ announces a third P-3 deployment in support of UN sanctions
    The Government has deployed a Royal New Zealand Air Force P-3K2 Orion (P-3) maritime patrol aircraft to support the implementation of United Nations Security Council (UNSC) resolutions imposing sanctions against North Korea, announced Minister of Foreign Affairs Winston Peters and Minister of Defence Ron Mark. “New Zealand has long supported ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Pacific trade and development agreement a reality
    Pacific regional trade and development agreement PACER Plus will enter into force in 60 days now that the required eight countries have ratified it. Trade and Export Growth Minister David Parker welcomed the announcement that the Cook Islands is the eighth nation to ratify this landmark agreement. “The agreement represents ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Securing a pipeline of teachers
    The Government is changing its approach to teacher recruitment as COVID-19 travel restrictions continue, by boosting a range of initiatives to get more Kiwis into teaching. “When we came into Government, we were faced with a teacher supply crisis,” Education Minister Chris Hipkins said. “Over the past three years, we ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Border exceptions for a small number of international students with visas
    The Government has established a new category that will allow 250 international PhD and postgraduate students to enter New Zealand and continue their studies, in the latest set of border exceptions. “The health, safety and wellbeing of people in New Zealand remains the Government’s top priority. Tight border restrictions remain ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • First COVID-19 vaccine purchase agreement signed
    The Government has signed an agreement to purchase 1.5 million COVID-19 vaccines – enough for 750,000 people – from Pfizer and BioNTech, subject to the vaccine successfully completing all clinical trials and passing regulatory approvals in New Zealand, say Research, Science and Innovation Minister Megan Woods and Health Minister Chris Hipkins. ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • International statement – End-to-end encryption and public safety
    We, the undersigned, support strong encryption, which plays a crucial role in protecting personal data, privacy, intellectual property, trade secrets and cyber security.  It also serves a vital purpose in repressive states to protect journalists, human rights defenders and other vulnerable people, as stated in the 2017 resolution of the ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Ministry of Defence Biodefence Assessment released
    The Ministry of Defence has today released a Defence Assessment examining Defence’s role across the spectrum of biological hazards and threats facing New Zealand. Biodefence: Preparing for a New Era of Biological Hazards and Threats looks at how the NZDF supports other agencies’ biodefence activities, and considers the context of ...
    BeehiveBy beehive.govt.nz
    3 weeks ago