web analytics

Defining the truth

Written By: - Date published: 10:31 am, March 17th, 2015 - 12 comments
Categories: Deep stuff, internet - Tags: , ,

News last week that Google is considering ranking web sites based on accuracy. This would in effect filter the sites that users see (all for “benign reasons” of course):

For some time, those of us studying the problem of misinformation in US politics – and especially scientific misinformation – have wondered whether Google could come along and solve the problem in one fell swoop.

After all, if Web content were rated such that it came up in searches based on its actual accuracy – rather than based on its link-based popularity – then quite a lot of misleading stuff might get buried. And maybe, just maybe, fewer parents would stumble on dangerous anti-vaccine misinformation (to list one highly pertinent example).

It always sounded like a pipe dream, but in the past week, there’s been considerable buzz that Google might indeed be considering such a thing. The reason is that a team of Google researchers recently published a mathematics-heavy paper documenting their attempts to evaluate vast numbers of Web sites based upon their accuracy. …

This piece covers the same news (again in a positive frame):

I recently wrote that the search engine is now using curated results when people search on vaccine-preventable diseases, to prevent the rampant spread of misinformation.

It seems Google may be preparing to use this science-based method of ensuring evidence-based results into other arenas, including climate change. Right now, Google uses various methods to rank search engine results, including the number and “authority” of sites that link to other sites. But this method is easy to game, giving pseudo- or anti-science sites higher credence in Google’s results page. Researchers at Google have published a paper proposing instead using “knowledge-based trust,” where the facts of the site are compared to what is commonly known to be true among trusted sources. AsNew Scientist says, “Facts the web unanimously agrees on are considered a reasonable proxy for truth.” You can claim, for example, that the Earth if flat, and get links from popular sites about it, but in this new system you won’t get much Google love. As you shouldn’t.

This has climate change deniers worried. As they should be. Since they rely on ridiculous, oft-debunked claims, their Google ranking could drop.

I have very mixed feelings about this. On the one hand improving the quality of information returned by searches would be good. We all benefit from higher quality information about health, less climate denier nonsense, less visibility for hate blogs (as one wag observed filtering for accuracy should pretty much make Whaleoil invisible).

But on the other hand, who decides what is accurate? (Who designs and weights the algorithms – will they find “the truth” or just the best funded / loudest voices?) How scientific, how open, how reliable will that process be? Google’s power to shape our lives is already immense, do I really want a profit driven American company effectively defining the truth for me? There is something to be said for seeing the raw debate and developing the skills to assess the validity of information for ourselves.

Whatever – Google is going to do what Google is going to do. But they should brace themselves for lawsuits. A lot of people make money out of nonsense, if Google makes them invisible they are going to sue. The Koch brothers and their denier industry won’t go quietly, for example. Interesting times.

12 comments on “Defining the truth ”

  1. One Anonymous Bloke 1

    Does this mean that all the top links will be behind science journal paywalls? Or to the relevant Wikipedia entry?

    • Tracey 1.1

      There won’t be enough hours in the day to scroll down to find National Party’s new ranking.

  2. RJL 2

    When Google results are just treated as a toy, or at best a survey of popular knowledge about a topic, then this seems quite a good idea. However, many people (and seemingly this is Google’s intent) treat Google results as the beginning and end of research about a topic. I see this lots in undergraduate research for assignments.

    If anything, anointing Google results with a “truth” algorithm will discourage people from thinking about what they source via Google even more.

    Presumably, the unscrupulous will eventually figure out how to game the “truth” algorithm too (and trigger a consequent arms race of modifications to the “truth” algorithm).

    • Murray Rawshark 2.1

      I often use Google as a research aid at the well past graduate level. If you know how to use it, it’s great. I have a few concerns about their truth algorithm, so I’ve downloaded the paper and I’ll see if I can understand it.

  3. Bill 3

    There’s a space for such a search function on some fronts, ie, as the post reports, on scientifically verifiable areas, although, even science has its orthodoxies (received wisdoms) and isn’t cut and dried.

    It’s within the social/political sphere that I’d be more worried. Although, even as it stands my searches and your searches are ‘siloed’ by google so that we ‘get what we want’ as it were.

    I believe that duckduckgo doesn’t perform searches based on historical search data.

    I’d settle for a search function that allowed for a simple and obvious exclusion of certain domain names or regions and that limited search results from single sites to some user defined number. I don’t want a screed of (say) BBC results. Just one or two will do…opening up prominent result displays to more sources. And from that one or two, each from a range of sources, I can decide which, if any, sites to do a site search on.

  4. Ovid 4

    It would be quite a challenge. At first, I would have thought they’d use citation weighting – the kind of thing we see with services like Google Scholar or Scopus – but that’s factored into their web crawler already. As a librarian, I encourage users approaching their resources with a critical eye. Google is a powerful tool, but should be used wisely.

    • One Anonymous Bloke 4.1

      wisely

      Indeed. Anyone who looks for information to support their existing beliefs will find it, which is why I make a point of searching for neutral or contradictory info.

  5. joe90 5

    I reckon we’re there.

    I fear we are witnessing the “death of expertise”: a Google-fueled, Wikipedia-based, blog-sodden collapse of any division between professionals and laymen, students and teachers, knowers and wonderers – in other words, between those of any achievement in an area and those with none at all. By this, I do not mean the death of actual expertise, the knowledge of specific things that sets some people apart from others in various areas. There will always be doctors, lawyers, engineers, and other specialists in various fields. Rather, what I fear has died is any acknowledgement of expertise as anything that should alter our thoughts or change the way we live.

    http://thefederalist.com/2014/01/17/the-death-of-expertise/

  6. peterlepaysan 6

    An algorithm that defines “accuracy”?

    Good science relies and depends upon healthy scepticism and robust debate, which must, perforce include judgement.

    Google has over reached itself if it thinks it can define accuracy.

    Accuracy requires testing of all relevant data.

    Google has no capability of gathering all relevant data on any topic.

    Was the gathering “accurate”?

    This is sillycon valley going up its own fundament

  7. what about non quantifiable, subjective topics such as
    religion,
    ethics,
    sexuality,
    politics,
    economics?

  8. Sable 8

    This has been around for a while. In my opinion Google are the US governments pal. There is a lot to show they are hardly impartial although they should be. I never use their search engine and never will.

Recent Comments

Recent Posts

  • NZ announces a third P-3 deployment in support of UN sanctions
    The Government has deployed a Royal New Zealand Air Force P-3K2 Orion (P-3) maritime patrol aircraft to support the implementation of United Nations Security Council (UNSC) resolutions imposing sanctions against North Korea, announced Minister of Foreign Affairs Winston Peters and Minister of Defence Ron Mark. “New Zealand has long supported ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Pacific trade and development agreement a reality
    Pacific regional trade and development agreement PACER Plus will enter into force in 60 days now that the required eight countries have ratified it. Trade and Export Growth Minister David Parker welcomed the announcement that the Cook Islands is the eighth nation to ratify this landmark agreement. “The agreement represents ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Securing a pipeline of teachers
    The Government is changing its approach to teacher recruitment as COVID-19 travel restrictions continue, by boosting a range of initiatives to get more Kiwis into teaching. “When we came into Government, we were faced with a teacher supply crisis,” Education Minister Chris Hipkins said. “Over the past three years, we ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Border exceptions for a small number of international students with visas
    The Government has established a new category that will allow 250 international PhD and postgraduate students to enter New Zealand and continue their studies, in the latest set of border exceptions. “The health, safety and wellbeing of people in New Zealand remains the Government’s top priority. Tight border restrictions remain ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • First COVID-19 vaccine purchase agreement signed
    The Government has signed an agreement to purchase 1.5 million COVID-19 vaccines – enough for 750,000 people – from Pfizer and BioNTech, subject to the vaccine successfully completing all clinical trials and passing regulatory approvals in New Zealand, say Research, Science and Innovation Minister Megan Woods and Health Minister Chris Hipkins. ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • International statement – End-to-end encryption and public safety
    We, the undersigned, support strong encryption, which plays a crucial role in protecting personal data, privacy, intellectual property, trade secrets and cyber security.  It also serves a vital purpose in repressive states to protect journalists, human rights defenders and other vulnerable people, as stated in the 2017 resolution of the ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Ministry of Defence Biodefence Assessment released
    The Ministry of Defence has today released a Defence Assessment examining Defence’s role across the spectrum of biological hazards and threats facing New Zealand. Biodefence: Preparing for a New Era of Biological Hazards and Threats looks at how the NZDF supports other agencies’ biodefence activities, and considers the context of ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New Approaches to Economic Challenges: Confronting Planetary Emergencies: OECD 9 October 2020
    New Approaches to Economic Challenges: Confronting Planetary Emergencies: OECD 9 October 2020 Hon David Parker’s response following Thomas Piketty and Esther Duflo. Good morning, good afternoon, and good evening, wherever in the world you might be. I first acknowledge the excellent thought provoking speeches of Thomas Piketty and Esther ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Kaipara Moana restoration takes next step
    A Memorandum of Understanding has been signed today at Waihāua Marae between the Crown, local iwi and councils to protect, restore and enhance the mauri of Kaipara Moana in Northland. Environment Minister David Parker signed the document on behalf of the Crown along with representatives from Ngā Maunga Whakahī, Ngāti ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Zealand and Uruguay unite on reducing livestock production emissions
    Agriculture Minister Damien O’Connor and Uruguayan Minister of Livestock, Agriculture and Fisheries Carlos María Uriarte have welcomed the launch of a three-year project that will underpin sustainable livestock production in Uruguay, Argentina, and Costa Rica.  The project called ‘Innovation for pasture management’ is led by Uruguay’s National Institute of Agricultural ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • 3100 jobs created through marae upgrades
    Hundreds of marae throughout the country will be upgraded through investments from the Provincial Growth Fund’s refocused post COVID-19 funding to create jobs and put money into the pockets of local tradespeople and businesses, Regional Economic Development Minister Shane Jones and Māori Development Minister Nanaia Mahuta have announced. “A total ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Health volunteers recognised in annual awards
    Health Minister Chris Hipkins has announced 9 teams and 14 individuals are the recipients of this year’s Minister of Health Volunteer Awards.  “The health volunteer awards celebrate and recognise the thousands of dedicated health sector volunteers who give many hours of their time to help other New Zealanders,” Mr Hipkins ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Community COVID-19 Fund supports Pacific recovery
    The Minister for Pacific Peoples, Aupito William Sio says a total of 264 groups and individuals have successfully applied for the Pacific Aotearoa Community COVID-19 Recovery Fund, that will support Pacific communities drive their own COVID-19 recovery strategies, initiatives, and actions. “I am keen to see this Fund support Pacific ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Community benefits from Māori apprenticeships
    Up to 50 Māori apprentices in Wellington will receive paid training to build houses for their local communities, thanks to a $2.75 million investment from the Māori Trades and Training Fund, announced Employment Minister Willie Jackson today. “This funding will enable Ngāti Toa Rangatira Incorporated to provide its Ngā Kaimahi ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Training fund supports Māori jobseekers
    Rapidly growing sectors will benefit from a $990,000 Māori Trades and Training Fund investment which will see Wellington jobseekers supported into work, announced Employment Minister Willie Jackson today. “This funding will enable Sapphire Consultants Ltd. to help up to 45 Māori jobseekers into paid training initiatives over two years through ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Ruakura Inland Port development vital infrastructure for Waikato
    The Government is investing $40 million to develop an inland port at Ruakura which will become a freight super-hub and a future business, research and residential development for the Waikato, Urban Development and Transport Minister Phil Twyford, and Māori Development Minister Nanaia Mahuta announced today. The funding has been has ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Appointments made to Defence Expert Review Group
    Defence Minister Ron Mark announced today the establishment of an Expert Review Group to review a number of aspects of the New Zealand Defence Force’s (NZDF) structure, information management and record-keeping processes.  The Expert Review Group’s work arises out of the first recommendation from the Report of the Government’s Inquiry ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • No active community cases of COVID-19
    There are no active community cases of COVID-19 remaining in the country after the last people from the recent outbreak have recovered from the virus, Health Minister Chris Hipkins said today. “This is a big milestone. New Zealanders have once again through their collective actions squashed the virus. The systems ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Clean energy upgrade for more public buildings
    More public buildings will be supported by the Government to upgrade to run on clean energy, the Minister for Climate Change James Shaw announced today. Minister Shaw announced that Lincoln and Auckland universities will receive support through the Clean-Powered Public Service Fund to replace fossil fuel boilers. Southern, Taranaki, and ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Schools back donations scheme for the second year
    More schools have opted in to the donations scheme for 2021, compared to 2020 when the scheme was introduced. “The families of more than 447,000 students will be better off next year, with 94% of eligible schools and kura opting into the scheme,” Education Minister Chris Hipkins said. “This is ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Ruapehu cycle trails gets PGF boost
    The spectacular Mountains to Sea cycle trail in Ruapehu District will receive $4.6 million in funding from the Provincial Growth Fund for two additional trails, Regional Economic Development Minister Shane Jones announced today. “This is an exciting development for the local community, and one that will provide significant economic opportunities ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Update to air border order strengthens crew requirements
    Additional measures coming into effect on Monday will boost our defence against COVID-19 entering New Zealand through the air border, Health Minister Chris Hipkins said today. “As part of our precautionary approach and strategy of constant review, we’re tightening the requirements around international aircrew,” Chris Hipkins said. The COVID-19 Public ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • A true picture of Māori business activity
    A better picture of the contribution Māori businesses make to the economy will be possible with changes to the way information is collected about companies and trading enterprises. Māori Development Minister Nanaia Mahuta and Small Business Minister Stuart Nash have announced a new option for Māori enterprises who are part ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • PGF funding for Taranaki projects
    The South Taranaki museum, a New Plymouth distillery and a Pasifika building firm will benefit from a Government investment totalling more than $1 million, Regional Economic Development Minister Shane Jones says. The $1.05m in grants and loans from the Provincial Growth Fund (PGF) will help the recipients expand and create ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Fijian Language Week 2020 inspires courage and strength during COVID-19 pandemic
    The Minister for Pacific Peoples, Aupito William Sio says the theme for the 2020 Fijian Language Week reflects the strong belief by Fijians that their language and culture inspires courage and strength that is strongly needed in times of emergencies, or through a significant challenge like the global COVID-19 pandemic ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Trades training builds on iwi aspirations
    An investment of $2.025 million from the Māori Trades and Training Fund will support Māori to learn new skills while making a positive difference for their communities, announced Employment Minister Willie Jackson today. “K3 Development Limited Partnership will receive $2,025,000 for its Takitimu Tuanui apprenticeship programme, which will support the ...
    BeehiveBy beehive.govt.nz
    3 weeks ago