web analytics

Sitemeter is broken – no Open Parachute stats.

Written By: - Date published: 1:35 pm, May 20th, 2017 - 6 comments
Categories: blogs - Tags: , , , , , , , , , ,

I see that Martyn Bradbury finally noticed that I dropped the public accessible statistics about The Standard in April at Open Parachute.

He characteristically titled it with his usual humility as “Blog Rankings: TDB second largest blog in NZ”. I thought that maybe we should start a movement to label him as “New Zealand’s Trump”. But I think that one of the big swinging dickheads locked in a current defamation trial already has his head stapled to his scrotum using the much larger Whaleoil sleaze and clickbait blog.

The reason that The Standard dropped on Ken’s list was quite simple and one that Bomber should have spotted himself earlier if he was less interested in bombastic self-promotion and more interested in how his site operates. Over the previous 4 months, the readings from Statcounter for page views had gotten increasingly inaccurate. Since Sitemeter had already displayed unexplained wild variances in recent years and most of the other public site stats packages have significiant other flaws on highish volume sites, we stopped running any.

As well as Statcounter, this site runs Google Analytics, WordPress Stats, and most accurately a slow analysis using the Apache logs. I tend to use Google Analytics as the usual, reference as it always closest to my occasional checks running the exhaustive Apache log analysis.

You can see the problem off the graph and the table below. Page views on Statcounter is got way below Analytics in February and never recovered. Over the last few years, the maximum variation between Statcounter and Google Analytics page views has been within +/- 15,000 for the range of page views per month of 300,000 to 600,000. Normally it is +/- 10,000. Even when we hit election peaks of more than 800,000 it is typically less than +- 20,000. Roughly 5% at the worst case.

Those are acceptable variances for something that is as tricky as measuring page views using questionable javascript, client side browsers, and various network filters and firewalls. When it consistently kicks up over 15% over a number of months then you know that something is going wrong.

Monthly Page Views Statcounter Google Analytics Difference
September 2016 369,540 364,647 4,893
October 2016 351,423 343,547 7,876
November 2016 379,565 387,904 -8,339
December 2016 402,218 479,215 -76,997
January 2017 344,060 396,006 -51,946
February 2017 376,092 404,807 -28,715
March 2017 366,486 438,881 -72,395

I noticed it in December and made time to look at the coding for problems. I couldn’t see any. I thought that there was a possible issue that would come right. January was less worse but on a smaller holiday volume. I started mentioning the issue to authors in the internal discussion posts.

In February there was a funny spike when it looked like someone at Statcounter dumped a pile of numbers into the page views in one hit – about an extra 30 thousand for us.

The Standard daily page views from Statcounter for February 2017

We weren’t alone. The same thing happened at the Daily Blog (an extra 22k) and a number of the other NZ sites that use Statcounter.

The Daily Blog daily page views from Statcounter for February 2017

March brought a lot of issues with slow page loads specifically related to statcounter. See the conversations here and here and here. I was somewhat busy that week at work (being a blogger and doing 60+ hour working weeks doesn’t always mesh), so I didn’t start tracking it until the weekend. But I got no useful responses from Statcounter.

Anyway, April was still bad. So when I had a break at work, I cut the connection to Statcounter and fixed the links in the mobile and desktop sites.

On a complete side issue, the other problem with the blog rankings is that it orders the ‘rankings’ on the wrong statistic. What Ken and Sitemeter calls ‘Visits’ is completely different to Sitemeter’s ‘Unique Visits’ and Analytics ‘Sessions’. Despite them trying to measure the same thing (how long a person is actually reading pages in a visit or session) and having very similar published parameters, they vary a lot. This shows up in the page views per visit or session.

Roughly speaking for our site in the same month,  the differences are stark. On our site and apparently on Kiwiblog, Sitemeter shows a consistent ratio of between 1.3 to 1.7 page views per ‘visit’ over a number of months. Statcounter shows 2.0 to 2.2 page views per unique visit over the same months. But Google Analytics shows 2.9 to 3.6 page views per session over the same months.

Bearing in mind that Google Analytics can show you pathways of each anonymous individual through the site visit including time stamps, then I’d say that google is correct. When I look at both Statcounter and Sitemeter logs, I have absolutely no idea where they cut off a ‘visit’. I suspect that is because they don’t post-process their logs.

But these are monumental differences, The effect of ordering on uncorrected ‘Visits’ from different stats packages is to make the ranking pretty useless. They don’t measure the same thing. Page views are a whole lot more similar between packages. However they can be affected by page design.

I don’t have the Sitemeter for the same period, but here are the visits and sessions for sitemeter and google analytics. Notice the big bump in February when Statcounter dropped that day’s extra visits in.

Monthly Statcounter ‘Unique Visits’ Google Analytics ‘Sessions’ Difference
September 2016 171,606 125,860 45,746
October 2016 162,311 111,866 50,445
November 2016 166,188 113,463 52,725
December 2016 192,890 143,339 49,551
January 2017 160,201 111,431 48,770
February 2017 186,268 107,771 78,497
March 2017 173,902 120,332 53,570

6 comments on “Sitemeter is broken – no Open Parachute stats. ”

  1. Ad 1

    What about Tweets?
    Is that still going?

    • lprent 1.1

      The gear ships off for EMC testing at the end of next week. I can start taking holidays and not working on weekends.

  2. Slim 2

    Craig v Slater
    Williams v Craig
    Standard v Daily Blog

    Nappies at dawn.

  3. lprent 3

    I seldom notice TDB, or Kiwiblog, or whaleoil. I simply don’t have time. However I needed to put up a post for the inevitable questions. When I was researching it I noticed Bomber being bomber again from the TDB link-back on the Open Parachute.

    Basically TDB needs to have a look at this problem as well. Otherwise it is likely that they will show in public a steadily decreasing readership. Unlike this site, they depend on being able to sell space and convince people that the site it worth putting money into.

    So Bomber got several mentions because like Donald Trump you appear to only be able to catch his attention if you make sure that his name is mentioned as many times as possible in a document. It doesn’t matter if it is a good mention or a bad mention. I have found that if you want information to be acted on, just mention the name.

    Umm can’t find the link for that. It did amuse me. Ah here – Reuters)

    Conversations with some officials who have briefed Trump and others who are aware of how he absorbs information portray a president with a short attention span.

    He likes single-page memos and visual aids like maps, charts, graphs and photos.

    National Security Council officials have strategically included Trump’s name in “as many paragraphs as we can because he keeps reading if he’s mentioned,” according to one source, who relayed conversations he had with NSC officials.

    Trump likes to look at a map of the country involved when he learns about a topic.

    Try this summary as well.

    Ah the leaker of the free world. But I digress…

Recent Comments

Recent Posts

  • Tokelau Language Week reminds us to stay united and strong
    Staying strong in the face of challenges and being true to our heritage and languages are key to preserving our cultural identity and wellbeing, is the focus of the 2020 Tokelau Language Week. Minister for Pacific Peoples, Aupito William Sio, says this year’s theme, ‘Apoapo tau foe, i nā tāfea ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • NZ announces a third P-3 deployment in support of UN sanctions
    The Government has deployed a Royal New Zealand Air Force P-3K2 Orion (P-3) maritime patrol aircraft to support the implementation of United Nations Security Council (UNSC) resolutions imposing sanctions against North Korea, announced Minister of Foreign Affairs Winston Peters and Minister of Defence Ron Mark. “New Zealand has long supported ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Pacific trade and development agreement a reality
    Pacific regional trade and development agreement PACER Plus will enter into force in 60 days now that the required eight countries have ratified it. Trade and Export Growth Minister David Parker welcomed the announcement that the Cook Islands is the eighth nation to ratify this landmark agreement. “The agreement represents ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Securing a pipeline of teachers
    The Government is changing its approach to teacher recruitment as COVID-19 travel restrictions continue, by boosting a range of initiatives to get more Kiwis into teaching. “When we came into Government, we were faced with a teacher supply crisis,” Education Minister Chris Hipkins said. “Over the past three years, we ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Border exceptions for a small number of international students with visas
    The Government has established a new category that will allow 250 international PhD and postgraduate students to enter New Zealand and continue their studies, in the latest set of border exceptions. “The health, safety and wellbeing of people in New Zealand remains the Government’s top priority. Tight border restrictions remain ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • First COVID-19 vaccine purchase agreement signed
    The Government has signed an agreement to purchase 1.5 million COVID-19 vaccines – enough for 750,000 people – from Pfizer and BioNTech, subject to the vaccine successfully completing all clinical trials and passing regulatory approvals in New Zealand, say Research, Science and Innovation Minister Megan Woods and Health Minister Chris Hipkins. ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • International statement – End-to-end encryption and public safety
    We, the undersigned, support strong encryption, which plays a crucial role in protecting personal data, privacy, intellectual property, trade secrets and cyber security.  It also serves a vital purpose in repressive states to protect journalists, human rights defenders and other vulnerable people, as stated in the 2017 resolution of the ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Ministry of Defence Biodefence Assessment released
    The Ministry of Defence has today released a Defence Assessment examining Defence’s role across the spectrum of biological hazards and threats facing New Zealand. Biodefence: Preparing for a New Era of Biological Hazards and Threats looks at how the NZDF supports other agencies’ biodefence activities, and considers the context of ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Approaches to Economic Challenges: Confronting Planetary Emergencies: OECD 9 October 2020
    New Approaches to Economic Challenges: Confronting Planetary Emergencies: OECD 9 October 2020 Hon David Parker’s response following Thomas Piketty and Esther Duflo. Good morning, good afternoon, and good evening, wherever in the world you might be. I first acknowledge the excellent thought provoking speeches of Thomas Piketty and Esther ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Kaipara Moana restoration takes next step
    A Memorandum of Understanding has been signed today at Waihāua Marae between the Crown, local iwi and councils to protect, restore and enhance the mauri of Kaipara Moana in Northland. Environment Minister David Parker signed the document on behalf of the Crown along with representatives from Ngā Maunga Whakahī, Ngāti ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New Zealand and Uruguay unite on reducing livestock production emissions
    Agriculture Minister Damien O’Connor and Uruguayan Minister of Livestock, Agriculture and Fisheries Carlos María Uriarte have welcomed the launch of a three-year project that will underpin sustainable livestock production in Uruguay, Argentina, and Costa Rica.  The project called ‘Innovation for pasture management’ is led by Uruguay’s National Institute of Agricultural ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • 3100 jobs created through marae upgrades
    Hundreds of marae throughout the country will be upgraded through investments from the Provincial Growth Fund’s refocused post COVID-19 funding to create jobs and put money into the pockets of local tradespeople and businesses, Regional Economic Development Minister Shane Jones and Māori Development Minister Nanaia Mahuta have announced. “A total ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Health volunteers recognised in annual awards
    Health Minister Chris Hipkins has announced 9 teams and 14 individuals are the recipients of this year’s Minister of Health Volunteer Awards.  “The health volunteer awards celebrate and recognise the thousands of dedicated health sector volunteers who give many hours of their time to help other New Zealanders,” Mr Hipkins ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Community COVID-19 Fund supports Pacific recovery
    The Minister for Pacific Peoples, Aupito William Sio says a total of 264 groups and individuals have successfully applied for the Pacific Aotearoa Community COVID-19 Recovery Fund, that will support Pacific communities drive their own COVID-19 recovery strategies, initiatives, and actions. “I am keen to see this Fund support Pacific ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Community benefits from Māori apprenticeships
    Up to 50 Māori apprentices in Wellington will receive paid training to build houses for their local communities, thanks to a $2.75 million investment from the Māori Trades and Training Fund, announced Employment Minister Willie Jackson today. “This funding will enable Ngāti Toa Rangatira Incorporated to provide its Ngā Kaimahi ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Training fund supports Māori jobseekers
    Rapidly growing sectors will benefit from a $990,000 Māori Trades and Training Fund investment which will see Wellington jobseekers supported into work, announced Employment Minister Willie Jackson today. “This funding will enable Sapphire Consultants Ltd. to help up to 45 Māori jobseekers into paid training initiatives over two years through ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Ruakura Inland Port development vital infrastructure for Waikato
    The Government is investing $40 million to develop an inland port at Ruakura which will become a freight super-hub and a future business, research and residential development for the Waikato, Urban Development and Transport Minister Phil Twyford, and Māori Development Minister Nanaia Mahuta announced today. The funding has been has ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Appointments made to Defence Expert Review Group
    Defence Minister Ron Mark announced today the establishment of an Expert Review Group to review a number of aspects of the New Zealand Defence Force’s (NZDF) structure, information management and record-keeping processes.  The Expert Review Group’s work arises out of the first recommendation from the Report of the Government’s Inquiry ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • No active community cases of COVID-19
    There are no active community cases of COVID-19 remaining in the country after the last people from the recent outbreak have recovered from the virus, Health Minister Chris Hipkins said today. “This is a big milestone. New Zealanders have once again through their collective actions squashed the virus. The systems ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Clean energy upgrade for more public buildings
    More public buildings will be supported by the Government to upgrade to run on clean energy, the Minister for Climate Change James Shaw announced today. Minister Shaw announced that Lincoln and Auckland universities will receive support through the Clean-Powered Public Service Fund to replace fossil fuel boilers. Southern, Taranaki, and ...
    BeehiveBy beehive.govt.nz
    3 weeks ago
  • Schools back donations scheme for the second year
    More schools have opted in to the donations scheme for 2021, compared to 2020 when the scheme was introduced. “The families of more than 447,000 students will be better off next year, with 94% of eligible schools and kura opting into the scheme,” Education Minister Chris Hipkins said. “This is ...
    BeehiveBy beehive.govt.nz
    3 weeks ago