web analytics

In theory it should be seamless…

Written By: - Date published: 8:15 pm, April 25th, 2011 - 17 comments
Categories: admin, The Standard - Tags:

Shifting the site to a GeoDNS with fallback capabilities this evening*. This involves changing the domain name server addresses again. Now like last time this is meant to be a seamless shift. However that may or may not be the case.

Last time there were some quite ISP’s with interesting ways of interpreting what a time to live meant (10 minutes means ten minutes damnit – not 10 hours). The replicated slave server turned out to have a few interesting issues and essentially failed. So there were some poor souls who were deprived of the site for quite a few hours.

This time, the replication has been running for the last week. I fixed the last few bugs in it last night. The DNS is starting to dynamically flip people to different servers as I write. In theory it should be seamless… If it isn’t then I’ll apologize in advance.

Now is a good time to cook dinner with the iPad in hand to monitor the change.

* In essence this means that when you request thestandard.org.nz, the domain name server will detect where you are asking from, and divert you to the nearest operational server.

For anyone in New Zealand, Australia, and Oceania this means your page comes from Auckland. Everyone else (including most of the spiders and spambots) will come from San Diego and not through the crowded Southern Cross cables. The Auckland server will lose about half of its weekday traffic.

It also means that we can have NZ servers without worrying about nuisance issues. There is now a hot server running offshore running a same operating site with a second or so delay. Either server can run the full site albeit slowly. It is also possible to easily add other lower cost servers hooked into the same system.

17 comments on “In theory it should be seamless… ”

  1. Still pinging at 103ms from here, @ approx 2021NZT.

    Seriously, the spambot kings aren’t even trying any more. “Useful post, thanks, I will bookmark this site” every time?

    I caught one suggesting the RSS was awry… that at least made me stop and read it for a few seconds. If they’re going to plague admins they could at least put the effort in to making it entertaining. Or they could just catch leprosy. Either is good.

    • lprent 1.1

      😈 They do seem rather unimaginative…

      Yeah the current TTL was set at 5 hours so it will take a bit of time to shift over. But googlebot, slurp, baidu and a number of the overseas ISP’s appear to have done so now.

      Yay! Steak preparing time

  2. lprent 2

    Looks good so far. The nice thing is that this should be the last major change to the site before the election.

  3. infused 3

    Round Robbin and TTL of 1 hour does the trick. You set the TTL to 1hr a week before though. DNS servers will sometimes ignore this and refresh when they want to as DNS can create a lot of traffic.

    • lprent 3.1

      I’d noticed that some DNS’es were a bit good at ignoring domain changes regardless what the TTL was.

      The TTL on the new configuration is currently set to 15 minutes. We really don’t need instantaneous fallbacks (yet). I’ll have a look at the DNS queries at the server side after I have a few weekdays to look at. I really don’t want to have millions of DNS lookups due to too short a TTL. Also don’t want to have massively long delays when the system needs to flip.

      But this new configuration appears to be flipping over pretty well with few problems as far as I can see. There is an issue with the timing of changes to robots.txt between the two systems that I will have to sort out. And I still haven’t started the sphinx search indexer for a similar reason. I’ll probably have to write some plugin excluders based on the system along with some .htaccess. But that can wait for the system to settle so I can see the traffic issues.

      In the meantime it is back to some nice clean c++ coding tomorrow. Doing system work is somewhat boring….

  4. BLiP 4

    As an end-user can I just say: never mind the obfuscating tech-whizz kid gobbledeegook, where’s the search function??? ; )

    • lprent 4.1

      I will attempt to turn it back on tonight. It is slightly complicated when the search is on two machines

      • BLiP 4.1.1

        No rush, mate. I did get used to it when it was working but using Google is okay as well Take your time and get it right at your end, please. Thanks for all you do.

  5. rosy 5

    Hi Lprent
    I’m  not sure if you know of any issues on the overseas server so thought I should mention….
    I’m having trouble posting, with the same issue Carol mentioned of the anti-spam not being accepted, but also:
    – Some pics won’t display – like today’s caption contest I can’t see at all
    – Sometimes the formatting functions won’t work (intermittent and possibly related to:
    – loading and editing is really slow – up to 5 minutes and then I’ve deleted the comment (by using delete, refresh and exiting the site because just deleting takes minutes as well).

    • rosy 5.1

      hah – anti-spam worked with that comment, but comment editor still broken – quicker to write a new comment than to edit the one above.

      • lprent 5.1.1

        Interesting. Looking at your location it appears that it is 325ms ping from the NZ server to there, and only 161ms from the US server to there (and 169ms from my home system in NZ to the west coast US server). You shouldn’t be getting much difference in terms of latency. The US server is probably superior in terms of shifting data.

        But the logs do show a lot more heavy CPU spikes on the US server compared to the NZ. It is those bloody bots.

        The anti-spam issue should be fixed now – dropped the javascript editor for the moment which was where the problem was coming from.. Try that.

        If you’re confident about your terminal / console /editor skills on the ? Mac ? then add the following line to the /etc/hosts file (in windows it is c:\windows\system32\drivers\etc\hosts for a 32bit system) (in mac/linux you need to sudo the editor to be able to save the file)

        120.138.23.92 thestandard.org.nz

        That will flip you to using the NZ server regardless of what the DNS says. Remove it to revert. But I suspect you’ll find that it is worse not better. It looks to me like a large chunk is just bad links between you and the server today.

        • rosy 5.1.1.1

          Yay! I have pictures. I’ll leave that IP address line in and change it back if anything goes wrong. I’ll let you know if that’s the case. Thanks heaps 🙂

    • lprent 5.2

      Ok. I will have to test it out. There are delays whilst the images get copied from one server to another, but they’re not meant to be more than a few minutes.

      The anti-spam is generated on that server. So that sounds like a loading problem. 

      I did do all of the testing for those things and it was a bit sluggish when posting comments – mostly because it was updating a remote database. But It looks like I’ll need to test when the system is under load.

      • Carol 5.2.1

        Thanks for all the work you’re putting into this, as I realise changing servers can be a major headache.

  6. lprent 6

    Dual servers is affecting

    1. The re-edit functionality. This looks like it is working correctly for people in NZ / aussie and failing for everyone elsewhere. I just ordered a extra license which will hopefully fix it it.

    2. The ipad/iphone functionality is probably OK from my testing. I just ordered a extra licenses.

    3. The comment save speed is pretty poor on the US server. Working on that.

    4. The images from new posts don’t come through fast enough. Authors scheduling those at least 15 minutes in advance would be a simple fix. But a more paranoid push strategy would help as well. Need to save in n places or on a separate web server (which is what wordpress.com appear to do).

  7. Will we get the options to put in links etc again ? these options are gone now.

Recent Comments

Recent Posts

  • Keynote address to Chartered Accountants Australia and New Zealand conference
    Speech to the CAANZ conference - November 19, 2020 Thank you, Greg, (Greg Haddon, MC) for the welcome. I’d like to acknowledge John Cuthbertson from CAANZ, the Commissioner of Inland Revenue Naomi Ferguson, former fellow MP and former Minister of Revenue, Peter Dunne, other guest speakers and CAANZ members. I ...
    BeehiveBy beehive.govt.nz
    7 hours ago
  • Expert independent advisory group appointed to strengthen the future of Māori broadcasting
    A panel of seven experts are adding their support to help shape the future of Māori broadcasting, Minister for Māori Development Willie Jackson has announced today. “Today I will meet with some of the most experienced Māori broadcasters, commentators and practitioners in the field. They have practical insights on the ...
    BeehiveBy beehive.govt.nz
    13 hours ago
  • Government to review housing settings
    New Zealand’s stronger-than-expected economic performance has flowed through to housing demand, so the Government will review housing settings to improve access to the market, the Finance Minister Grant Robertson announced today. “Our focus is on improving access to the housing market for first home buyers and ensuring house price growth ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Crown accounts reflect Govt’s careful economic management
    The better-than-expected Crown accounts released today show the Government’s careful management of the COVID-19 health crisis was the right approach to support the economy. As expected, the Crown accounts for the year to June 2020 show the operating balance before gains and losses, or OBEGAL, was in deficit. However that ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Community launch marks next step in addressing racism in education
    The launch of Te Hurihanganui in Porirua today is another important milestone in the work needed to address racism in the education system and improve outcomes for Māori learners and their whānau, Associate Education Minister Kelvin Davis says. Budget 2019 included $42 million over three years to put Te Hurihanganui ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Government to consider recommendations on DNA use in criminal investigations
    The Minister of Justice has received the Law Commission’s recommending changes to the law governing the way DNA is used in criminal investigations. The report, called The Use of DNA in Criminal Investigations – Te Whahamahi I te Ira Tangata I ngā Mātai Taihara, recommends new legislation to address how ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Speech to Wakatū Nelson regional hui on trade
    First, I want to express my thanks to Te Taumata for this hui and for all the fantastic work you are doing for Māori in the trade space. In the short time that you’ve been operating you’ve already contributed an enormous amount to the conversation, and developed impressive networks.  I ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Speech to Primary Industries Summit
    Thank you for the opportunity to speak to you today about the significant contribution the food and fibres sector makes to New Zealand and how this Government is supporting that effort. I’d like to start by acknowledging our co-Chairs, Terry Copeland and Mavis Mullins, my colleague, Agriculture Minister Damien O’Connor, ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Fast track referrals will speed up recovery and boost jobs and home building
    The Government is taking action to increase jobs, speed up the economic recovery and build houses by putting three more projects through its fast track approval process. “It’s great to see that the fast-track consenting process is working. Today we have referred a mix of potential projects that, if approved, ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Papakāinga provides critically needed homes in Hastings
    A papakāinga opened today by the Minister for Māori Development the Hon Willie Jackson will provide whānau with much needed affordable rental homes in Hastings. The four home papakāinga in Waiōhiki is the first project to be completed under the ‘Hastings Place Based’ initiative. This initiative is a Government, Hastings ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • New Zealand ready to host APEC virtually
    Prime Minister Jacinda Ardern took over the leadership of APEC earlier today, when she joined leaders from the 21 APEC economies virtually for the forum’s final 2020 meeting. “We look forward to hosting a fully virtual APEC 2021 next year. While this isn’t an in-person meeting, it will be one ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Revival of Māori Horticulturists
    The rapid revival of Māori horticulture was unmistakeable at this year’s Ahuwhenua Trophy Awards, with 2020 marking the first time this iconic Māori farming event was dedicated to horticulture enterprises. Congratulating finalists at the Awards, Māori Development Minister Willie Jackson said growing large-scale māra kai is part of Māori DNA. ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Emergency benefit to help temporary visa holders
    From 1 December, people on temporary work, student or visitor visas who can’t return home and or support themselves may get an Emergency Benefit from the Ministry of Social Development, Social Development and Employment Minister Carmel Sepuloni announced today. Previously, temporary visa holders in hardship because of COVID-19 have had ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • School sustainability projects to help boost regional economies
    Forty one schools from the Far North to Southland will receive funding for projects that will reduce schools’ emissions and save them money, Education Minister Chris Hipkins announced today. This is the second round of the Sustainability Contestable Fund, and work will begin immediately. The first round announced in April ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Farmer-led projects to improve water health in Canterbury and Otago
    More than $6 million will be spent on helping farmers improve the health of rivers, wetlands, and habitat biodiversity in Canterbury and Otago, as well as improving long-term land management practices, says Agriculture Minister Damien O’Connor. Four farmer-led catchment group Jobs for Nature projects have between allocated between $176,000 and ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Tupu Aotearoa continues expansion to Pacific communities in Nelson, Marlborough, Tasman & Northl...
    Pacific communities in Nelson, Marlborough, Tasman and Northland will benefit from the expansion of the Tupu Aotearoa programme announced today by the Minister for Pacific Peoples, Aupito William Sio. The programme provides sustainable employment and education pathways and will be delivered in partnership with three providers in Northland and two ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • New primary school and classrooms for 1,200 students in South Island
    Education Minister Chris Hipkins unveiled major school building projects across the South Island during a visit to Waimea College in Nelson today. It’s part of the Government’s latest investment of $164 million to build new classrooms and upgrade schools around the country. “Investments like this gives the construction industry certainty ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Minister of Māori Development pays tribute to Rudy Taylor
      Today the Minister of Māori Development, alongside other Government Ministers and MP’s said their final farewells to Nga Puhi Leader Rudy Taylor.  “Rudy dedicated his life to the betterment of Māori, and his strong approach was always from the ground up, grassroots, sincere and unfaltering”  “Over the past few ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Prime Minister to attend APEC Leaders’ Summit
    Prime Minister Jacinda Ardern will attend the annual APEC Economic Leaders’ Meeting and associated events virtually today and tomorrow. “In a world where we cannot travel due to COVID-19, continuing close collaboration with our regional partners is key to accelerating New Zealand’s economic recovery,” Jacinda Ardern said. “There is wide ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Speech to Infrastructure NZ Symposium
    Tena Koutou, Tena Koutou and thank you for inviting me to speak to you today. This is a critical time for New Zealand as we respond to the damage wreaked by the global COVID-19 pandemic. It is vital that investment in our economic recovery is well thought through, and makes ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Pike River 10 Year Anniversary Commemorative Service
    Tēnei te mihi ki a tātau katoa e huihui nei i tēnei rā Ki a koutou ngā whānau o te hunga kua riro i kōnei – he mihi aroha ki a koutou Ki te hapori whānui – tēnā koutou Ki ngā tāngata whenua – tēnā koutou Ki ngā mate, e ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Huge investment in new and upgraded classrooms to boost construction jobs
    Around 7,500 students are set to benefit from the Government’s latest investment of $164 million to build new classrooms and upgrade schools around the country. “The election delivered a clear mandate to accelerate our economic recovery and build back better. That’s why we are prioritising construction projects in schools so more ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Keeping Pike River Mine promises 10 years on
    Ten years after the Pike River Mine tragedy in which 29 men lost their lives while at work, a commemorative service at Parliament has honoured them and their legacy of ensuring all New Zealand workplaces are safe. Prime Minister Jacinda Ardern attended the event, along with representatives of the Pike ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Additional testing to strengthen border and increase safety of workers
    New testing measures are being put in place to increase the safety of border workers and further strengthen New Zealand’s barriers against COVID-19, COVID-19 Response Minister Chris Hipkins said today. “These strengthened rules – to apply to all international airports and ports – build on the mandatory testing orders we’ve ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • More public housing delivered in Auckland
    The Government’s investment in public housing is delivering more warm, dry homes with today’s official opening of 82 new apartments in New Lynn by the Housing Minister Megan Woods. The Thom Street development replaces 16 houses built in the 1940s, with brand new fit-for-purpose public housing that is in high ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Agreement advanced to purchase up to 5 million COVID-19 vaccines
    The Government has confirmed an in-principle agreement to purchase up to 5 million COVID-19 vaccines – enough for 5 million people – from Janssen Pharmaceutica, subject to the vaccine successfully completing clinical trials and passing regulatory approvals in New Zealand, says Research, Science and Innovation Minister Megan Woods. “This agreement ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Jobs for Nature funding will leave a conservation legacy for Waikanae awa
    Ninety-two jobs will be created to help environmental restoration in the Waikanae River catchment through $8.5 million of Jobs for Nature funding, Conservation Minister Kiritapu Allan announced today. “The new funding will give a four-year boost to the restoration of the Waikanae awa, and is specifically focussed on restoration through ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • New Dunedin Hospital project progresses to next stage
    As the new Dunedin Hospital project progresses, the Government is changing the oversight group to provide more technical input, ensure continued local representation, and to make sure lessons learnt from Dunedin benefit other health infrastructure projects around the country. Concept design approval and the release of a tender for early ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Jump in apprentice and trainee numbers
    The number of New Zealanders taking up apprenticeships has increased nearly 50 percent, and the number of female apprentices has more than doubled. This comes as a Government campaign to raise the profile of vocational education and training (VET) begins. Prime Minister Jacinda Ardern and Education Minister Chris Hipkins announced ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • ReBuilding Nations Symposium 2020 (Infrastructure NZ Conference opening session)
    Tena koutou katoa and thank you for the opportunity to be with you today. Can I acknowledge Ngarimu Blair, Ngati Whatua, and Mayor Phil Goff for the welcome. Before I start with my substantive comments, I do want to acknowledge the hard work it has taken by everyone to ensure ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New Zealand's biosecurity champions honoured
    Biosecurity Minister Damien O’Connor has paid tribute to the winners of the 2020 New Zealand Biosecurity Awards. “These are the people and organisations who go above and beyond to protect Aotearoa from pests and disease to ensure our unique way of life is sustained for future generations,” Damien O’Connor says. ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Tourism Industry Aotearoa Conference
    speech to Tourism Industry Aotearoa annual summit Te Papa,  Wellington Introduction Nau mai, haere mai Tēnā koutou, tēnā koutou, Ka nui te mihi, ki a koutou. Thank you Tourism Industry Aotearoa for hosting today’s Summit. In particular, my acknowledgements to TIA Chair Gráinne Troute and Chief Executive Chris Roberts. You ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Supermarkets announced as Government’s second market study
    The Government has today launched a market study to ensure New Zealanders are paying a fair price for groceries.   “Supermarkets are an integral part of our communities and economy, so it’s important to ensure that Kiwis are getting a fair deal at the checkout,” Minister of Commerce and Consumer ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Masks to be worn on Auckland public transport and all domestic flights
    Masks will need to be worn on all public transport in Auckland and in and out of Auckland and on domestic flights throughout the country from this Thursday, Minister for COVID-19 Response Chris Hipkins said today. “I will be issuing an Order under the COVID-19 Response Act requiring the wearing ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New Zealand signs Regional Comprehensive Economic Partnership
    Increase to New Zealand’s GDP by around $2 billion each year Increase opportunities for NZ exporters to access regional markets Cuts red tape and offers one set of trade rules across the Asia Pacific region New government procurement, competition policy and electronic commerce offers NZ exporters increased business opportunities Prime ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Minister acknowledges students as exams begin
    Education Minister Chris Hipkins has recognised the extraordinary challenges students have faced this year, ahead of NCEA and New Zealand Scholarship exams which begin on Monday. “I want to congratulate students for their hard work during a year of unprecedented disruption, and I wish students all the best as ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Prime Minister meets with key ASEAN and East Asia Summit partners
    Prime Minister Jacinda Ardern today attended the ASEAN-New Zealand Commemorative Summit and discussed with Leaders a range of shared challenges facing the Indo-Pacific region, including: The ongoing management of the COVID-19 pandemic; The importance of working collectively to accelerate economic recovery; and Exploring further opportunities for partners to work more ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Veterans Affairs Summit held in Korea
    A Ministerial Summit on Veterans’ Affairs was held in the Republic of Korea this week. Ministers with veteran responsibilities were invited from all 22 countries that had been part of the United Nations Forces during the Korean War (1950 – 1953). The Summit marked the 70th anniversary of the outbreak ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Clear direction set for the education system, skills prioritised
    The Government has released a set of priorities for early learning through to tertiary education and lifelong learning to build a stronger, fairer education system that delivers for all New Zealanders. “The election delivered a clear mandate from New Zealanders to accelerate our plan to reduce inequalities and make more ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • A Progressive Agenda
    Speech to the Climate Change + Business Conference, November 12, 2020 Tena koutou katoa Thank you for inviting me to speak here today. It is great to see us all come together for a common cause: to redefine our future in the face of unprecedented times.  Covid-19 and climate change are ...
    BeehiveBy beehive.govt.nz
    2 weeks ago