web analytics

In theory it should be seamless…

Written By: - Date published: 8:15 pm, April 25th, 2011 - 17 comments
Categories: admin, The Standard - Tags:

Shifting the site to a GeoDNS with fallback capabilities this evening*. This involves changing the domain name server addresses again. Now like last time this is meant to be a seamless shift. However that may or may not be the case.

Last time there were some quite ISP’s with interesting ways of interpreting what a time to live meant (10 minutes means ten minutes damnit – not 10 hours). The replicated slave server turned out to have a few interesting issues and essentially failed. So there were some poor souls who were deprived of the site for quite a few hours.

This time, the replication has been running for the last week. I fixed the last few bugs in it last night. The DNS is starting to dynamically flip people to different servers as I write. In theory it should be seamless… If it isn’t then I’ll apologize in advance.

Now is a good time to cook dinner with the iPad in hand to monitor the change.

* In essence this means that when you request thestandard.org.nz, the domain name server will detect where you are asking from, and divert you to the nearest operational server.

For anyone in New Zealand, Australia, and Oceania this means your page comes from Auckland. Everyone else (including most of the spiders and spambots) will come from San Diego and not through the crowded Southern Cross cables. The Auckland server will lose about half of its weekday traffic.

It also means that we can have NZ servers without worrying about nuisance issues. There is now a hot server running offshore running a same operating site with a second or so delay. Either server can run the full site albeit slowly. It is also possible to easily add other lower cost servers hooked into the same system.

17 comments on “In theory it should be seamless… ”

  1. Still pinging at 103ms from here, @ approx 2021NZT.

    Seriously, the spambot kings aren’t even trying any more. “Useful post, thanks, I will bookmark this site” every time?

    I caught one suggesting the RSS was awry… that at least made me stop and read it for a few seconds. If they’re going to plague admins they could at least put the effort in to making it entertaining. Or they could just catch leprosy. Either is good.

    • lprent 1.1

      😈 They do seem rather unimaginative…

      Yeah the current TTL was set at 5 hours so it will take a bit of time to shift over. But googlebot, slurp, baidu and a number of the overseas ISP’s appear to have done so now.

      Yay! Steak preparing time

  2. lprent 2

    Looks good so far. The nice thing is that this should be the last major change to the site before the election.

  3. infused 3

    Round Robbin and TTL of 1 hour does the trick. You set the TTL to 1hr a week before though. DNS servers will sometimes ignore this and refresh when they want to as DNS can create a lot of traffic.

    • lprent 3.1

      I’d noticed that some DNS’es were a bit good at ignoring domain changes regardless what the TTL was.

      The TTL on the new configuration is currently set to 15 minutes. We really don’t need instantaneous fallbacks (yet). I’ll have a look at the DNS queries at the server side after I have a few weekdays to look at. I really don’t want to have millions of DNS lookups due to too short a TTL. Also don’t want to have massively long delays when the system needs to flip.

      But this new configuration appears to be flipping over pretty well with few problems as far as I can see. There is an issue with the timing of changes to robots.txt between the two systems that I will have to sort out. And I still haven’t started the sphinx search indexer for a similar reason. I’ll probably have to write some plugin excluders based on the system along with some .htaccess. But that can wait for the system to settle so I can see the traffic issues.

      In the meantime it is back to some nice clean c++ coding tomorrow. Doing system work is somewhat boring….

  4. BLiP 4

    As an end-user can I just say: never mind the obfuscating tech-whizz kid gobbledeegook, where’s the search function??? ; )

    • lprent 4.1

      I will attempt to turn it back on tonight. It is slightly complicated when the search is on two machines

      • BLiP 4.1.1

        No rush, mate. I did get used to it when it was working but using Google is okay as well Take your time and get it right at your end, please. Thanks for all you do.

  5. rosy 5

    Hi Lprent
    I’m  not sure if you know of any issues on the overseas server so thought I should mention….
    I’m having trouble posting, with the same issue Carol mentioned of the anti-spam not being accepted, but also:
    – Some pics won’t display – like today’s caption contest I can’t see at all
    – Sometimes the formatting functions won’t work (intermittent and possibly related to:
    – loading and editing is really slow – up to 5 minutes and then I’ve deleted the comment (by using delete, refresh and exiting the site because just deleting takes minutes as well).

    • rosy 5.1

      hah – anti-spam worked with that comment, but comment editor still broken – quicker to write a new comment than to edit the one above.

      • lprent 5.1.1

        Interesting. Looking at your location it appears that it is 325ms ping from the NZ server to there, and only 161ms from the US server to there (and 169ms from my home system in NZ to the west coast US server). You shouldn’t be getting much difference in terms of latency. The US server is probably superior in terms of shifting data.

        But the logs do show a lot more heavy CPU spikes on the US server compared to the NZ. It is those bloody bots.

        The anti-spam issue should be fixed now – dropped the javascript editor for the moment which was where the problem was coming from.. Try that.

        If you’re confident about your terminal / console /editor skills on the ? Mac ? then add the following line to the /etc/hosts file (in windows it is c:\windows\system32\drivers\etc\hosts for a 32bit system) (in mac/linux you need to sudo the editor to be able to save the file)

        120.138.23.92 thestandard.org.nz

        That will flip you to using the NZ server regardless of what the DNS says. Remove it to revert. But I suspect you’ll find that it is worse not better. It looks to me like a large chunk is just bad links between you and the server today.

        • rosy 5.1.1.1

          Yay! I have pictures. I’ll leave that IP address line in and change it back if anything goes wrong. I’ll let you know if that’s the case. Thanks heaps 🙂

    • lprent 5.2

      Ok. I will have to test it out. There are delays whilst the images get copied from one server to another, but they’re not meant to be more than a few minutes.

      The anti-spam is generated on that server. So that sounds like a loading problem. 

      I did do all of the testing for those things and it was a bit sluggish when posting comments – mostly because it was updating a remote database. But It looks like I’ll need to test when the system is under load.

      • Carol 5.2.1

        Thanks for all the work you’re putting into this, as I realise changing servers can be a major headache.

  6. lprent 6

    Dual servers is affecting

    1. The re-edit functionality. This looks like it is working correctly for people in NZ / aussie and failing for everyone elsewhere. I just ordered a extra license which will hopefully fix it it.

    2. The ipad/iphone functionality is probably OK from my testing. I just ordered a extra licenses.

    3. The comment save speed is pretty poor on the US server. Working on that.

    4. The images from new posts don’t come through fast enough. Authors scheduling those at least 15 minutes in advance would be a simple fix. But a more paranoid push strategy would help as well. Need to save in n places or on a separate web server (which is what wordpress.com appear to do).

  7. Will we get the options to put in links etc again ? these options are gone now.

Recent Comments

Recent Posts

  • Building back better
    It’s a three-week recess in Parliament – so, no bills are going through the House and no select committees are meeting. But the hard work of our ministers continues, and many of our MPs are back in their electorates, taking the opportunity to meet with local communities and businesses about ...
    3 days ago
  • Greens call for a Warrant of Fitness for rental homes
    The Green Party is launching a petition today calling on the Government’s Healthy Homes Standards to be backed up with a proper Warrant of Fitness (WoF) for rental homes. ...
    6 days ago
  • Securing our recovery: By the numbers
    Our plan to secure New Zealand’s recovery from COVID-19 is working, with the past three months seeing the second-highest number of people moved off a main benefit into work since records began. ...
    2 weeks ago
  • More Kiwis in work through recovery plan
    The latest statistics show the Government’s focus on jobs is working. The net number of people on a main benefit dropped by around 11,190 people during the past three months, with around 31,240 people moving off a benefit into work. ...
    2 weeks ago
  • Green Party appoints new Chief of Staff
    The Green Party has appointed a new Parliamentary Chief of Staff, Robin Campbell. ...
    2 weeks ago
  • We’re turning 105!
    It’s our birthday! Today, 105 years ago, the New Zealand Labour Party was founded. And we haven’t stopped moving since: fighting for workers’ rights, expanding protections to boost equality, and upholding democratic socialist ideals. We’re now the oldest political party in New Zealand and, as we celebrate our 105 years, ...
    3 weeks ago
  • Principles for guiding the Emissions Reduction Plan Speech
    Tēnā koutou, tēnā koutou, tēnā koutou katoa. ...
    3 weeks ago

  • New station a platform for AirportLink to take off
    Every Aucklander with access to the rail network will now have a quick and convenient trip to the airport, Transport Minister Michael Wood and Auckland Mayor Phil Goff said during the official opening of the new Puhinui Interchange today. The new interchange links the rail platform with a new bus ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • 10 days sick leave for employees delivered
    Legislation doubling employees’ minimum sick leave entitlement to 10 days comes into effect today, bringing benefits to both businesses and employees, Workplace Relations and Safety Minister Michael Wood announced today. “Our Government is delivering on a key manifesto commitment to help Kiwis and workplaces stay healthy,” Michael Wood said. “COVID-19 ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Prime Minister congratulates Fiame Naomi Mata’afa on Election Win
    Prime Minister Jacinda Ardern tonight congratulated Prime Minister-elect Fiame Naomi Mata’afa on her victory in the Samoa’s general election. “New Zealand has a special relationship with Samoa, anchored in the Treaty of Friendship. We look forward to working with Samoa’s new government in the spirit of partnership that characterises this ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Quarantine Free Travel with Australia suspended
    Quarantine Free Travel from all Australian states and territories to New Zealand is being suspended as the Covid situation there worsens, Prime Minister Jacinda Ardern and COVID-19 Response Minister Chris Hipkins announced today. From 11.59pm today Australians will no longer be able to enter New Zealand quarantine-free. This will be ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Growing conservation efforts in Gisborne
    A big injection of Jobs for Nature funding will create much-needed jobs and financial security for families in TeTairāwhiti, and has exciting prospects for conservation in the region, Conservation Minister Kiri Allan says. “The projects target local communities most affected by the economic consequences of COVID 19 and are designed ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Flood recovery given further assistance
    The Government is contributing a further $1 million to help the flood battered Buller community, Acting Emergency Management Minister Kris Faafoi announced today. “Buller is a small community which has found itself suddenly facing significant and ongoing welfare costs. While many emergency welfare costs are reimbursed by Government, this money ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Funding for five projects to reduce food waste
    The Government is funding five projects to help address the growing problem of food waste, Environment Minister David Parker announced today. “New Zealand households throw away nearly 300,000 tonnes of food every year, half of which could still be eaten. By supporting these initiatives, we’re taking steps to reduce this ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Temporary Accommodation Service activated for West Coast flooding event
    The Temporary Accommodation Service (TAS) has been activated today - meaning residents on the West Coast of the South Island and in the Marlborough region hit by flooding over the weekend can now access help finding temporary accommodation, announced Associate Minister of Housing (Public Housing) Poto Williams in Westport today. ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Pause to Quarantine Free Travel from South Australia to New Zealand
    Quarantine Free Travel from South Australia to New Zealand will be paused from 11.59am (NZT) tonight, COVID-19 Response Minister Chris Hipkins has announced. However, people currently in the state who ordinarily live in New Zealand will be able to return on “managed return” flights starting with the next available flight, ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • New Zealand condemns malicious cyber activity by Chinese state-sponsored actors
    New Zealand has established links between Chinese state-sponsored actors known as Advanced Persistent Threat 40 (APT40) and malicious cyber activity in New Zealand. “The GCSB has worked through a robust technical attribution process in relation to this activity. New Zealand is today joining other countries in strongly condemning this malicious ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Remarks to Diplomatic Corps
    It is a pleasure to be with you all this evening. Some of you may have been surprised when you received an invitation from the Minister of Disarmament and Arms Control, and I would forgive you if you were. New Zealand is unique in having established a Ministerial portfolio ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Early Pfizer shipment boosts vaccine schedule
    The largest shipment of the Pfizer vaccine to date has arrived into New Zealand two days ahead of schedule, and doses are already being delivered to vaccination centres around the country, COVID-19 Response Minister Chris Hipkins says. “The shipment of more than 370,000 doses reached New Zealand yesterday, following a ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Backing for Bay of Islands predator free effort
    The Government is throwing its support behind an ambitious project to restore native biodiversity and build long-term conservation careers, Conservation Minister Kiri Allan says. Predator Free Bay of Islands aims to eradicate predators from the three main peninsulas in the region, and significantly reduce their impact throughout the wider 80,000-plus ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Government commits $600,000 to flood recovery
    The Government is contributing $600,000 to help residents affected by the weekend’s violent weather with recovery efforts. Acting Minister for Emergency Management Kris Faafoi and Agriculture Minister Damien O’Connor have been in the Buller district this afternoon to assess flood damage and support the local response effort. They have announced ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Government assisting local responses to heavy rainfall and high wind
    Acting Minister of Emergency Management Kris Faafoi says Central Government is monitoring the severe weather across the country, and is ready to provide further support to those affected if necessary. “My thoughts are with everyone who has been affected by this latest event, particularly communities on the West Coast and ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • PM Ardern chairs APEC Leaders’ meeting on COVID-19
    New Zealand Prime Minister Jacinda Ardern has chaired a meeting of Leaders representing the 21 APEC economies overnight. “For the first time in APEC’s history Leaders have come together for an extraordinary meeting focused exclusively on COVID-19, and how our region can navigate out of the worst health and economic ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Health Minister welcomes progress on nurses’ pay
    The New Zealand Nurses Organisation’s decision to take the Government’s improved pay offer to members and to lift strike notices is a positive move towards settling district health board nurses’ pay claims, Health Minister Andrew Little said. “It’s encouraging that the discussions between NZNO and DHBs over the nurses’ employment ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Boost for Pacific regional business
    Pacific businesses will get a much-needed financial boost as they recover from the effects of the COVID-19 pandemic thanks to the new Pacific Aotearoa Regional Enterprise Fund, said Minister for Pacific Peoples Aupito William Sio.  The new $2 million fund will co-invest in Pacific business projects and initiatives to create ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • PM Ardern call with President Biden
    Prime Minister Jacinda Ardern spoke with US President Biden this morning, ahead of the APEC Informal Leaders’ Retreat on COVID-19. “President Biden and I discussed the forthcoming APEC leaders meeting and the critical importance of working together as a region to navigate out of the COVID-19 pandemic”, Jacinda Ardern said. ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Renewed partnership creates jobs for New Zealand youth
    The Government has signed a new memorandum of understanding (MoU) with the Mayors Taskforce for Jobs, strengthening the partnership to get more young people into work.  The Mayors Taskforce for Jobs (MTFJ) is a nationwide network of all Mayors in New Zealand, who are committed to making sure all young ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • South Island areas prioritised in tourism fund
    Five South Island areas are prioritised in the latest round of decisions from a tourism fund that is supporting infrastructure projects from Cape Reinga to Stewart Island and the Chathams. Tourism Minister Stuart Nash has announced details of 57 nationwide projects to receive support from the Tourism Infrastructure Fund (TIF). ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New code sets clear expectations for learner safety and wellbeing in tertiary education
    A new code of practice for the pastoral care of domestic tertiary and international students will be in place from January next year, Education Minister Chris Hipkins announced today The code, which makes clear that creating an environment that supports learning and wellbeing is a shared responsibility between tertiary providers, ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • First TAB New Zealand Board appointments announced
    The members of the first TAB NZ Board come with experience in racing and sport administration, business and governance, the betting industry, broadcasting and gambling harm minimisation. “This Board will progress from the excellent work done by the interim board, put in place in August 2020,” Grant Robertson said. “The ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Northland Maori Pathways initiative introduced
    The Government has today launched Māori Pathways at Northland Region Corrections Facility, a ground-breaking series of initiatives designed in partnership with Māori to reduce re-offending and improve outcomes for whānau. A key part of the Hōkai Rangi strategy, Māori Pathways looks to achieve long-term change and involves a number of ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Extended Essential Skills visas being rolled out
    Two year Essential Skills visa to provide certainty to at least 18,000 visa holders Streamlined application process to benefit at least 57,000 visa holders The Government is increasing the duration of some Essential Skills visas and streamlining the application process to provide more certainty to employers and visa holders while ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Pause to Quarantine Free Travel from Victoria to New Zealand
    Quarantine Free Travel from Victoria to New Zealand will be paused from 1.59am (NZT) Friday, COVID-19 Response Minister Chris Hipkins has announced. The decision follows updated public health advice from New Zealand officials and a growing number of cases and locations of interest. The pause will run for at least ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Hydrogen arrangement signed with Singapore
    The signing of an Arrangement of Cooperation on low-carbon hydrogen with Singapore heralds the start of greater collaboration between it and New Zealand as both countries transition towards low carbon economies, says Energy and Resources Minister Megan Woods. The cooperation arrangement between New Zealand’s Ministry of Business, Innovation and Employment ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Hydrogen agreement signed with Singapore
    The signing of a Memorandum of Cooperation on low-carbon hydrogen with Singapore signals the start of greater collaboration between the two countries as they transition towards low carbon economies, says Energy and Resources Minister Dr Megan Woods. The cooperation agreement between New Zealand’s Ministry of Business, Innovation and Employment and ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Speech to LGNZ Conference
    Kia ora koutou katoa and thank-you for the invitation to speak to you all today. I would like to acknowledge Local Government New Zealand President Stuart Crosby, and Chief Executive, Susan Freeman-Greene, Te Maruata Chair, Bonita Bigham, and our host, Mayor John Leggett. I also acknowledge all the elected members ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Government to provide support for water reforms, jobs and growth
    The Government today announced a $2.5 billion package to support local government transition through the reforms to New Zealand’s drinking water, wastewater and stormwater services. The package will also stimulate local economies while creating jobs and unlocking infrastructure for housing. “New Zealand’s water systems are facing a significant crisis and ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Government Initiatives Contribute to Fall in Benefit Numbers
    Minister for Social Development Carmel Sepuloni has welcomed the release of the June quarter Benefit Statistics which show a continuing fall in the number of people receiving a Main Benefit. “This Government’s plan to increase work focused support for Jobseekers is paying off,” Carmel Sepuloni said. “All up Benefit numbers ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Tourism support package continues rollout
    Mental wellbeing support is being rolled out to five South Island communities most affected by the absence of international tourists. Tourism Minister Stuart Nash today announced details of how tourism operators and communities can access the help announced in May as part of the government’s $200 million Tourism Communities: Support, ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • NZ-PNG Sign Statement of Partnership
    New Zealand’s Prime Minister Jacinda Ardern and Papua New Guinea’s Prime Minister James Marape signed the first ever New Zealand - Papua New Guinea Statement of Partnership today. “This new Statement of Partnership reflects the importance we place on the close economic, cultural and people-to-people links our two countries have ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Further advice being sought on new cases in Victoria
    Further advice is being sought from public health officials following seven new positive cases of COVID-19 in Victoria today, COVID-19 Response Minister Chris Hipkins says. “There are also a growing number of locations of interest that are of concern, including a sports stadium on Saturday and several pubs,” Chris Hipkins ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Christchurch Learning Community Hubs supporting ethnic families
    As part of the Government’s ongoing commitment to working with the victims and those affected by the March 15 terror attacks, today Associate Minister of Education Hon Jan Tinetti released the report ‘Voices from the Ōtautahi’ on the Christchurch Learning Community Hubs. “It’s so important we continue to support the ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Hundreds more hands funded to work for nature
    Supporting biodiversity protection through community-led projects and on private property will create at least 500 more jobs under the Mahi mō te Taiao/Jobs for Nature programme, Minister of Conservation Kiritapu Allan announced today. “The work we are funding includes everything from pest control and restoration planting to plant propagation, skill ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Saliva testing expansion for frontline border workers
    All frontline border workers who are required to be regularly tested for COVID-19 will soon be able to choose regular saliva testing as a full replacement for nasopharyngeal testing, COVID-19 Response Minister Chris Hipkins has announced. Saliva testing will be expanded as an option for all those on a regular ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Government consults on freshwater farm plan
    The Government is inviting farmers and growers to provide their practical ideas to help develop high-quality and workable freshwater farm plans, in line with its freshwater goals said Agriculture Minister Damien O’Connor and Environment Minister David Parker. The ministers today released the consultation documents for freshwater farm plans and stock exclusion low slope maps. Comment is being sought on a new, more ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Increased support for midwives
    New measures to help bolster the midwifery workforce as they care for the next generation of New Zealanders, have been announced today by Associate Minister of Health Dr Ayesha Verrall. “New Zealand’s midwives are committed to the wellbeing of women and whānau, but they’re facing significant challenges. The DHB midwifery ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Prime Minister's Speech to NZIIA Annual Conference
    Ladies and gentlemen, distinguished guests, ata mārie, tēnā koutou katoa. It’s a great pleasure to attend an event on such an important topic as New Zealand’s future in the Indo-Pacific region. Thank you to the New Zealand Institute of International Affairs for bringing this hui together. I am encouraged to ...
    BeehiveBy beehive.govt.nz
    2 weeks ago