In theory it should be seamless…

Written By: - Date published: 8:15 pm, April 25th, 2011 - 17 comments
Categories: admin, The Standard - Tags:

Shifting the site to a GeoDNS with fallback capabilities this evening*. This involves changing the domain name server addresses again. Now like last time this is meant to be a seamless shift. However that may or may not be the case.

Last time there were some quite ISP’s with interesting ways of interpreting what a time to live meant (10 minutes means ten minutes damnit – not 10 hours). The replicated slave server turned out to have a few interesting issues and essentially failed. So there were some poor souls who were deprived of the site for quite a few hours.

This time, the replication has been running for the last week. I fixed the last few bugs in it last night. The DNS is starting to dynamically flip people to different servers as I write. In theory it should be seamless… If it isn’t then I’ll apologize in advance.

Now is a good time to cook dinner with the iPad in hand to monitor the change.

* In essence this means that when you request thestandard.org.nz, the domain name server will detect where you are asking from, and divert you to the nearest operational server.

For anyone in New Zealand, Australia, and Oceania this means your page comes from Auckland. Everyone else (including most of the spiders and spambots) will come from San Diego and not through the crowded Southern Cross cables. The Auckland server will lose about half of its weekday traffic.

It also means that we can have NZ servers without worrying about nuisance issues. There is now a hot server running offshore running a same operating site with a second or so delay. Either server can run the full site albeit slowly. It is also possible to easily add other lower cost servers hooked into the same system.

17 comments on “In theory it should be seamless… ”

  1. Still pinging at 103ms from here, @ approx 2021NZT.

    Seriously, the spambot kings aren’t even trying any more. “Useful post, thanks, I will bookmark this site” every time?

    I caught one suggesting the RSS was awry… that at least made me stop and read it for a few seconds. If they’re going to plague admins they could at least put the effort in to making it entertaining. Or they could just catch leprosy. Either is good.

    • lprent 1.1

      😈 They do seem rather unimaginative…

      Yeah the current TTL was set at 5 hours so it will take a bit of time to shift over. But googlebot, slurp, baidu and a number of the overseas ISP’s appear to have done so now.

      Yay! Steak preparing time

  2. lprent 2

    Looks good so far. The nice thing is that this should be the last major change to the site before the election.

  3. infused 3

    Round Robbin and TTL of 1 hour does the trick. You set the TTL to 1hr a week before though. DNS servers will sometimes ignore this and refresh when they want to as DNS can create a lot of traffic.

    • lprent 3.1

      I’d noticed that some DNS’es were a bit good at ignoring domain changes regardless what the TTL was.

      The TTL on the new configuration is currently set to 15 minutes. We really don’t need instantaneous fallbacks (yet). I’ll have a look at the DNS queries at the server side after I have a few weekdays to look at. I really don’t want to have millions of DNS lookups due to too short a TTL. Also don’t want to have massively long delays when the system needs to flip.

      But this new configuration appears to be flipping over pretty well with few problems as far as I can see. There is an issue with the timing of changes to robots.txt between the two systems that I will have to sort out. And I still haven’t started the sphinx search indexer for a similar reason. I’ll probably have to write some plugin excluders based on the system along with some .htaccess. But that can wait for the system to settle so I can see the traffic issues.

      In the meantime it is back to some nice clean c++ coding tomorrow. Doing system work is somewhat boring….

  4. BLiP 4

    As an end-user can I just say: never mind the obfuscating tech-whizz kid gobbledeegook, where’s the search function??? ; )

    • lprent 4.1

      I will attempt to turn it back on tonight. It is slightly complicated when the search is on two machines

      • BLiP 4.1.1

        No rush, mate. I did get used to it when it was working but using Google is okay as well Take your time and get it right at your end, please. Thanks for all you do.

  5. rosy 5

    Hi Lprent
    I’m  not sure if you know of any issues on the overseas server so thought I should mention….
    I’m having trouble posting, with the same issue Carol mentioned of the anti-spam not being accepted, but also:
    – Some pics won’t display – like today’s caption contest I can’t see at all
    – Sometimes the formatting functions won’t work (intermittent and possibly related to:
    – loading and editing is really slow – up to 5 minutes and then I’ve deleted the comment (by using delete, refresh and exiting the site because just deleting takes minutes as well).

    • rosy 5.1

      hah – anti-spam worked with that comment, but comment editor still broken – quicker to write a new comment than to edit the one above.

      • lprent 5.1.1

        Interesting. Looking at your location it appears that it is 325ms ping from the NZ server to there, and only 161ms from the US server to there (and 169ms from my home system in NZ to the west coast US server). You shouldn’t be getting much difference in terms of latency. The US server is probably superior in terms of shifting data.

        But the logs do show a lot more heavy CPU spikes on the US server compared to the NZ. It is those bloody bots.

        The anti-spam issue should be fixed now – dropped the javascript editor for the moment which was where the problem was coming from.. Try that.

        If you’re confident about your terminal / console /editor skills on the ? Mac ? then add the following line to the /etc/hosts file (in windows it is c:\windows\system32\drivers\etc\hosts for a 32bit system) (in mac/linux you need to sudo the editor to be able to save the file)

        120.138.23.92 thestandard.org.nz

        That will flip you to using the NZ server regardless of what the DNS says. Remove it to revert. But I suspect you’ll find that it is worse not better. It looks to me like a large chunk is just bad links between you and the server today.

        • rosy 5.1.1.1

          Yay! I have pictures. I’ll leave that IP address line in and change it back if anything goes wrong. I’ll let you know if that’s the case. Thanks heaps 🙂

    • lprent 5.2

      Ok. I will have to test it out. There are delays whilst the images get copied from one server to another, but they’re not meant to be more than a few minutes.

      The anti-spam is generated on that server. So that sounds like a loading problem. 

      I did do all of the testing for those things and it was a bit sluggish when posting comments – mostly because it was updating a remote database. But It looks like I’ll need to test when the system is under load.

      • Carol 5.2.1

        Thanks for all the work you’re putting into this, as I realise changing servers can be a major headache.

  6. lprent 6

    Dual servers is affecting

    1. The re-edit functionality. This looks like it is working correctly for people in NZ / aussie and failing for everyone elsewhere. I just ordered a extra license which will hopefully fix it it.

    2. The ipad/iphone functionality is probably OK from my testing. I just ordered a extra licenses.

    3. The comment save speed is pretty poor on the US server. Working on that.

    4. The images from new posts don’t come through fast enough. Authors scheduling those at least 15 minutes in advance would be a simple fix. But a more paranoid push strategy would help as well. Need to save in n places or on a separate web server (which is what wordpress.com appear to do).

  7. Will we get the options to put in links etc again ? these options are gone now.

Recent Comments

Recent Posts

  • Speech to the 2024 Infrastructure Symposium
    Introduction Good morning. It’s a great privilege to be here at the 2024 Infrastructure Symposium. I was extremely happy when the Prime Minister asked me to be his Minister for Infrastructure. It is one of the great barriers holding the New Zealand economy back from achieving its potential. Building high ...
    BeehiveBy beehive.govt.nz
    7 hours ago
  • $571 million for Defence pay and projects
    Defence Minister Judith Collins today announced the upcoming Budget will include new funding of $571 million for Defence Force pay and projects. “Our servicemen and women do New Zealand proud throughout the world and this funding will help ensure we retain their services and expertise as we navigate an increasingly ...
    BeehiveBy beehive.govt.nz
    12 hours ago
  • Climate change – mitigating the risks and costs
    New Zealand’s ability to cope with climate change will be strengthened as part of the Government’s focus to build resilience as we rebuild the economy, Climate Change Minister Simon Watts says. “An enduring and long-term approach is needed to provide New Zealanders and the economy with certainty as the climate ...
    BeehiveBy beehive.govt.nz
    12 hours ago
  • Getting new job seekers on the pathway to work
    Jobseeker beneficiaries who have work obligations must now meet with MSD within two weeks of their benefit starting to determine their next step towards finding a job, Social Development and Employment Minister Louise Upston says. “A key part of the coalition Government’s plan to have 50,000 fewer people on Jobseeker ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Accelerating Social Investment
    A new standalone Social Investment Agency will power-up the social investment approach, driving positive change for our most vulnerable New Zealanders, Social Investment Minister Nicola Willis says.  “Despite the Government currently investing more than $70 billion every year into social services, we are not seeing the outcomes we want for ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Getting Back on Track
    Check against delivery Good morning. It is a pleasure to be with you to outline the Coalition Government’s approach to our first Budget. Thank you Mark Skelly, President of the Hutt Valley Chamber of Commerce, together with  your Board and team, for hosting me.   I’d like to acknowledge His Worship ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • NZ – European Union ties more critical than ever
    Your Excellency Ambassador Meredith,   Members of the Diplomatic Corps and Ambassadors from European Union Member States,   Ministerial colleagues, Members of Parliament, and other distinguished guests, Thank you everyone for joining us.   Ladies and gentlemen -    In diplomacy, we often speak of ‘close’ and ‘long-standing’ relations.   ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Therapeutic Products Act to be repealed
    The Therapeutic Products Act (TPA) will be repealed this year so that a better regime can be put in place to provide New Zealanders safe and timely access to medicines, medical devices and health products, Associate Health Minister Casey Costello announced today. “The medicines and products we are talking about ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Decisions on Wellington City Council’s District Plan
    The Minister Responsible for RMA Reform, Chris Bishop, today released his decision on twenty recommendations referred to him by the Wellington City Council relating to its Intensification Planning Instrument, after the Council rejected those recommendations of the Independent Hearings Panel and made alternative recommendations. “Wellington notified its District Plan on ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Rape Awareness Week: Government committed to action on sexual violence
    Rape Awareness Week (6-10 May) is an important opportunity to acknowledge the continued effort required by government and communities to ensure that all New Zealanders can live free from violence, say Ministers Karen Chhour and Louise Upston.  “With 1 in 3 women and 1 in 8 men experiencing sexual violence ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Smarter lunch programme feeds more, costs less
    Associate Education Minister David Seymour has today announced that the Government will be delivering a more efficient Healthy School Lunches Programme, saving taxpayers approximately $107 million a year compared to how Labour funded it, by embracing innovation and commercial expertise. “We are delivering on our commitment to treat taxpayers’ money ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Report provides insights into marine recovery
    New research on the impacts of extreme weather on coastal marine habitats in Tairāwhiti and Hawke’s Bay will help fishery managers plan for and respond to any future events, Oceans and Fisheries Minister Shane Jones says. A report released today on research by Niwa on behalf of Fisheries New Zealand ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • NZ to send political delegation to the Pacific
    Deputy Prime Minister and Foreign Minister Winston Peters will lead a broad political delegation on a five-stop Pacific tour next week to strengthen New Zealand’s engagement with the region.   The delegation will visit Solomon Islands, Papua New Guinea, Vanuatu, New Caledonia, and Tuvalu.    “New Zealand has deep and ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Low gas production threatens energy security
    There has been a material decline in gas production according to figures released today by the Gas Industry Co.  Figures released by the Gas Industry Company show that there was a 12.5 per cent reduction in gas production during 2023, and a 27.8 per cent reduction in gas production in the ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Defence industry talent, commitment recognised
    Defence Minister Judith Collins tonight announced the recipients of the Minister of Defence Awards of Excellence for Industry, saying they all contribute to New Zealanders’ security and wellbeing. “Congratulations to this year’s recipients, whose innovative products and services play a critical role in the delivery of New Zealand’s defence capabilities, ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Speech to the Minister of Defence Awards of Excellence for Industry
    Welcome to you all - it is a pleasure to be here this evening.I would like to start by thanking Greg Lowe, Chair of the New Zealand Defence Industry Advisory Council, for co-hosting this reception with me. This evening is about recognising businesses from across New Zealand and overseas who in ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Speech to the Sixth Annual New Zealand Government Data Summit
    It is a pleasure to be speaking to you as the Minister for Digitising Government.  I would like to thank Akolade for the invitation to address this Summit, and to acknowledge the great effort you are making to grow New Zealand’s digital future. Today, we stand at the cusp of ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Ceasefire agreement needed now: Peters
    New Zealand is urging both Israel and Hamas to agree to an immediate ceasefire to avoid the further humanitarian catastrophe that military action in Rafah would unleash, Foreign Minister Winston Peters says.   “The immense suffering in Gaza cannot be allowed to worsen further. Both sides have a responsibility to ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Daily school attendance data now available
    A new online data dashboard released today as part of the Government’s school attendance action plan makes more timely daily attendance data available to the public and parents, says Associate Education Minister David Seymour.  The interactive dashboard will be updated once a week to show a national average of how ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Ambassador to United States appointed
    Foreign Minister Winston Peters has announced Rosemary Banks will be New Zealand’s next Ambassador to the United States of America.    “Our relationship with the United States is crucial for New Zealand in strategic, security and economic terms,” Mr Peters says.    “New Zealand and the United States have a ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • New permit proposed for recreational gold mining
    The Government is considering creating a new tier of minerals permitting that will make it easier for hobby miners to prospect for gold. “New Zealand was built on gold, it’s in our DNA. Our gold deposits, particularly in regions such as Otago and the West Coast have always attracted fortune-hunters. ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • NZ and the UAE launch FTA negotiations
    Minister for Trade Todd McClay today announced that New Zealand and the United Arab Emirates (UAE) will commence negotiations on a free trade agreement (FTA). Minister McClay met with his counterpart UAE Trade Minister Dr Thani bin Ahmed Al Zeyoudi in Dubai, where they announced the launch of negotiations on a ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • New Zealand Sign Language Week an opportunity for anyone to sign
    New Zealand Sign Language Week is an excellent opportunity for all Kiwis to give the language a go, Disabilities Issues Minister Louise Upston says. This week (May 6 to 12) is New Zealand Sign Language (NZSL) Week. The theme is “an Aotearoa where anyone can sign anywhere” and aims to ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Next stop NASA for New Zealand students
    Six tertiary students have been selected to work on NASA projects in the US through a New Zealand Space Scholarship, Space Minister Judith Collins announced today. “This is a fantastic opportunity for these talented students. They will undertake internships at NASA’s Ames Research Center or its Jet Propulsion Laboratory (JPL), where ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • $1.9 billion investment to keep NZ safe from crime
    New Zealanders will be safer because of a $1.9 billion investment in more frontline Corrections officers, more support for offenders to turn away from crime, and more prison capacity, Corrections Minister Mark Mitchell says. “Our Government said we would crack down on crime. We promised to restore law and order, ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • OECD reinforces need to control spending
    The OECD’s latest report on New Zealand reinforces the importance of bringing Government spending under control, Finance Minister Nicola Willis says. The OECD conducts country surveys every two years to review its members’ economic policies. The 2024 New Zealand survey was presented in Wellington today by OECD Chief Economist Clare Lombardelli.   ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Agreement delivers Local Water Done Well for Auckland
    The Government has delivered on its election promise to provide a financially sustainable model for Auckland under its Local Water Done Well plan. The plan, which has been unanimously endorsed by Auckland Council’s Governing Body, will see Aucklanders avoid the previously projected 25.8 per cent water rates increases while retaining ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Gaza and the Pacific on the agenda with Germany
    Foreign Minister Winston Peters discussed the need for an immediate ceasefire in Gaza, and enhanced cooperation in the Pacific with German Foreign Minister Annalena Baerbock during her first official visit to New Zealand today.    "New Zealand and Germany enjoy shared interests and values, including the rule of law, democracy, respect for the international system ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Decision allows for housing growth in Western Bay of Plenty
    The Minister Responsible for RMA Reform, Chris Bishop today released his decision on four recommendations referred to him by the Western Bay of Plenty District Council, opening the door to housing growth in the area. The Council’s Plan Change 92 allows more homes to be built in existing and new ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Speech to New Zealand China Council
    Thank you, John McKinnon and the New Zealand China Council for the invitation to speak to you today.    Thank you too, all members of the China Council. Your effort has played an essential role in helping to build, shape, and grow a balanced and resilient relationship between our two ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Modern insurance law will protect Kiwi households
    The Government is modernising insurance law to better protect Kiwis and provide security in the event of a disaster, Commerce and Consumer Affairs Minister Andrew Bayly announced today. “These reforms are long overdue. New Zealand’s insurance law is complicated and dated, some of which is more than 100 years old. ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Government recommits to equal pay
    The coalition Government is refreshing its approach to supporting pay equity claims as time-limited funding for the Pay Equity Taskforce comes to an end, Public Service Minister Nicola Willis says.  “Three years ago, the then-government introduced changes to the Equal Pay Act to support pay equity bargaining. The changes were ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Transforming how our children learn to read
    Structured literacy will change the way New Zealand children learn to read - improving achievement and setting students up for success, Education Minister Erica Stanford says.  “Being able to read and write is a fundamental life skill that too many young people are missing out on. Recent data shows that ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • NZ not backing down in Canada dairy dispute
    Trade Minister Todd McClay says Canada’s refusal to comply in full with a CPTPP trade dispute ruling in our favour over dairy trade is cynical and New Zealand has no intention of backing down. Mr McClay said he has asked for urgent legal advice in respect of our ‘next move’ ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Stronger oversight for our most vulnerable children
    The rights of our children and young people will be enhanced by changes the coalition Government will make to strengthen oversight of the Oranga Tamariki system, including restoring a single Children’s Commissioner. “The Government is committed to delivering better public services that care for our most at-risk young people and ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Streamlining Building Consent Changes
    The Government is making it easier for minor changes to be made to a building consent so building a home is easier and more affordable, Building and Construction Minister Chris Penk says.      “The coalition Government is focused on making it easier and cheaper to build homes so we can ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Minister acknowledges passing of Sir Robert Martin (KNZM)
    New Zealand lost a true legend when internationally renowned disability advocate Sir Robert Martin (KNZM) passed away at his home in Whanganui last night, Disabilities Issues Minister Louise Upston says. “Our Government’s thoughts are with his wife Lynda, family and community, those he has worked with, the disability community in ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Speech to New Zealand Institute of International Affairs, Parliament – Annual Lecture: Challenges ...
    Good evening –   Before discussing the challenges and opportunities facing New Zealand’s foreign policy, we’d like to first acknowledge the New Zealand Institute of International Affairs. You have contributed to debates about New Zealand foreign policy over a long period of time, and we thank you for hosting us.  ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Accelerating airport security lines
    From today, passengers travelling internationally from Auckland Airport will be able to keep laptops and liquids in their carry-on bags for security screening thanks to new technology, Transport Minister Simeon Brown says. “Creating a more efficient and seamless travel experience is important for holidaymakers and businesses, enabling faster movement through ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Community hui to talk about kina barrens
    People with an interest in the health of Northland’s marine ecosystems are invited to a public meeting to discuss how to deal with kina barrens, Oceans and Fisheries Minister Shane Jones says. Mr Jones will lead the discussion, which will take place on Friday, 10 May, at Awanui Hotel in ...
    BeehiveBy beehive.govt.nz
    1 week ago

Page generated in The Standard by Wordpress at 2024-05-10T09:42:41+00:00