In theory it should be seamless…

Written By: - Date published: 8:15 pm, April 25th, 2011 - 17 comments
Categories: admin, The Standard - Tags:

Shifting the site to a GeoDNS with fallback capabilities this evening*. This involves changing the domain name server addresses again. Now like last time this is meant to be a seamless shift. However that may or may not be the case.

Last time there were some quite ISP’s with interesting ways of interpreting what a time to live meant (10 minutes means ten minutes damnit – not 10 hours). The replicated slave server turned out to have a few interesting issues and essentially failed. So there were some poor souls who were deprived of the site for quite a few hours.

This time, the replication has been running for the last week. I fixed the last few bugs in it last night. The DNS is starting to dynamically flip people to different servers as I write. In theory it should be seamless… If it isn’t then I’ll apologize in advance.

Now is a good time to cook dinner with the iPad in hand to monitor the change.

* In essence this means that when you request thestandard.org.nz, the domain name server will detect where you are asking from, and divert you to the nearest operational server.

For anyone in New Zealand, Australia, and Oceania this means your page comes from Auckland. Everyone else (including most of the spiders and spambots) will come from San Diego and not through the crowded Southern Cross cables. The Auckland server will lose about half of its weekday traffic.

It also means that we can have NZ servers without worrying about nuisance issues. There is now a hot server running offshore running a same operating site with a second or so delay. Either server can run the full site albeit slowly. It is also possible to easily add other lower cost servers hooked into the same system.

17 comments on “In theory it should be seamless… ”

  1. Still pinging at 103ms from here, @ approx 2021NZT.

    Seriously, the spambot kings aren’t even trying any more. “Useful post, thanks, I will bookmark this site” every time?

    I caught one suggesting the RSS was awry… that at least made me stop and read it for a few seconds. If they’re going to plague admins they could at least put the effort in to making it entertaining. Or they could just catch leprosy. Either is good.

    • lprent 1.1

      😈 They do seem rather unimaginative…

      Yeah the current TTL was set at 5 hours so it will take a bit of time to shift over. But googlebot, slurp, baidu and a number of the overseas ISP’s appear to have done so now.

      Yay! Steak preparing time

  2. lprent 2

    Looks good so far. The nice thing is that this should be the last major change to the site before the election.

  3. infused 3

    Round Robbin and TTL of 1 hour does the trick. You set the TTL to 1hr a week before though. DNS servers will sometimes ignore this and refresh when they want to as DNS can create a lot of traffic.

    • lprent 3.1

      I’d noticed that some DNS’es were a bit good at ignoring domain changes regardless what the TTL was.

      The TTL on the new configuration is currently set to 15 minutes. We really don’t need instantaneous fallbacks (yet). I’ll have a look at the DNS queries at the server side after I have a few weekdays to look at. I really don’t want to have millions of DNS lookups due to too short a TTL. Also don’t want to have massively long delays when the system needs to flip.

      But this new configuration appears to be flipping over pretty well with few problems as far as I can see. There is an issue with the timing of changes to robots.txt between the two systems that I will have to sort out. And I still haven’t started the sphinx search indexer for a similar reason. I’ll probably have to write some plugin excluders based on the system along with some .htaccess. But that can wait for the system to settle so I can see the traffic issues.

      In the meantime it is back to some nice clean c++ coding tomorrow. Doing system work is somewhat boring….

  4. BLiP 4

    As an end-user can I just say: never mind the obfuscating tech-whizz kid gobbledeegook, where’s the search function??? ; )

    • lprent 4.1

      I will attempt to turn it back on tonight. It is slightly complicated when the search is on two machines

      • BLiP 4.1.1

        No rush, mate. I did get used to it when it was working but using Google is okay as well Take your time and get it right at your end, please. Thanks for all you do.

  5. rosy 5

    Hi Lprent
    I’m  not sure if you know of any issues on the overseas server so thought I should mention….
    I’m having trouble posting, with the same issue Carol mentioned of the anti-spam not being accepted, but also:
    – Some pics won’t display – like today’s caption contest I can’t see at all
    – Sometimes the formatting functions won’t work (intermittent and possibly related to:
    – loading and editing is really slow – up to 5 minutes and then I’ve deleted the comment (by using delete, refresh and exiting the site because just deleting takes minutes as well).

    • rosy 5.1

      hah – anti-spam worked with that comment, but comment editor still broken – quicker to write a new comment than to edit the one above.

      • lprent 5.1.1

        Interesting. Looking at your location it appears that it is 325ms ping from the NZ server to there, and only 161ms from the US server to there (and 169ms from my home system in NZ to the west coast US server). You shouldn’t be getting much difference in terms of latency. The US server is probably superior in terms of shifting data.

        But the logs do show a lot more heavy CPU spikes on the US server compared to the NZ. It is those bloody bots.

        The anti-spam issue should be fixed now – dropped the javascript editor for the moment which was where the problem was coming from.. Try that.

        If you’re confident about your terminal / console /editor skills on the ? Mac ? then add the following line to the /etc/hosts file (in windows it is c:\windows\system32\drivers\etc\hosts for a 32bit system) (in mac/linux you need to sudo the editor to be able to save the file)

        120.138.23.92 thestandard.org.nz

        That will flip you to using the NZ server regardless of what the DNS says. Remove it to revert. But I suspect you’ll find that it is worse not better. It looks to me like a large chunk is just bad links between you and the server today.

        • rosy 5.1.1.1

          Yay! I have pictures. I’ll leave that IP address line in and change it back if anything goes wrong. I’ll let you know if that’s the case. Thanks heaps 🙂

    • lprent 5.2

      Ok. I will have to test it out. There are delays whilst the images get copied from one server to another, but they’re not meant to be more than a few minutes.

      The anti-spam is generated on that server. So that sounds like a loading problem. 

      I did do all of the testing for those things and it was a bit sluggish when posting comments – mostly because it was updating a remote database. But It looks like I’ll need to test when the system is under load.

      • Carol 5.2.1

        Thanks for all the work you’re putting into this, as I realise changing servers can be a major headache.

  6. lprent 6

    Dual servers is affecting

    1. The re-edit functionality. This looks like it is working correctly for people in NZ / aussie and failing for everyone elsewhere. I just ordered a extra license which will hopefully fix it it.

    2. The ipad/iphone functionality is probably OK from my testing. I just ordered a extra licenses.

    3. The comment save speed is pretty poor on the US server. Working on that.

    4. The images from new posts don’t come through fast enough. Authors scheduling those at least 15 minutes in advance would be a simple fix. But a more paranoid push strategy would help as well. Need to save in n places or on a separate web server (which is what wordpress.com appear to do).

  7. Will we get the options to put in links etc again ? these options are gone now.

Recent Comments

Recent Posts

  • Agreement delivers Local Water Done Well for Auckland
    The Government has delivered on its election promise to provide a financially sustainable model for Auckland under its Local Water Done Well plan. The plan, which has been unanimously endorsed by Auckland Council’s Governing Body, will see Aucklanders avoid the previously projected 25.8 per cent water rates increases while retaining ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Gaza and the Pacific on the agenda with Germany
    Foreign Minister Winston Peters discussed the need for an immediate ceasefire in Gaza, and enhanced cooperation in the Pacific with German Foreign Minister Annalena Baerbock during her first official visit to New Zealand today.    "New Zealand and Germany enjoy shared interests and values, including the rule of law, democracy, respect for the international system ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Decision allows for housing growth in Western Bay of Plenty
    The Minister Responsible for RMA Reform, Chris Bishop today released his decision on four recommendations referred to him by the Western Bay of Plenty District Council, opening the door to housing growth in the area. The Council’s Plan Change 92 allows more homes to be built in existing and new ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Speech to New Zealand China Council
    Thank you, John McKinnon and the New Zealand China Council for the invitation to speak to you today.    Thank you too, all members of the China Council. Your effort has played an essential role in helping to build, shape, and grow a balanced and resilient relationship between our two ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Modern insurance law will protect Kiwi households
    The Government is modernising insurance law to better protect Kiwis and provide security in the event of a disaster, Commerce and Consumer Affairs Minister Andrew Bayly announced today. “These reforms are long overdue. New Zealand’s insurance law is complicated and dated, some of which is more than 100 years old. ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Government recommits to equal pay
    The coalition Government is refreshing its approach to supporting pay equity claims as time-limited funding for the Pay Equity Taskforce comes to an end, Public Service Minister Nicola Willis says.  “Three years ago, the then-government introduced changes to the Equal Pay Act to support pay equity bargaining. The changes were ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Transforming how our children learn to read
    Structured literacy will change the way New Zealand children learn to read - improving achievement and setting students up for success, Education Minister Erica Stanford says.  “Being able to read and write is a fundamental life skill that too many young people are missing out on. Recent data shows that ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • NZ not backing down in Canada dairy dispute
    Trade Minister Todd McClay says Canada’s refusal to comply in full with a CPTPP trade dispute ruling in our favour over dairy trade is cynical and New Zealand has no intention of backing down. Mr McClay said he has asked for urgent legal advice in respect of our ‘next move’ ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Stronger oversight for our most vulnerable children
    The rights of our children and young people will be enhanced by changes the coalition Government will make to strengthen oversight of the Oranga Tamariki system, including restoring a single Children’s Commissioner. “The Government is committed to delivering better public services that care for our most at-risk young people and ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Streamlining Building Consent Changes
    The Government is making it easier for minor changes to be made to a building consent so building a home is easier and more affordable, Building and Construction Minister Chris Penk says.      “The coalition Government is focused on making it easier and cheaper to build homes so we can ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Minister acknowledges passing of Sir Robert Martin (KNZM)
    New Zealand lost a true legend when internationally renowned disability advocate Sir Robert Martin (KNZM) passed away at his home in Whanganui last night, Disabilities Issues Minister Louise Upston says. “Our Government’s thoughts are with his wife Lynda, family and community, those he has worked with, the disability community in ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Speech to New Zealand Institute of International Affairs, Parliament – Annual Lecture: Challenges ...
    Good evening –   Before discussing the challenges and opportunities facing New Zealand’s foreign policy, we’d like to first acknowledge the New Zealand Institute of International Affairs. You have contributed to debates about New Zealand foreign policy over a long period of time, and we thank you for hosting us.  ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Accelerating airport security lines
    From today, passengers travelling internationally from Auckland Airport will be able to keep laptops and liquids in their carry-on bags for security screening thanks to new technology, Transport Minister Simeon Brown says. “Creating a more efficient and seamless travel experience is important for holidaymakers and businesses, enabling faster movement through ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Community hui to talk about kina barrens
    People with an interest in the health of Northland’s marine ecosystems are invited to a public meeting to discuss how to deal with kina barrens, Oceans and Fisheries Minister Shane Jones says. Mr Jones will lead the discussion, which will take place on Friday, 10 May, at Awanui Hotel in ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Kiwi exporters win as NZ-EU FTA enters into force
    Kiwi exporters are $100 million better off today with the NZ EU FTA entering into force says Trade Minister Todd McClay. “This is all part of our plan to grow the economy. New Zealand's prosperity depends on international trade, making up 60 per cent of the country’s total economic activity. ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Mining resurgence a welcome sign
    There are heartening signs that the extractive sector is once again becoming an attractive prospect for investors and a source of economic prosperity for New Zealand, Resources Minister Shane Jones says. “The beginnings of a resurgence in extractive industries are apparent in media reports of the sector in the past ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Ō-Rākau Remembrance Bill passes first reading
    The return of the historic Ō-Rākau battle site to the descendants of those who fought there moved one step closer today with the first reading of Te Pire mō Ō-Rākau, Te Pae o Maumahara / The Ō-Rākau Remembrance Bill. The Bill will entrust the 9.7-hectare battle site, five kilometres west ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Government to boost public EV charging network
    Energy Minister Simeon Brown has announced 25 new high-speed EV charging hubs along key routes between major urban centres and outlined the Government’s plan to supercharge New Zealand’s EV infrastructure.  The hubs will each have several chargers and be capable of charging at least four – and up to 10 ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Residential Property Managers Bill to not progress
    The coalition Government will not proceed with the previous Government’s plans to regulate residential property managers, Housing Minister Chris Bishop says. “I have written to the Chairperson of the Social Services and Community Committee to inform him that the Government does not intend to support the Residential Property Managers Bill ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Independent review into disability support services
    The Government has announced an independent review into the disability support system funded by the Ministry of Disabled People – Whaikaha. Disability Issues Minister Louise Upston says the review will look at what can be done to strengthen the long-term sustainability of Disability Support Services to provide disabled people and ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Justice Minister updates UN on law & order plan
    Justice Minister Paul Goldsmith has attended the Universal Periodic Review in Geneva and outlined the Government’s plan to restore law and order. “Speaking to the United Nations Human Rights Council provided us with an opportunity to present New Zealand’s human rights progress, priorities, and challenges, while responding to issues and ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Ending emergency housing motels in Rotorua
    The Government and Rotorua Lakes Council are committed to working closely together to end the use of contracted emergency housing motels in Rotorua. Associate Minister of Housing (Social Housing) Tama Potaka says the Government remains committed to ending the long-term use of contracted emergency housing motels in Rotorua by the ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Trade Minister travels to Riyadh, OECD, and Dubai
    Trade Minister Todd McClay heads overseas today for high-level trade talks in the Gulf region, and a key OECD meeting in Paris. Mr McClay will travel to Riyadh to meet with counterparts from Saudi Arabia and the Gulf Cooperation Council (GCC). “New Zealand’s goods and services exports to the Gulf region ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Education priorities focused on lifting achievement
    Education Minister Erica Stanford has outlined six education priorities to deliver a world-leading education system that sets Kiwi kids up for future success. “I’m putting ambition, achievement and outcomes at the heart of our education system. I want every child to be inspired and engaged in their learning so they ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • NZTA App first step towards digital driver licence
    The new NZ Transport Agency (NZTA) App is a secure ‘one stop shop’ to provide the services drivers need, Transport Minister Simeon Brown and Digitising Government Minister Judith Collins say.  “The NZTA App will enable an easier way for Kiwis to pay for Vehicle Registration and Road User Charges (RUC). ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Supporting whānau out of emergency housing
    Whānau with tamariki growing up in emergency housing motels will be prioritised for social housing starting this week, says Associate Housing Minister Tama Potaka. “Giving these whānau a better opportunity to build healthy stable lives for themselves and future generations is an essential part of the Government’s goal of reducing ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Tribute to Dave O'Sullivan
    Racing Minister Winston Peters has paid tribute to an icon of the industry with the recent passing of Dave O’Sullivan (OBE). “Our sympathies are with the O’Sullivan family with the sad news of Dave O’Sullivan’s recent passing,” Mr Peters says. “His contribution to racing, initially as a jockey and then ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Speech – Eid al-Fitr
    Assalaamu alaikum, greetings to you all. Eid Mubarak, everyone! I want to extend my warmest wishes to you and everyone celebrating this joyous occasion. It is a pleasure to be here. I have enjoyed Eid celebrations at Parliament before, but this is my first time joining you as the Minister ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Government saves access to medicines
    Associate Health Minister David Seymour has announced Pharmac’s largest ever budget of $6.294 billion over four years, fixing a $1.774 billion fiscal cliff.    “Access to medicines is a crucial part of many Kiwis’ lives. We’ve committed to a budget allocation of $1.774 billion over four years so Kiwis are ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Pharmac Chair appointed
    Hon Paula Bennett has been appointed as member and chair of the Pharmac board, Associate Health Minister David Seymour announced today. "Pharmac is a critical part of New Zealand's health system and plays a significant role in ensuring that Kiwis have the best possible access to medicines,” says Mr Seymour. ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Taking action on Fetal Alcohol Spectrum Disorder
    Hundreds of New Zealand families affected by Fetal Alcohol Spectrum Disorder (FASD) will benefit from a new Government focus on prevention and treatment, says Health Minister Dr Shane Reti. “We know FASD is a leading cause of preventable intellectual and neurodevelopmental disability in New Zealand,” Dr Reti says.  “Every day, ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • New sports complex opens in Kaikohe
    Regional Development Minister Shane Jones today attended the official opening of Kaikohe’s new $14.7 million sports complex. “The completion of the Kaikohe Multi Sports Complex is a fantastic achievement for the Far North,” Mr Jones says. “This facility not only fulfils a long-held dream for local athletes, but also creates ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Diplomacy needed more than ever
    Foreign Minister Winston Peters’ engagements in Türkiye this week underlined the importance of diplomacy to meet growing global challenges.    “Returning to the Gallipoli Peninsula to represent New Zealand at Anzac commemorations was a sombre reminder of the critical importance of diplomacy for de-escalating conflicts and easing tensions,” Mr Peters ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Anzac Commemorative Address, Buttes New British Cemetery Belgium
    Ambassador Millar, Burgemeester, Vandepitte, Excellencies, military representatives, distinguished guests, ladies and gentlemen – good morning and welcome to this sacred Anzac Day dawn service.  It is an honour to be here on behalf of the Government and people of New Zealand at Buttes New British Cemetery, Polygon Wood – a deeply ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Anzac Commemorative Address – NZ National Service, Chunuk Bair
    Distinguished guests -   It is an honour to return once again to this site which, as the resting place for so many of our war-dead, has become a sacred place for generations of New Zealanders.   Our presence here and at the other special spaces of Gallipoli is made ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Anzac Commemorative Address – Dawn Service, Gallipoli, Türkiye
    Mai ia tawhiti pamamao, te moana nui a Kiwa, kua tae whakaiti mai matou, ki to koutou papa whenua. No koutou te tapuwae, no matou te tapuwae, kua honoa pumautia.   Ko nga toa kua hinga nei, o te Waipounamu, o te Ika a Maui, he okioki tahi me o ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • PM announces changes to portfolios
    Paul Goldsmith will take on responsibility for the Media and Communications portfolio, while Louise Upston will pick up the Disability Issues portfolio, Prime Minister Christopher Luxon announced today. “Our Government is relentlessly focused on getting New Zealand back on track. As issues change in prominence, I plan to adjust Ministerial ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • New catch limits for unique fishery areas
    Recreational catch limits will be reduced in areas of Fiordland and the Chatham Islands to help keep those fisheries healthy and sustainable, Oceans and Fisheries Minister Shane Jones says. The lower recreational daily catch limits for a range of finfish and shellfish species caught in the Fiordland Marine Area and ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Minister welcomes hydrogen milestone
    Energy Minister Simeon Brown has welcomed an important milestone in New Zealand’s hydrogen future, with the opening of the country’s first network of hydrogen refuelling stations in Wiri. “I want to congratulate the team at Hiringa Energy and its partners K one W one (K1W1), Mitsui & Co New Zealand ...
    BeehiveBy beehive.govt.nz
    2 weeks ago
  • Urgent changes to system through first RMA Amendment Bill
    The coalition Government is delivering on its commitment to improve resource management laws and give greater certainty to consent applicants, with a Bill to amend the Resource Management Act (RMA) expected to be introduced to Parliament next month. RMA Reform Minister Chris Bishop has today outlined the first RMA Amendment ...
    BeehiveBy beehive.govt.nz
    2 weeks ago

Page generated in The Standard by Wordpress at 2024-05-06T03:43:41+00:00