web analytics

In theory it should be seamless…

Written By: - Date published: 8:15 pm, April 25th, 2011 - 17 comments
Categories: admin, The Standard - Tags:

Shifting the site to a GeoDNS with fallback capabilities this evening*. This involves changing the domain name server addresses again. Now like last time this is meant to be a seamless shift. However that may or may not be the case.

Last time there were some quite ISP’s with interesting ways of interpreting what a time to live meant (10 minutes means ten minutes damnit – not 10 hours). The replicated slave server turned out to have a few interesting issues and essentially failed. So there were some poor souls who were deprived of the site for quite a few hours.

This time, the replication has been running for the last week. I fixed the last few bugs in it last night. The DNS is starting to dynamically flip people to different servers as I write. In theory it should be seamless… If it isn’t then I’ll apologize in advance.

Now is a good time to cook dinner with the iPad in hand to monitor the change.

* In essence this means that when you request thestandard.org.nz, the domain name server will detect where you are asking from, and divert you to the nearest operational server.

For anyone in New Zealand, Australia, and Oceania this means your page comes from Auckland. Everyone else (including most of the spiders and spambots) will come from San Diego and not through the crowded Southern Cross cables. The Auckland server will lose about half of its weekday traffic.

It also means that we can have NZ servers without worrying about nuisance issues. There is now a hot server running offshore running a same operating site with a second or so delay. Either server can run the full site albeit slowly. It is also possible to easily add other lower cost servers hooked into the same system.

17 comments on “In theory it should be seamless… ”

  1. Still pinging at 103ms from here, @ approx 2021NZT.

    Seriously, the spambot kings aren’t even trying any more. “Useful post, thanks, I will bookmark this site” every time?

    I caught one suggesting the RSS was awry… that at least made me stop and read it for a few seconds. If they’re going to plague admins they could at least put the effort in to making it entertaining. Or they could just catch leprosy. Either is good.

    • lprent 1.1

      😈 They do seem rather unimaginative…

      Yeah the current TTL was set at 5 hours so it will take a bit of time to shift over. But googlebot, slurp, baidu and a number of the overseas ISP’s appear to have done so now.

      Yay! Steak preparing time

  2. lprent 2

    Looks good so far. The nice thing is that this should be the last major change to the site before the election.

  3. infused 3

    Round Robbin and TTL of 1 hour does the trick. You set the TTL to 1hr a week before though. DNS servers will sometimes ignore this and refresh when they want to as DNS can create a lot of traffic.

    • lprent 3.1

      I’d noticed that some DNS’es were a bit good at ignoring domain changes regardless what the TTL was.

      The TTL on the new configuration is currently set to 15 minutes. We really don’t need instantaneous fallbacks (yet). I’ll have a look at the DNS queries at the server side after I have a few weekdays to look at. I really don’t want to have millions of DNS lookups due to too short a TTL. Also don’t want to have massively long delays when the system needs to flip.

      But this new configuration appears to be flipping over pretty well with few problems as far as I can see. There is an issue with the timing of changes to robots.txt between the two systems that I will have to sort out. And I still haven’t started the sphinx search indexer for a similar reason. I’ll probably have to write some plugin excluders based on the system along with some .htaccess. But that can wait for the system to settle so I can see the traffic issues.

      In the meantime it is back to some nice clean c++ coding tomorrow. Doing system work is somewhat boring….

  4. BLiP 4

    As an end-user can I just say: never mind the obfuscating tech-whizz kid gobbledeegook, where’s the search function??? ; )

    • lprent 4.1

      I will attempt to turn it back on tonight. It is slightly complicated when the search is on two machines

      • BLiP 4.1.1

        No rush, mate. I did get used to it when it was working but using Google is okay as well Take your time and get it right at your end, please. Thanks for all you do.

  5. rosy 5

    Hi Lprent
    I’m  not sure if you know of any issues on the overseas server so thought I should mention….
    I’m having trouble posting, with the same issue Carol mentioned of the anti-spam not being accepted, but also:
    – Some pics won’t display – like today’s caption contest I can’t see at all
    – Sometimes the formatting functions won’t work (intermittent and possibly related to:
    – loading and editing is really slow – up to 5 minutes and then I’ve deleted the comment (by using delete, refresh and exiting the site because just deleting takes minutes as well).

    • rosy 5.1

      hah – anti-spam worked with that comment, but comment editor still broken – quicker to write a new comment than to edit the one above.

      • lprent 5.1.1

        Interesting. Looking at your location it appears that it is 325ms ping from the NZ server to there, and only 161ms from the US server to there (and 169ms from my home system in NZ to the west coast US server). You shouldn’t be getting much difference in terms of latency. The US server is probably superior in terms of shifting data.

        But the logs do show a lot more heavy CPU spikes on the US server compared to the NZ. It is those bloody bots.

        The anti-spam issue should be fixed now – dropped the javascript editor for the moment which was where the problem was coming from.. Try that.

        If you’re confident about your terminal / console /editor skills on the ? Mac ? then add the following line to the /etc/hosts file (in windows it is c:\windows\system32\drivers\etc\hosts for a 32bit system) (in mac/linux you need to sudo the editor to be able to save the file)

        120.138.23.92 thestandard.org.nz

        That will flip you to using the NZ server regardless of what the DNS says. Remove it to revert. But I suspect you’ll find that it is worse not better. It looks to me like a large chunk is just bad links between you and the server today.

        • rosy 5.1.1.1

          Yay! I have pictures. I’ll leave that IP address line in and change it back if anything goes wrong. I’ll let you know if that’s the case. Thanks heaps 🙂

    • lprent 5.2

      Ok. I will have to test it out. There are delays whilst the images get copied from one server to another, but they’re not meant to be more than a few minutes.

      The anti-spam is generated on that server. So that sounds like a loading problem. 

      I did do all of the testing for those things and it was a bit sluggish when posting comments – mostly because it was updating a remote database. But It looks like I’ll need to test when the system is under load.

      • Carol 5.2.1

        Thanks for all the work you’re putting into this, as I realise changing servers can be a major headache.

  6. lprent 6

    Dual servers is affecting

    1. The re-edit functionality. This looks like it is working correctly for people in NZ / aussie and failing for everyone elsewhere. I just ordered a extra license which will hopefully fix it it.

    2. The ipad/iphone functionality is probably OK from my testing. I just ordered a extra licenses.

    3. The comment save speed is pretty poor on the US server. Working on that.

    4. The images from new posts don’t come through fast enough. Authors scheduling those at least 15 minutes in advance would be a simple fix. But a more paranoid push strategy would help as well. Need to save in n places or on a separate web server (which is what wordpress.com appear to do).

  7. Will we get the options to put in links etc again ? these options are gone now.

Recent Comments

Recent Posts

  • Government support boosts Arts and Culture sector
    Government support for the cultural sector to help it recover from the impact of COVID-19 has resulted in more cultural sector jobs predicted through to 2026, and the sector performing better than forecast. The latest forecast by economic consultancy ‘Infometrics’ reflects the impact of Government investment in keeping people in ...
    BeehiveBy beehive.govt.nz
    3 hours ago
  • Govt takes further action against gang crime
    The Government will make it illegal for high risk people to own firearms by introducing Firearms Prohibition Orders (FPOs) that will strengthen action already taken to combat the influence of gangs and organised crime to help keep New Zealanders and their families safe, Police Minister Poto Williams and Justice Minister ...
    BeehiveBy beehive.govt.nz
    10 hours ago
  • Thousands of MIQ spaces allocated to secure economic recovery
    Five hundred spaces per fortnight will be allocated in managed isolation facilities over the next 10 months, many for skilled and critical workers to support our economic recovery, COVID-19 Response Minister Chris Hipkins and Agriculture Minister Damien O’Connor say. “The Trans-Tasman bubble has freed up more rooms, allowing us to ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • New Zealand Sign Language Week a chance to recognise national taonga
    This week (10 – 16 May 2021) is New Zealand Sign Language Week (NZSL), a nationwide celebration of NZSL as an official language of New Zealand. “We’re recognised as a world leader for our commitment to maintaining and furthering the use of our sign language,” says Minister for Disability Issues ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Economic resilience provides more options in Budget 2021
    Securing the recovery and investing in the wellbeing of New Zealanders is the focus of Budget 2021, Grant Robertson told his audience at a pre-budget speech in Auckland this morning. "The economy has proven resilient in response to COVID-19, due to people having confidence in the Government’s health response to ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Pre-Budget speech to BNZ-Deloitte Auckland Breakfast Event
    Thank you for the invitation to speak to you today, and to share with you some of the Government’s thinking leading into this year’s budget. This will be my fourth time delivering the annual Budget for the Government, though the events of the past year have thrown out that calculation. ...
    BeehiveBy beehive.govt.nz
    1 day ago
  • Rotuman Language week affirms language as the key to Pacific wellbeing
    The first Pacific Language Week this year  makes it clear that  language is the key to the wellbeing for all Pacific people said Minister for Pacific Peoples, Aupito William Sio. “This round of language  weeks begin with Rotuman. As I have always  said language is one of the pillars of ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Budget delivers improved cervical and breast cancer screening
    Budget 2021 funds a more effective cervical screening test to help reduce cervical cancer rates A new breast screening system that can proactively identify and enrol eligible women to reach 271,000 more people who aren’t currently in the programme. Budget 2021 delivers a better cervical screening test and a major ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • NZ-France to co-chair Christchurch Call Leaders’ Summit
    New Zealand and France will jointly convene the Christchurch Call Community for a leaders’ summit, to take stock of progress and develop a new shared priority work plan. Prime Minister Jacinda Ardern and President Emmanuel Macron will co-chair the leaders’ meeting on the 2nd anniversary of the Call, on 14 ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • New South Wales travel pause to be lifted tomorrow
    COVID-19 Response Minister Chris Hipkins says the current travel pause with New South Wales will lift tomorrow – subject to no further significant developments in NSW. “New Zealand health officials met today to conduct a further assessment of the public health risk from the recently identified COVID-19 community cases in Sydney. It has been determined that the risk to public ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • March 15 Collective Impact Board appointed
    The voices of those affected by the March 15 mosque attacks will be heard more effectively with the establishment of a new collective impact board, Associate Minister for Social Development and Employment Priyanca Radhakrishnan announced today. Seven members of the Christchurch Muslim community have been appointed to the newly established Board, ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • More young Kiwis supported with mental health and addiction services
    Nearly quarter of a million more young New Zealanders will have access to mental health and addiction support in their communities as the Government’s youth mental health programme gathers pace. New contracts to expand youth-specific services across the Northland, Waitematā and Auckland District Health Board areas have been confirmed, providing ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • New hospital facilities mean fewer trips to Auckland for Northlanders
    Northlanders will no longer automatically have to go to Auckland for lifesaving heart procedures like angiograms, angioplasty and the insertion of pacemakers, thanks to new operating theatres and a cardiac catheter laboratory opened at Whangārei Hospital by Health Minister Andrew Little today. The two projects – along with a new ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Fair Pay Agreements to improve pay and conditions for essential workers
    The Government is delivering on its pre-election commitment to implement Fair Pay Agreements which will improve wages and conditions, as well as help support our economic recovery, Workplace Relations and Safety Minister Michael Wood announced today. Fair Pay Agreements will set minimum standards for all employees and employers in an ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Establishment of the new Māori Health Authority takes first big step
    Sir Mason Durie will lead a Steering Group to provide advice to the Transition Unit on governance arrangements and initial appointments to an interim board to oversee the establishment of the Māori Health Authority. This Group will ensure that Māori shape a vital element of our future health system, Minister ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Cycle trails move up a gear in Central
    Work on new and upgraded cycle trails in Queenstown, Arrowtown and Central Otago is moving up a gear as two significant projects pass further milestones today. Tourism Minister Stuart Nash has announced new funding for the Queenstown Trails Project, and will also formally open the Lake Dunstan Trail at Bannockburn ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Picton ferry terminal upgrade consent fast-tracked
    The planned upgrade of the Waitohi Picton Ferry terminal has been approved under the fast-track consenting process.  Environment Minister David Parker today welcomed the decision by the expert consenting panel to approve the Waitohi Picton Ferry Precinct Redevelopment Project.    The project will provide a significant upgrade to the ferry facilities ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Quarantine Free Travel with New South Wales paused
    COVID-19 Response Minister Chris Hipkins has announced his intention to pause Quarantine Free Travel from New South Wales to New Zealand while the source of infection of the two cases announced in Sydney in the last two days is investigated.  Whole genome sequencing has linked the case yesterday to a recent ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Covid-19 immigration powers to be extended
    The passing of a bill to extend temporary COVID-19 immigration powers means continued flexibility to support migrants, manage the border, and help industries facing labour shortages, Immigration Minister Kris Faafoi said. “Over the past year, we’ve made rapid decisions to extend visas, vary visa conditions and waive some application requirements ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • “Supporting a Trade-Led Economic Recovery”
    Trade Policy Road Show SpeechManukau, Auckland   Kia ora koutou – nau mai, haere mai ki Manukau, ki Tāmaki.   Good morning everyone, and thank you for this opportunity to discuss with you current global challenges, opportunities and the Government’s strategy in support of a trade-led recovery from the economic ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Building consent numbers at an all-time high
    A record 41,028 new homes have been consented in the year ended March 2021 March 2021 consent numbers the highest since the 1940s Record number of new homes consented in Auckland The number of new homes consented is at an all-time high, showing a strong and increasing pipeline of demand ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Whānau-centred support for parents and tamariki
    Up to 60 whānau in Counties Manukau will be supported through the first three years of their parenthood by a new whānau-centred model of care, said Associate Health Minister, Hon Aupito William Sio. “Providing this support to young parents is something we have to get right. It’s a priority both ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • NZ backs moves to improve global access to COVID vaccines
    New Zealand welcomes and strongly supports the announcement made by the United States Trade Representative to work for a waiver of IP protections on COVID-19 vaccines at the WTO, Trade Minister Damien O’Connor said. “New Zealand supports equitable access to COVID vaccines for all. No one is safe from the ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Tourism communities: support, recovery and re-set plan
    TIHEI MAURI ORA Tuia te whakapono Tuia te tumanako Tuia te aroha Tuia te hunga ora Ki te hunga ora Tihei Mauri ora Ka nui te mihi ki a koutou Tena koutou, tena koutou, tena koutou katoa. Thank you, Hilary and thank you, Chris, and everyone at TIA for this ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Support, recovery and re-set plan for tourism communities
    Five South Island tourist communities targeted for specialist support Pressure on Māori tourism operators and Conservation facilities recognised Domestic and international-facing tourism agencies put on more secure footing Long-term plan to re-set tourism with a focus on sustainability, industry standards and regional economic diversification A plan to ensure the immediate ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Speech on NZ Rail Plan
    Check against delivery E ngā mana, e ngā reo, e ngā karanga maha o te wa, tēnā koutou, tēnā koutou, tēnā tātou katoa. Ki ngā mana whenua o Taranaki Whānui anō nei aku mihi ki a koutou. Nōku te hōnore kia haere mai ki te whakanuia tēnei huihuinga whakahirahira. Nō ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Government hits massive milestone in Violence Prevention & Elimination
    Minister for Family and Sexual Violence Marama Davidson announced a major milestone at a hui in South Auckland today, with the launch of the national engagement process on the prevention and elimination of family and sexual violence. “There is no room for violence in our lives – there is no ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Fee waiver extended for conservation tourism businesses
    Tourism businesses operating on public conservation land will have another six months of fees waived to help them adjust to the downturn in international visitors in the wake of the COVID-19 pandemic, Acting Minister of Conservation Dr Ayesha Verrall has announced. "We acknowledge it has been a difficult year for ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • ‘Lua Wave’ to future-proof Pasifika Festivals in Aotearoa
    Pasifika festival organisers will receive additional support to adapt to the COVID-19 environment thanks to the Government’s newly launched ‘Lua Wave’ component of the Pasifika Festivals Initiative, Minister for Arts, Culture and Heritage Carmel Sepuloni announced today. “This initiative has not only been to support festival organisers to recover from ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Crown accounts show confidence in Govt economic plan
    The Government’s financial accounts continue to reflect the resilience of the economy and confidence in the Government’s economic recovery plan. The Crown accounts for the nine months to the end of March 2021 show both OBEGAL and the operating balance remain better than forecast in the Half Year Economic and ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Energy Trusts of NZ Autumn Conference
    It’s a pleasure to be here today. Thank you Karen [Sherry] for the introduction and thanks to the Energy Trusts Executive for inviting me to speak at tonight’s event. It is an exciting time to come to speak to trustees of distribution companies. For many decades the electricity industry was ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • New partnership to grow Māori success in STEM
    A new partnership with the Pūhoro STEM Academy will support thousands more rangatahi Māori to participate and succeed in the fields of science, technology, and innovation, Associate Education Minister Kelvin Davis announced today. Since 2016, Pūhoro has worked with Māori students to build their capability and create pathways to employment ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Rail builds platform for economic recovery
    Transport Minister Michael Wood and State-Owned Enterprises Minister Dr David Clark today released the Government’s long term vision for a sustainable rail network that supports our economic recovery. New Zealand Rail Plan lays out how the Government is building a resilient, reliable and safe network, as well as the indicative ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • NZ and UK agree to lift the pace of free trade talks
    New Zealand and the United Kingdom have agreed to rapidly lift the tempo of talks, as the two countries enter a new phase in free trade negotiations, Trade and Export Growth Minister Damien O’Connor announced today. “UK Secretary of State for International Trade, Liz Truss, and I spoke today about ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Counter-Terrorism Legislation Bill passes first reading
    The Counter-Terrorism Legislation Bill has passed its first reading and will now be considered by Parliament’s Justice select committee. “The Bill updates and improves New Zealand’s counter-terrorism legislation and ensures that the right legislative tools are available to intervene early and prevent harm,” Minister of Justice Kris Faafoi said. “The ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Statement on The Speaker and Annual Review Debate
    “The serious issue of alleged sexual assault and harassment at Parliament was poorly managed and inappropriately politicised last night. The tone of the debate did not reflect well on Parliament as a whole,” Prime Minister Jacinda Ardern said. “Any investigation of claims of sexual assault should be in a manner ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Govt motoring towards zero-carbon buses and protecting drivers’ conditions
    Transport Minister Michael Wood is seeking feedback on options for the next phase of the Public Transport Operating Model (PTOM) review to better protect bus drivers’ pay conditions, and also achieving the Government’s target of fully decarbonising the public transport bus fleet by 2035. Michael Wood said investing in our ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Drop in unemployment shows Govt economic plan is working
    The Government’s economic recovery plan continues to be reflected in the labour market, with more people in work and unemployment falling. Stats NZ figures show employment rose by 15,000 in the March quarter, with 14,000 more women in work. The unemployment rate fell from 4.9 percent to 4.7 percent. This ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Government sets pay and workforce expectations for the Public Sector
    The Government’s Workforce Policy Statement issued today sets out its expectations for pay and employment relations in the Public Sector, the Minister of Finance and Minister for the Public Service say. “New Zealand has had an exceptionally successful health and economic response to COVID-19. This has been supported by the ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Author Ben Brown is New Zealand’s first Te Awhi Rito Reading Ambassador
    Lyttleton writer Ben Brown (Ngāti Mahuta, Ngāti Koroki, Ngāti Paoa) will be New Zealand’s first Te Awhi Rito Reading Ambassador, promoting the value of reading for children and young people, Internal Affairs Minister Jan Tinetti announced today. A poet and award-winning author, Ben Brown writes books, non-fiction and short stories ...
    BeehiveBy beehive.govt.nz
    1 week ago