web analytics

Maintenance time

Written By: - Date published: 11:51 am, January 2nd, 2022 - 15 comments
Categories: infrastructure, The Standard, uncategorized - Tags:

The Standard server is going down for a few hours later today for maintenance.

Server waiting for maintenance

It needs a replacement for the steadily failing hard drives in the archive array (RAID-Z3) and a replacement of 2Tb disks (some now over 7 years old) with new 4Tb drives. Rather than having 8 in the array, one has fully died and another faulted. So I’ll replace with 4x4Tb drives. About to head to PBTech to get a one more drive (I prefer getting them out of different batches).

The metaSAS card needs to move so that it doesn’t occasionally get overheating errors. I also have an large quiet exterior fan to attach to provide more even ventilation.

The SSDs that run The Standard array are starting to get wear issues, most notably in the log regions. Plus I need to start replacing those Intel 120Gb SSDs with something that is a bit bigger.

A good vacuum of the chassis interior wouldn’t go amiss. Even with the dust covers, the fine dust is slowly building up. Plus I think that the cat hair is starting to get in. She does like to groom herself just in front (after having a good sunbath).

I was thinking about updating the motherboard, CPU and RAM. But that can wait for another year.

As usual, I can’t really give you a precise time-frame because of the vagaries of shopping (urrgh) and balky hardware. However everything is backed up (and that takes a while to archive close to 10Tb to AWS S3). It should be a matter of only a few hours at worst to get up and running again, and then days to get the non-critical backup data down again.

In the mean time – enjoy the sunny day. I know that Luna will…

Luna in the sun
Luna bathing in the sun and preparing to shed cat hair into the server.

 Updated: The debris of old drives..

The residual drives – to be stored or disposed of.

15 comments on “Maintenance time ”

  1. Puckish Rogue 1

    So does this mean there'll be a dictionary function added? (I'd chip in a few bucks if it was money thing)

  2. Good luck Luna, you know this is only temporary and you will soon be able to get back into cat shedding mode in front of that consistently nice warm 'thing'.

    Support PR. If there is anything that a few $$$$ will help I would be happy to help too.

    This site and ALL its users/poster/commenters brings joy to me not the least of which is the intelligence and writing skills of all. And not forgetting the impecable moderating. smiley

  3. Dennis Frank 3

    I wonder if an AI module will eventually be a worthwhile addition? It could self-diagnose times for regenerative replacements to the system, put in the order to PBTech.

    You'd need a slot in your front door for the courier driver to drop the packages through. Then a package-stripping robot (along the lines of them automatic vacuumers) to extricate the replacement modules from the packages.

    Writing the instruction program to teach the robot to insert the new bits would be the tricky part. Robot would need eyes to see the slots, and an internalised photo of the equipment from the inserter's perspective to match up with.

    Anyway, if you need a creative project for your retirement plan you could consider how to make the TS system resilient via self-maintenance… enlightened

    • Shanreagh 3.1

      I vote for Luna being trained to do all this. She is on site, fewer $$$$ in travel costs and may be keen. So often when recruiting for new tasks the existing 'employees' are overlooked. After AI is pretty scary, almost as scary as having a vaccine…'ooops who said that?'

      We should keep this within the animal kingdom. Failing Luna then Gezza's Pukeko or Elvira the eel may be free for training. wink

    • lprent 3.2

      Curiously enough, a server self-diagnosis software module is what I'm writing at present professionally. Probably not the AI yet, I'm just pulling enough data to allow alerts. But also to enable data mining over time for expert system rules.

  4. higherstandard 4

    Has your lord and master thought of doing a Mayor Stubbs …. might be just what the city needs.

    • lprent 4.1

      She is no Governor Grey, ruler of government house.

      I'd could say that she rules my partner – the soft-hearted food giver to a cat whose finicky eating habits a a legend. However Luna doesn't sleep on my side of the bed because I auto-kick when bitten through the covers. Luna comes to me when she wants to be rubbed up the wrong way – as a hair removal.

      However all these must be ridiculous rumours because I just got told so….

  5. lprent 5

    Ok – starting to shutdown. I located where my screw driver set went to..

    • lprent 5.1

      And we're back.

      Had a problem that I had three identical Intel SSD drives, and I'd forgetten to get the serial numbers before shutdown

      Like this

      $ lsblk --nodeps -o name,serial
      NAME SERIAL
      sda S1DHNSAF817333Y
      sdb ZDH8TXGX
      sdc WD-WX42D31KS5SE
      sdd WD-WXA2D21RV3HE
      sde ZDHAR4D8
      sdf ZDHAQ4NC
      sdg CVCV4302022A120BGN
      sdh CVLT614108Z2120GGN
      sdi PHWL5433003G120LGN
      sdj S2R4NX0H410553P
      sdk 130801400034
      sdl S3YBNB0N402586X
      sdm CVMP2355042L120BGN
      nvme0n1 50026B76839DD779
      $ lsscsi
      [0:0:16:0] disk ATA ST4000VN008-2DR1 SC60 /dev/sdb
      [0:0:17:0] disk ATA WDC WD40EFZX-68A 0B81 /dev/sdc
      [0:0:18:0] disk ATA WDC WD40EFZX-68A 0B81 /dev/sdd
      [0:0:19:0] disk ATA ST4000VN008-2DR1 SC60 /dev/sde
      [0:0:20:0] disk ATA ST4000VN008-2DR1 SC60 /dev/sdf
      [1:0:0:0] disk ATA Samsung SSD 840 BB6Q /dev/sda
      [2:0:0:0] disk ATA INTEL SSDSC2CW12 400i /dev/sdg
      [3:0:0:0] disk ATA INTEL SSDSC2KW12 G200 /dev/sdh
      [4:0:0:0] disk ATA INTEL SSDSC2BB12 0370 /dev/sdi
      [5:0:0:0] disk ATA Samsung SSD 850 2B6Q /dev/sdj
      [6:0:0:0] disk ATA SanDisk SDSSDP06 0 /dev/sdk
      [7:0:0:0] disk ATA Samsung SSD 860 4B6Q /dev/sdl
      [8:0:0:0] disk ATA INTEL SSDSC2CT12 300i /dev/sdm
      [N:0:1:1] disk KINGSTON SA2000M81000G__1 /dev/nvme0n1

      That would have chopped nearly half an hour off the time. I kept putting the wrong one back in.

      But also not getting the right battery for the UPS systems didn’t help.

  6. lprent 6

    Turns out the drives were older than I thought.

    • 1 WD from 2012
    • 5 WD from 2013
    • 1 Seagate from 2013 (which was the dead one).
    • 1 WD from 2012 2016

    Lets hope that 5 x 4 terabyte drives (3 Seagate IronWolf and 2 WD Red Plus) last as long. Turns out I forget that I had a 4Tb Ironwolf that I had alreday brought in 2020 for testing.

    Now there are just these 8 2Tb antiques plus a few Intel 120Gb to clean and dispose of. Most of them are still ok with few errors. I will tuck them away in a backup e-sata system.

  7. McFlock 7

    any reason wordfence would be throwing 403 errors?

    • lprent 7.1

      Yeah, zpool creation of archive created it at /archive rather than /mnt/archive

      rsync to copy Hold to /mnt/archive carefully created a /mnt/archive and filled up the root directory. When it ran out of space, it started to fill RAM, and then quit. That meant that there wasn't a lot of spare RAM available, so large requests to use it – like wordfence would cause a 403 error because it it couldn't get enough RAM to do whatever it was wanting to do.

      Fixed finally. Pretty freaky that TS carried on working from reading. Not so hot on saving anything.

      The rsyncs and copies are in full overnight pulls. Hopefully all done before morning.

  8. Descendant Of Smith 8

    Not related to your rebuild but I thought interesting anyway.

    Son is just dealing with a few of these errors on different businesse's systems. Affecting email for some.

    The FIP-FS "Microsoft scan engine failed to load. Can't convert "2201010001" too long.

    YYMMDDhhmm formatted time exceed signed INT range.

    Seems 2022 is a problem not just 2000.

    Found a link.

    https://borncity.com/win/2022/01/02/microsoft-besttigt-exchange-year-2022-problem-fip-fs-scan-engine-failed-to-load-1-jan-2022/

    • lprent 8.1

      Oh dear. Who would code that into a 32 bit signed integer?
      If they'd done it in a 32 bit unsigned integer then it wouldn't be a problem until later.

      Hex 0xFFFFFFFF == Dec 4,294,967,295 (ie with a no signed bit)
      Hex 0x7FFFFFFF == Dec 2,125,483,647 (can be negative)

      Some dumbarse corporate programming fool obviously thought it'd be more 'efficient' to convert a string to a numeric to break it up. Which is stupid in the face of it. It is more efficient to split the string and convert the date elements because 2 string bytes at a datetime. That is a trivial conversion to date (see std c++ datetime), whereas converting 10 bytes at a time to a number is laborious, especially when you have to then split that number to get to a datetime.

      (reads article) Ok – Microsoft Exchange – figures. One bit of software that I swore I’d never recommend two decades ago.

Recent Comments

Recent Posts

  • World’s first algae-based local anaesthetic another step closer to reality
    A partnership between the Government and the Cawthron Institute has delivered a breakthrough in the production of a potent microalgal ingredient for the world’s first algae-based pain medication, Agriculture Minister Damien O’Connor announced.  “Scientists at Cawthron Institute in Nelson have developed a reliable and commercially scalable method for producing neosaxitoxin, ...
    BeehiveBy beehive.govt.nz
    22 hours ago
  • Ngāti Mutunga o Wharekauri and the Crown sign Agreement in Principle| Ka waitohu a Ngāti Mutunga o...
    Ngāti Mutunga o Wharekauri and the Crown have signed an Agreement in Principle marking a significant milestone towards the settlement of their historical Treaty of Waitangi claims. Ngāti Mutunga are based on Wharekauri/Chatham Islands and are the second of two iwi/imi to reach agreement with the Crown. “Today’s signing follows ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Further ACC reforms introduced to Parliament
    New reporting requirements on access to ACC Earlier access to minimum rate of compensation Refinement to ACC purpose to focus on supporting all eligible injured people to access ACC The Accident Compensation (Access Reporting and Other Matters) Amendment Bill which aims to improve access to ACC for all injured people, ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • Government supports Chatham Islands' resilience
    The Government is supporting the Chatham Islands’ resilience to extreme weather events and natural hazards through a grant to secure safe drinking water, Minister for Emergency Management Kieran McAnulty said. “Many households in the Chatham Islands lack easy access to drinking water and have been forced to get water to ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • New Chief Coroner appointed
    Coroner Anna Tutton has been appointed as the new Chief Coroner, Attorney-General David Parker announced today. Anna Tutton was appointed as a Coroner in January 2015, based in Christchurch, and as Deputy Chief Coroner in 2020.  After the previous Chief Coroner, Judge Deborah Marshall, retired Ms Tutton took on the ...
    BeehiveBy beehive.govt.nz
    2 days ago
  • DIRA Amendment Bill passes third reading
    The Government has passed an Amendment Bill today to support Fonterra’s move to a new capital structure and the continued success of New Zealand’s dairy industry. The Dairy Industry Restructuring (Fonterra Capital Restructuring) Amendment Bill will allow the Fonterra co-operative to make changes to its capital structure, as well as ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Minister Whaitiri to attend Food Ministers’ Meeting with Australian counterparts
    Minister for Food Safety Meka Whaitiri will attend the Fourth Australia and New Zealand Food Ministers’ Meeting in Melbourne on Friday. It will be the first time the meeting has been held in person since the Covid-19 pandemic disrupted international travel. “The Food Ministers’ Meeting sets the policy direction for ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • New Kiwibank parent appoints directors
    David McLean and Sir Brian Roche have been appointed as the first two directors of the newly incorporated Kiwi Group Capital Limited (KCG), the parent company of Kiwibank. In August, the Government acquired 100 percent of Kiwi Group Holdings, which also operates New Zealand Home Loans, from NZ Post, ACC ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Defence Ministers meet in Cambodia
    Minister of Defence Peeni Henare attended the Association of Southeast Asian Nations (ASEAN) Defence Ministers’ Meeting-Plus (ADMM-Plus) in Siem Reap, Cambodia. “The first face to face meeting of the ADMM-Plus members is an opportunity for me to highlight New Zealand’s position on key regional security matters,” Peeni Henare said.  “In ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Pay equity extended to thousands more social workers
    The Government will extend pay equity to all community and iwi organisations who employ social workers and receive funding from the Crown, Minister for Women Jan Tinetti announced today. We expect this will improve the lives of approximately 4,600 social workers. “This extension means thousands more social workers will be ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Taskforce set up to protect construction industry from product shortages & delays
    New ‘Critical Materials Taskforce’ will trouble shoot building materials shortages Focus on maximising productivity & cushioning businesses from supply chain risks Successful ‘Plasterboard Taskforce’ reshaped to include broader sector knowledge and expertise Will provide guidance, data and information to support builders, designers and business owners A new Critical Materials Taskforce ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Bigger ED, more theatres and more beds in new Whangārei Hospital
    A new emergency department with three times more space will be part of the first stage of a two-stage project to build a new hospital for Whangārei and Northland. The Government has today confirmed funding for stage one of the new hospital – an acute services building and a child-health ...
    BeehiveBy beehive.govt.nz
    3 days ago
  • Finnish PM to visit New Zealand
    Finland’s Prime Minister Sanna Marin, accompanied by Minister for Development Cooperation and Foreign Trade Ville Skinnari and a business delegation will visit New Zealand next week, Prime Minister Jacinda Ardern announced today. The two leaders will meet in Auckland. “New Zealand and Finland are natural partners. We share similar approaches ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • New recreational rules to support hāpuku and bass fisheries
    The daily limits on recreationally caught hāpuku (also known as groper) and bass will be lowered to a total of two per person in some areas, with a new accumulation limit of three per person on multi-day trips. Oceans and Fisheries Minister, David Parker said the rule changes would take ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Jobs for Nature enabling Mātāuranga Māori
    Mātāuranga Māori is at the heart of the latest tranche of Jobs for Nature projects set to promote biodiversity and reduce impacts of climate change on Māori land, Minister of Conservation Poto Williams says. Project work will include the creation of an ecological corridor in Tairāwhiti, protecting 60 hectares of ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Supporting resilient shipping infrastructure in Vanuatu
    The Government has announced further support to Vanuatu to assist in constructing climate-resilient wharves as part of the Vanuatu Inter-Island Shipping Support Project (VISSP). “Aotearoa New Zealand is committed to supporting the economic recovery of our Pacific region in a way that continues to provide growth and supports climate resilience,” ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Government welcomes High Court ruling on climate case
    The High Court has today confirmed the legality of the advice provided by the Climate Change Commission (the Commision) to inform New Zealand’s nationally determined contribution (NDC) and the first three emissions budgets.  Minister of Climate Change James Shaw says New Zealanders can have confidence in the Commission and of ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Government introduces changes to mining Act with stronger environmental focus
    ·         Crown Minerals Act will no longer actively “promote” prospecting, exploration, and mining of Crown-owned minerals ·         Will create more certainty around engagement between industry, iwi and hapū. The Government is proposing changes to modernise the Crown Minerals Act 1991 (CMA) to support more environmentally conscious management of resources, says ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Speech to Building Nations 2050 conference
    Tēnā koutou, tēnā koutou katoa. Good morning and thank you, Jack, for the introduction. I’d like to take a moment to acknowledge Infrastructure New Zealand Chair, Margaret Devlin and all the sponsors and organisers of this event for bringing us together in ‘Building Nations 2050’. I would also like to ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Better natural hazard information for home buyers
    Associate Minister of Local Government Kieran McAnulty has today introduced legislation to empower councils to share better information about natural hazards with the public. The Local Government Official Information Amendment (LGOIMA) Bill will make it easier for Councils to share clear and concise information in Land Information Memorandum (LIM) reports. ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • New Zealand welcomes visiting WTO Director General
    The World Trade Organization (WTO) Director General Dr Ngozi Okonjo-Iweala visits New Zealand this week. Minister for Trade and Export Growth Damien O’Connor said the WTO was essential to New Zealand as a small export-dependent trading nation.  “New Zealand’s economic security depends on our ability to trade. Our goods exports ...
    BeehiveBy beehive.govt.nz
    4 days ago
  • Faster, cheaper, better resource management law given first reading
    New laws that will deliver a faster, cheaper, and better resource management system had their first reading in the House today. The Spatial Planning (SP) and the Natural and Built Environment (NBE) Bills, which were introduced last week, will replace the 30-year-old Resource Management Act (RMA). Environment Minister David Parker ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Minister Sio to meet new Vanuatu PM
    Associate Foreign Affairs Minister Aupito William Sio travels to Vanuatu today, to meet with the new Government led by Prime Minister Alatoi Ishmael Kalsakau and to represent Aotearoa New Zealand at the Pacific Community (SPC) Ministerial Conference being hosted in Port Vila. Minister Sio will have a number of bilateral meetings with ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Driving ahead with the Clean Car Standard
    Following discussions with vehicle importers, the Government has confirmed the Clean Car Standard will be phased in from 1 December 2022, significantly reducing the CO2 emissions of light vehicles in New Zealand, announced Transport Minister Michael Wood. “Emissions from our light vehicle fleet are the single largest source of ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Speech to Constitutional Kōrero conference
    Our Evolving Sense of Nationhood – Me Anga Whakamua Indigenous Futures and New Zealand’s Constitution Tuia ki runga, Tuia ki raro, Tuia te here tangata, Mai i te wheiao ki te ao mārama Ka rongo te pō ka rongo te āo! Tīhei Mauri Ora! Kei ngā miro o te ao ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Rental sector changes to regulate residential property managers, clear up meth confusion and ease pr...
    A suite of measures to improve the lives of renters and landlords has been announced by Housing Minister Dr Megan Woods as the Government makes more progress on reform of the rental sector. “Nearly 600,000 households rent in New Zealand and these measures will result in regulated oversight of residential ...
    BeehiveBy beehive.govt.nz
    5 days ago
  • Further sanctions on the political and economic elites of Russia and Belarus
    Foreign Affairs Minister Nanaia Mahuta today announced further sanctions on members of the inner circles of governments in Russia and Belarus, as part of the ongoing response to the war in Ukraine. “Aotearoa New Zealand first moved against the powerful and wealthy in Russia with sanctions on political and economic ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Another step towards improved supermarket competition
    The Bill to trigger an unprecedented shake-up of the grocery sector and deliver New Zealanders a fairer deal at the checkout and help tackle cost of living pressures is ready for its first reading at Parliament. “The duopoly has now been given plenty of warning. If they fail to adequately ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Black Ferns to be celebrated at Parliament
    A public event and celebration will be held on Parliament’s lawn on December 13 to celebrate our Rugby World Cup winning Black Ferns. “The Black Ferns’ triumph at Eden Park is one of New Zealand’s greatest sporting moments,” Grant Robertson said. “They are extraordinary athletes, exceptional people and proud New ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Autism Guideline released by Ministry
    The release of the latest edition of the Aotearoa New Zealand Autism Guideline – He Waka Huia Takiwātanga Rau has been welcomed by Minister for Disability Issues Poto Williams today. The Guideline provides an opportunity to better understand and communicate best practices for supporting autistic people and their families and ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Speech to Aotearoa Refugee Hui
    Nga mihi nui ki a koutou, Welcome to the Parliament, your Parliament. It is great to see the community here in such numbers, and I am happy to be here with my parliamentary colleagues to listen and take part in the discussions today. I particularly want to acknowledge Ibrahim Omer ...
    BeehiveBy beehive.govt.nz
    6 days ago
  • Global climate talks underline need for domestic action
    Minister of Climate Change James Shaw marked the end of COP27 negotiations in Egypt by saying it was now crunch time for counties to step up and take urgent action at home. “Even though we have these international negotiations every year, our focus must always be on what we do ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Defence Minister visits Ukraine and Poland
    Defence Minister Peeni Henare has visited Ukraine and Poland, holding talks with his Ministerial counterparts. During the talks Minister Henare reaffirmed New Zealand’s unwavering support for the Ukrainian defence against Russia’s illegal and unprovoked invasion.   The visit  was a further demonstration of New Zealand’s ongoing support to the people ...
    BeehiveBy beehive.govt.nz
    7 days ago
  • Stuart Nash to attend OECD meetings
    Small Business Minister Stuart Nash will travel to Paris today to attend small business meetings with the Organisation for Economic Co-operation and Development (OECD). Stuart Nash will chair the OECD’s Digital for SMEs (D4SME) Steering Group meeting and the 4th Roundtable of the OECD D4SME Global Initiative. “The OECD’s Digital ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Human Rights Act enhanced to protect religious communities
    The Government will amend the law to make sure religious communities feel safe and welcome in New Zealand. After extensive consultation, with more than 19,000 submissions on six proposals, the Government will make one change to address incitement towards religious communities while asking for further work to be done alongside ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Defence Minister meets with UK counterpart and visits NZDF personnel
    Minister of Defence Peeni Henare held talks in the UK today with his counterpart, Secretary of State for Defence Ben Wallace.   The Ministers reiterated the importance of our defence relationship, and reflected on the strong historical and cultural ties between the United Kingdom and New Zealand.   Together, they ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Government takes action to reduce gambling harm from pokies
    The Government is announcing today changes to strengthen the requirements in venues which have pokie (gambling) machines to reduce the harm they cause people. “The changes focus on reducing harm caused by pokies, which can affect both those people gambling and their whānau. In short, they would make the ‘host ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • The Pacific business village comes to Auckland
    The Pacific Business Village (the Village) is now going to set up in the Auckland region, said Minister for Pacific Peoples Aupito William Sio. The Ministry secured $15.5 million in Budget 2022 to meet community demand volumes for services to support Pacific businesses and Pacific social enterprises across Aotearoa. “The ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Government’s health investments making a difference for New Zealanders
    Fewer New Zealanders say cost is a barrier to visiting a GP or getting a prescription. The number of children going hungry has halved over the past decade. Statistics show why the Government has made major investment in mental health. Official statistics released today show the Government’s targeted health investments ...
    BeehiveBy beehive.govt.nz
    1 week ago
  • Speech to the Asia New Zealand Foundation
    Kia koutou, warm pacific greetings.I am delighted we have the opportunity to meet kanohi ki te kanohi and talanoa in-person, I would like to extend my thanks to Adele and her team for organising this event, for us, today; fa’afetai tele lava.  I am also delighted to see some rangatahi ...
    BeehiveBy beehive.govt.nz
    1 week ago