I figured most of you could relate to this.
I was updating my Proxmox servers from 7.4 to 8. First one went without problems. That second one though… Yea, not so much… I THINK it’s GRUB but not sure yet.
Now my Nextcloud, NAS, main reverse proxy and half my DNS went down. And no time to fix it before work. Lovely 🤕 Well I now know what I’ll be doing when I get home.
Out of morbid curiosity, What are some of ya’lls self hosting horror stories.?
Oh man, I empathize with you. Sometimes your self-hosted services go down at really bad times and you just don’t have time to fix it in the moment. Then the fact that its broken starts nagging at you throughout the rest of the day. Hope you get your stuff back up without too much fuss.
My current horror story is that my QNAP TS-453 Pro NAS that was hosting my Jellyfin and Nextcloud shut off on its own several weeks back and then refused to boot up. Turns out there’s a known manufacturing defect in the Intel J1900 chip the NAS uses that causes clock drift and every TS-451 and TS-453 NAS that was ever sold is basically a ticking time bomb and it was my time to get bit. QNAP never issued a recall even though they knew about the issue and is refusing to help customers affected by it. Now I am hoping that I can use the resistor fix in that forum post to briefly revive my NAS so that I can then backup all the data into a DIY NAS that I am still ordering parts for. Picked up some good deals but man DIY is still expensive. Hopefully, it’s worth it as I never want to use turnkey solutions again after this experience.
This was a loooot of pcs affected by that one. Synology was also hit for example.
The fact that QNAP knew about this and didn’t warn their customers would cause me to boycott them for life. This isn’t just like a gaming PC. This is a NAS. Some peoples entire lives are on there.
There are lots of reasons to avoid QNAP but that’s rough.
So glad I went DIY with Ryzen and Unraid
My first power outage was a very bad experience since I was absolutely not prepared for it.
I have no ups since the grid is very stable in here (it’s been the one and only outage in 5 years). The outage was short but I had forgot to activate the option in the BIOS of my server to power on when plugged in. So my server stayed shut down after electricity was restored. Of course, I happened to be away for the whole week when this happened with no way to access my server physically.
This is the event that made me learn about and start using a KVM that I can use remotely.