Yeah it was pretty crazy I’ve heard ram tends to go obsolete before it dies, but I do have a potential root cause, I did notice after hooking up the new motherboard that the side and back case fans weren’t plugged in, they were routed through a cheap case rgb controller board which must’ve fallen off the tape in the back side of the case, so I’m guessing thermals took them out and 1 just happened to survive(likely the one furthest from the CPU)
so this week I was getting ready for my workday when my Son tells me CraftyController is inaccessible, so I tried to SSH into the box that the service is pinned to… nada, dead. tried to power cycle it, nada.
now this node was a B450M-A mobo Ryzen 7 2700X platform with some hodgepodge scrap RAM I’ve had running in it(RAM birthday was 2019). I hooked it up to a mini monitor and a keyboard, but it didn’t post at all, so just a blue screen of no signal. unfortunately the B450M-A mobo didn’t feature POST debug lights, nor did it use QLED, it apparently relied on PC Speaker, and my machine wasn’t telling any tales. so since I had no real idea as to the root cause and after reseating the RAM and the GPU and fiddling with it got me nowhere, I got my partner to approve the outspend for replacement of the motherboard so that I could have actual Debug indicators.
Thursday the ROG B550-F Gaming WIFI II mobo arrived, as did the Ryzen 9 5900XT and the Nautilus 360RS cooler. I spent the evening assembling the mobo and CPU and the GPU, the RAM, and all the related wiring. figured I would do the Cooler the next day. Yesterday I got the cooler in place with some serious hardware acrobatics. I then fired it up and Yellow LED. DRAM issue, so I unseated all of the RAM, plugging in one of the hodgepodge sets(I had 4x8GB ram sticks) neither set worked, went to just trying a single stick. of the 4 sticks only 1 was able to get past the Yellow LED and into completed POST.
So the RAM was shot and I’m not going to run containers on a machine with only 8 GB of ram. so I ordered up some Vengeance LPX 2x16G sticks and they arrived this morning! I just finished slotting them and then wrestling with Gentoo’s understanding of where all the hardware was. it was a lot of fiddling with the gentoo kernel config, and installing the nvidia drivers, but after all of that was done, the system booted up successfully! I’ve now got it back in its residence connected up to the UPS power, about to shunt docker containers back to the newly improved machine with 2x the CPU capacity.
Was a wild ride, but the cool part of it was when the system shat itself it was part of a 3 node Docker Swarm and I had recently migrated to a NAS for persistence of my container data. though the other 2 nodes aren’t as overbuilt as this thing, so I did have to do some memory wrangling and disabling my lower priority services in order to restore service, but I was able to ensure all necessary services were able to run during the outage, and I got some learning in regards to a couple of the services that didn’t port as cleanly as I would’ve liked. all in all fun times in system administration! lol.
This is interesting as every call center I have worked or been involved with has always had metrics of hold times and a whole group of managers doing call forecasting and manipulating schedules to ensure a target of average hold times, average handle times, and average not ready states for their workers. I feel like HP is taking heat for something that every single company is guilty of. All companies want to encourage self-service, to the point of eliminating tools for agents to assist the customer, forcing them to refer the customer back to the app or website to complete transactions. Callcenter workers are a constant cost center and companies are trying anything to avoid paying.
This week I saw my 3 machine cluster flailing trying to stay online, digging around identified it as an issue with communication with my NAS. It was running NFS3 and so I swapped that to NFS4.1 and did some tuning and now my services have never been faster!
Same here, been using premium since it was bundled with google music when that was a thing. Aside from the creators sponsors, I never received a single ad as long as I was signed in properly to my account.
Everyday is a Linux party here! Been running gentoo for like 20 years on my server box, which has now grown a couple more boxes in swarm config and my wife’s machine is now mint.
For me I think I enjoyed 98, XP, 7 it was nearly Star Trek rules every other edition was ok. 7 was the culmination of the best of. But absolute shit ever since. Honestly wish I could just go back to 7 for anything that requires windows( I try to stay away from it whenever possible)
Funny enough I got 7 ultimate for free by having a Microsoft themed Tupperware party and using their party invite platform. They sent me a box with free copy and ms colored streamers and windows 7 napkins. I still have the napkins new and sealed. Had to take like 4 pictures with my friends around a laptop I think. Not a bad trade for the best version of 7. I don’t think they’d ever get people to do the same for the newer OS’s. 7 was one of the good ones
I run a swarm and the NAS~esque machine has its exportfs entries under /export so all my docker persistence data goes into /export/docks/<stackname>/<service>/<mount>
Guess it’s time to get some m.2 to SATA adapters
And a pain in the ass to get the power plug inserted especially in scenarios where you might need to pull power and reset power
I suppose the ecosystem enjoyer could just cut the part of the peel that is affected a rubbish only the affected portion. Still sucks though
I have this same setup, current strategy is I have automation in my n8n where I can fill in a form and if submits the dns addition to both piholes via api. I am considering alternatives but has worked alright for now
That’s fair, I was half asleep when I wrote it so probably the half that controls word rate was in that half that was still offline.
I started my descent into the depths of self hosting with an old phenom II black PC, I bought a bunch of HDDs and put them in a RAID 10 via mdadm and eventually learned my lesson about not using LVM on my Linux for my storage management. Having volume flexibility has helped immensely there.
I can echo some people’s recommendation of portainer though be careful as if you want to get into multi device docker management portainer has some limits on what you can do for free. I upgraded to their pro tier using their free promo for 3 instances, but then had 2 mini pcs dumped on me by my brother in law, which took me to 4 managed nodes which exceeded their latest limit.
I have since switched to dokploy managing my docker swarm, so considering this platform decision early can save some growing pains, dokploy also has built in management for traefik so it is pretty slick though I have been maintaining my own nginx proxy by hand(not even npm, just nginx and a bunch of service config files).
I definitely recommend pi.hole, something like AMP or crafty controller or some such if you want to host game servers on it still, duplicati is a nice web interface for creating timely backups of things, and supports a variety of cloud storage(I currently offsite to a backblaze B2 storage bucket which is AWS S3 compatible).
Blue iris I think is something I saw passed around recently for security cams, all the Arrs are pretty easy to setup once you get one of them setup. My one drive replacement ended up being own cloud, as I fought with nextcloud getting it setup the way I liked so had to pivot.
Link warden is a tool I have used for archiving websites and creating a shareable bookmark collection. Audiobookshelf and Calibre(plus calibre-web) make a decent way to manage audio and ebooks.
If you are sharing this server and its services with others I highly recommend getting some kind of SSO setup, I ultimately picked Authentik for this, it has great integration documentation for most popular services, now my family can access all my services without having 22 different passwords.
Outside of those recommendations I can recommend checking out some sites like selfh.st for some inspiration on the kinds of services you can run and figure out what your needs/desires are and do some A/B testing on some that operate in the same space to see which ones fit your needs better.
I can also say looking at the greeting pinned post in this community is pretty good as well to get some ideas. I posted my most recent list of services in there(though it is now 2-3 services behind since I am addicted and growing).
If your old gaming pc rig has a decent GPU in it you could also consider running Ollama and open-webui and host your own personal agentic AI. I really feel the sky is the limit when it comes to self-hosting.
Edit:added much needed paragraphing to my monolithic post so that they are better services with looser coupling.
I had tried a few distros prior to gentoo but the process of installing and using just felt like windows but off brand for a long time, 5 years later I am learning about this tinkerers distro that you compile everything yourself, that weekend I started with a stage 2 setup disk and brought everything online got comfortable with the emerge lifecycle and have never left since, though I am considering if I want to leave on my next reinstall, if that ever comes, I have heard horror stories about upgrading major versions of Ubuntu that I just don’t experience on gentoo, it’s just the Linux I have used for like 20 years and it has pretty much never let me down, only times it has shat itself on me was my own fault for not reading the newsletters about some major GCC upgrade or some breaking update
Hey all, I’ve been slowly building services on my server over many many years, starting with running a minecraft ftb server, to where I am now, which is 1 primary system(providing the network filesystem) and 2 auxiliary minipc systems my brother in law recently donated. I moved from Docker to Docker Swarm after getting those MiniPC’s and enjoying the added compute. Currently my swarm is running:
As I go about my day I’m always looking for new and interesting containers to run, and then scrutinizing if they fill a need, replace an existing service with a better version of the same service, or if it’s better off not implementing, then I pull them down. this has been a great experience in devops learning and the longer I work on the server the more best practices I put in place and the more I understand why corporate clouds have some of the practices they have. I look forward to poking around in this community looking to help and to find new containers to accrete into my platform.
Any of the major banks consider breaches as cost of doing business at their scale compared to smaller banks. My bank prides itself on never having a breach, and it is insufferable to develop code for, but I guess it’s the price of security
As someone who had to support resold Hughes net networking I can tell you that satellite internet is great at downloading large bulks of information, otherwise you run into a problem of physics, adding 88,000 miles of round trip to your internet connectivity(1 hop to space then back to Hughes network gateway on earth, then back to space and then to you) are going to be super latency, gaming is not recommended nor is streaming, it can also be hella spotty as any weather events at your location or at hughes(which I think is in North Carolina?) will impede the line of sight needed between the dishes. I’ve never heard a good experience with satellite.
The power supply is a bit on the older side it’s a TX650 gold. So it will probably be the next thing my platform sees in terms of update