• 0 Posts
  • 497 Comments
Joined 3 years ago
cake
Cake day: July 29th, 2023

help-circle

  • mlg@lemmy.worldtoFuck AI@lemmy.worldNo good outcome here
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 days ago

    People replying to this with “muh enterprise” don’t understand that I can still plug in a Supermicro server with the correct power input, spin up Linux, and do whatever the hell I want with my giga ultra 8x NVlink GPU 2X Xeon CPU morbillion dollar server.

    Now even though it will be sold for a measly couple thousand dollars after the collapse, it doesn’t mean I can’t burn through my unemployment savings to have fun lol.


  • GitHub gets autoscanned by thousands of malicious actors for keys and credentials on every commit, including the comments lol.

    The fact that CISA themselves never saw an automated breach attempt only minutes after pushing to github is the more interesting story here.

    Either the contractor is so incompetent that they didn’t have any logging set up and the breach went completely unnoticed for 6 months.

    Or this really is some fat honeypot that they won’t admit is a honeypot because they’ve been using it to watch or bait APTs.

    Currently, there is no indication that any sensitive data was compromised as a result of this incident

    This is literally impossible unless it really was a honeypot. You can demo this yourself in real time. Make a throwaway cloud account on your favorite provider, commit the cloud auth token into a repo, and you will see an automated bot login within minutes.

    Commiting any secrets to a public repo should just be considered auto compromised because of how potent it is.

    That stuff ususlly gets exposed via poor CI/CD permissions where credentials are required, but straight up file commit is like publicly announcing exactly where you left your house keys lol.



    • Anything that you can shove hardware into (CPU, RAM, HDDs, maybe a PCI slot), so any used workstation is a great start, and don’t bother splurging initially, just follow the quality tool rule and only buy when something becomes inadequate. If you want to jump straight into loud and noisy severs, you can pick up used servers for cheap like R730s which there’s a ton of out there. Just avoid 2.5" drive bays because 3.5" HDDS are way cheaper per Gb.

    • Would recommend podman over docker as its matured to the point where it has a lot of better features like rootless, quadlets, etc that you might want to take advantage of in the future. OS is whatever linux you prefer, but I recommend you stay away from Ubuntu. If you want something RedHat but not as cutting edge as Fedora, I’ve heard OpenSUSE is pretty nice.

    For apps, If you want to do HTTPS via GUI then npmplus is nice option, Otherwise caddy can do the same with text config. Rest is whatever you want to try out :)

    EDIT: If you start making an *arr stack, I would recommend recyclarr to handle the quite expansive content filter settings for sonarr and radarr.


  • I hate to break the news but the issue with Bitwarden is that the client sucks total ass, and there are no drop in 3rd party replacements for the browser plugin.

    Been running Vaultwarden for a while now and even though the sync implementation is nice and clean, it’s just not worth the end user experience.

    This is really dumb when compared to literally every other password manager, open source and enterprise which does a much better job of actually being a password manager and not a glorified encrypted text file.

    I’m eventually going to switch back to KeePassXC and just suggest setting a master password with Firefox’s builtin password manager for everyone else who just wants a painless user experience and not have to deal with syncing vaults.



  • NIMBY is usually more to do with perceived loss in value though no?

    People don’t want AI datacenters because they are directly offloading energy costs to neighborhoods via substantially higher power bills. Which is happening because the demand is so high, they can’t compensate by building more power sources in the same time frame.

    That and the poor reception to the AI market, which is wrecking jobs, the economy, etc.

    Otherwise, datacenters were pretty well known for being built with very little resistance before this, especially since lots of providers, like Google, would fund geopower sources to power their datacenters which would add power to the grid with surplus.






  • I’m curious but has anyone’s business/employer actually bought or used these off the shelf “AI” solutions that are all running the same cloud model with a fancy system prompt + frontend?

    Because I really have only seen ChatGPT, Claude, or sometimes Gemini in enterprise.

    Actually for that matter, I don’t even know anyone personally who tried any of the ad spam ones from the superbowl.






  • There’s the MTT S80 (First PCIe Gen 5 GPU lol) which is the consumer grade version of Moore Thread’s enterprise GPUs like S4000, but the problem is that they trade off super cheap VRAM and PCIe bandwidth for low compute power compared to even antiquated stuff from Intel, AMD, and Nvidia.

    They’re actually a great choice if you want to run AI/LLM stuff for really cheap, and Moore threads has their own CUDA knockoff called MUSA which iirc does have support in the various LLM backends available. Back when they released, it was going for something like $160 in China and ~$200-250 online. Could easily pool the VRAM, though finding a mobo+CPU combo with enough PCIe lanes to spare meant you’d most likely not be taking advantage of more than maybe 2 or 3 cards in one tensor parallel split.

    China’s domestic processor production is still catching up, so even though they have access to high speed RAM and all the latest standards, they don’t have the cores to match.

    Their last KX7000 x86 CPU was comparable to a skylake i5 or i7, but just with newer standards like DDR5 and PCIe gen 4. So they’re about 7 years behind based on that estimate.



  • laziness about having to go through and reinstall everything on a clean install

    Package managers make this a breeze to the point that people upload their personal script to github so they can run one command to get all of their software and theming on a new PC lol.

    No need to even go that far, just pop open the app “store” (everything is free lol) and just click away at everything you want. Can probably get most of your stuff in 10 minutes tops.

    What even are the significant differences with different distros?

    It boils down to how effective the user experience & preference is and what the backend is built on (which usually affects user experience & preference lol).

    Mint is highly recommended because it cleans up a ton of the random stuff from Ubuntu upstream and maintains a clean and low cost (cpu/ram usage) desktop environment that’s very easy to use. It’s highly recommended for anyone who is new or inexperienced with linux or OSs in general and just wants to get on with life. The single downside is that its packages are not the latest and greatest, so its great for everything except gaming where you want the new stuff like drivers, proton upgrades, new features, etc.

    Fedora is what Ubuntu was 15 years ago, which is best all around user experience. It chooses very sensible but cutting edge packages which gives you excellent performance benefits of new tech like BTRFS/XFS without losing out on stability. It’s also the distro Linus himself uses because he finds it easy to just install and again, get on with life lol. Fedora also has excellent user docs and forums which is great if you need help with something. Only downside is I think you have to flick a switch (or run a command) to enable all video codecs because they don’t ship it on their main package repository since H264 & HEVC have weird licensing issues.

    Bazzite is a downstream of Fedora Silverblue, which is an atomic distro that makes it really hard to screw something up by using a read only root and rollback-able updates, similar to Android and SteamOS. It was specifically designed to make gaming on handhelds an easy out of box experience so you don’t have to manually set up stuff like touchscreen keyboards or power settings on non PC hardware. You can run it on PC if you’d like the benefit of the rollback image system which can unbork your machine super easy, though it already is quite hard to bork because the root filesystem is read only, so apps are installed in a similar way as Android apps (Flatpak).


    Learning Linux is actually quite intuitive (thankfully), and everything from the GUI perspective is mostly the same, if not an outright improvement in several areas. I would highly recommend playing with the live install of whichever distro you pick along with the desktop environment to get a feel for how it looks before you commit to an install.

    Desktop Environments are also not tied to distros. You can basically choose any DE on any distro (like Mint’s Cinnamon on Fedora), but the two biggest ones are GNOME (Mac like) and KDE (Windows like). I think KDE is way better than GNOME, but you can play with both & more to see which one you prefer.

    Your main issue to figure out when permanently switching is if there is any software or process that you rely on in Windows that would be different in Linux. For me it was switching from Microsoft Office to LibreOffice (there are also more, like OnlyOffice), which was completely painless since it was like 95% the same and could open up docx just fine.

    The other possible ones could be:

    • Adobe stuff (some stuff like PS works, but it’s a bit involved to setup the first time)
    • Games that use kernel level anticheat (big nono in linux because it breaks security)

    The second one is really what’s keeping a lot of people from making a permanent change which I’m hoping Valve can change with the upcoming Steam Machine because even for Windows, its like running a rootkit that really should not have that level of access to your PC.

    I don’t play any games that utilize it, but you might and it won’t work on linux until the publisher decides to let it: https://areweanticheatyet.com/. The comments are usually outdated back from when the game first released, so as long is it’s green or blue, it should run out of box.

    Some publishers (Epic Games mostly) are also just dicks that don’t use kernel level in some games but still choose not to enable linux support when compiling their game, despite all the major anitcheat vendors supporting linux and even mac.

    The good news is that for everything else, there’s a pretty good chance you’ll actually see an increase in performance from Windows. The biggest one for me was World of Warships which went from 2 minutes load times down to just 30 seconds on a hard drive, and about 15-20%+ FPS even when on an SSD.