That’s cool! I’m really interested to know how many tokens per second you can get with a really good U.2. My gut is that it won’t actually be better than the 24VRAM+96RAM cache setup this user already tested with though.

How much do you need? Show your maths. I looked it up online for my post, and the website said 1747GB, which is completely in-line with other models.

https://apxml.com/posts/gpu-requirements-deepseek-r1

Thanks!

Can you link that post?

Running R1 locally isn’t realistic. But you can rent a server and run it privately on someone else’s computer. It costs about 10 per hour to run. You can run it on CPU for a little less. You need about 2TB of RAM.

If you want to run it at home, even quantized in 4 bit, you need 20 4090s. And since you can only have 4 per computer for normal desktop mainboards, that’s 5 whole extra computers too, and you need to figure out networking between them. A more realistic setup is probably running it on CPU, with some layers offloaded to 4 GPUs. In that case you’ll need 4 4090s and 512GB of system RAM. Absolutely not cheap or what most people have, but technically still within the top top top end of what you might have on your home computer. And remember this is still the dumb 4 bit configuration.

Edit: I double-checked and 512GB of RAM is unrealistic. In fact anything higher than 192 is unrealistic. (High-end) AM5 mainboards support up to 256GB, but 64GB RAM sticks are much more expensive than 48GB ones. Most people will probably opt for 48GB or lower sticks. You need a Threadripper to be able to use 512GB. Very unlikely for your home computer, but maybe it makes sense with something else you do professionally. In which case you might also have 8 RAM slots. And such a person might then think it’s reasonable to spend 3000 Euro on RAM. If you spent 15K Euro on your home computer, you might be able to run a reduced version of R1 very slowly.

Literally only one of those is a legitimate political position. “Taiwan Independence”. And it’s a position you’re allowed to broadcast on RedNote if you show any sort of knowledge and tact.

Hong Kong was liberated in 97, and apartheid was slowly dismantled afterwards, and they’ll eventually be liberated from liberalism and then capitalism when it’s possible. Nothing platitudes don’t make that happen faster. If you care about the liberation of Hong Kongers, then do real political activism in Hong Kong with real policy suggestions.

What does remember Tienanmen Square 1989 mean? Because to me and any reasonable content moderator, it looks like you’re trying to say “People died, be angry!” as opposed to actually advocating or cautioning about anything actionable. Are you making an anti-CIA appeal? Anti-IMF? Pro-IMF? Pro-Mao? Anti-Deng? Are you trying to say “If the soldiers weren’t unarmed, we could’ve avoided bloodshed”? Because then you’re basically saying soldiers acting as police should’ve shot then innocent people, which is illegal. You’re advocating for violence, of course that’s going to be removed by moderators. Of course you’re not actually trying to say anything at all, because you are both politically illiterate, and because you know nothing of the event. Instead what you’re trying to say is “I’ve seen a lot of photos of tank man, and I heard the Chinese censored news about the gunfights, I am very invested in that act of censorship failing because my government told me to be”. That’s not advocating for anything, you’re just attacking the state, armed with rumour. Outside of China, in most countries, you’re allowed to do that. But that doesn’t make it not trolling.

Xi Jingping, the normal-skinned human is not a yellow bear. If you want to call Xi greedy or a messy eater or whatever else you imagine Winnie The Pooh communicates beyond a stereotype attacking all east Asians, then say that instead. Because otherwise it’s just going to look like you’re being racist, which should be removed.

Why when you want to demonstrate censorship on Rednote do you choose topics which legitimately should be moderated, if only for community vibes. Do you want ‘Free Speech Absolutist’ edgelords setting the tone for the platform?

What leverage does your boss use at work when they order you to do stuff?

I’ll give you a €10 gift-card to whatever popular online store you want. I ask for nothing in return. Absolutely no stipulations. The only thing is that you have to give me your credit card number and the expiration and the numbers on the back. I’ll just verify it’s real with a €1 charge (and then return the €1). That’s it. Not gonna do anything with the data. In fact, I’ll delete the data afterwards. Want €10?

Matrix, even if it was a siv, would be better than Signal, because it doesn’t know your phone and passport numbers.

The user’s library of apps are Windows apps. And Windows does support Linux programs. There are versions of Windows that don’t technically have it enabled by default, but it’s easy to install support. It has a built in command “wsl --install”, and a button in the store and start-menu. And for most users who get a pre-configured image from IT or their laptop manufacturer it’s pre-installed.

I really don’t get this community’s insistence on getting people to use Linux no matter how much destruction they bring. Steam games on Linux are not what anyone has in mind when they say Linux doesn’t have games. Because Linux isn’t binary compatibility, it’s libre software.

In my circles, if someone says “Linux such and such”, we assume they might be referring to their FreeBSD computer as well. Here it seems Linux is more likely to refer to Android. Emulating a sketchy Windows game doesn’t make Linux the better platform for games. The Windows games are always going to be best on Windows, and now your Linux computer has malware on it.

The models can’t do anything the inference library doesn’t allow for. So you shouldn’t need to worry about a rogue model if you’re loading it somewhere someone you trust can vouch for. If you’re worried about Ollama, you can monitor its network usage (and block it in your firewall). There shouldn’t be any network activity if you disable auto-update.

A capitalist is someone who owns capital, not someone who supports capitalism. A liberal is someone who supports capitalism. I don’t think Linus is a liberal, given that he’s the Linux guy. But he’s obviously a capitalist, and that’s okay, that’s something you should strive towards if you live under capitalism, even if ideologically you oppose capitalism.

thought-terminating cliché

There’s no argument, it’s the definition of the word. Why do you assume there should be argument around the normal usage of a word?

Someone should invade the USA and bring democracy.

They’re in this thread, from your instance. Just scroll up.

It sucks how Trump used his president-powers to do this.

Runke is the verb form. Runk is the noun form. You can say “en runk”.

Stringent purity test being someone not actively furthering genocide.

Sure, so swap it out with something that costs more than 3K.

• What if you want to buy a A100, it’s a graphics card for doing maths on your computer, it costs 5000 euro. Maybe I’m using it for my AI boyfriend and I think it’s embarrassing and don’t want anyone to know, or I’m making political cartoons with 3D software and need a lot of VRAM.
• Maybe I’m buying very many hijabs. Maybe I’m buying solar panels and don’t want to randomly selected to be bothered by the cannabis inspector or I bought a new projector explicitly to give to someone else, but I don’t want to be bothered by the telly license inspector – who at least in Ireland is allowed to invade your privacy and inspect your home looking for projectors. It’s not illegal to own a projector and not pay the license, it’s only illegal to connect and use a projector without paying the license. If you buy it as a gift for someone who already has some sort of screen and is paying the license, you haven’t done anything wrong and don’t deserve the scrutiny.
• Maybe I bought a statue and I don’t want the government to know who I idolise.
• Maybe I bought furniture and I don’t want the government to know in case the person who made the furniture turns out to be the wrong ethnicity or religion or political affiliation in the future.
• Maybe I bought a auto or bike to mod for use on my own property and don’t want the government to notify all the relevant patent holders “just in case”.