YarrMatey(she/her)

Thing is, my specs are really good. Again, my laptop is a beast and it ran like 100% CPU, 100% GPU, and 100% of my 64gb of DDR5 Ram! Seeing it and how hot it made my computer

Local llm usage depends on your VRAM, your GPU. It sounds like you tried to run a model your laptop can’t handle. If you also need your RAM, then it is going to be super slow no matter what. The number each model has is important to determine if your GPU can handle it, also the quantization. If you run something significantly smaller like 2B* rather than say gemma 31B, then a laptop might be able to handle it. Your laptop is not a beast (for LLM usage) unless it has more than 24 GB of VRAM on it so don’t assume you can run any model on it. Look for smaller numbers with quantization. Running a local llm for me on my desktop is similar to running a video game, it doesn’t slow to a crawl or cause 100% on CPU or RAM because only the VRAM is touched.

*or 4B even, just depends on your GPU

Blahaj does remove calls to violence imo. He had additional petty reasons like how blahaj gave A.N. an endorsement saying “well-moderated” after the previous A.N. admin in question was no longer an admin.

Sorry I should have double-checked your account before replying. Anyway, I will continue picturing your hateful religion as hateful.

Do you want to call Muslims slurs? What about engage in antisemitism? What’s the real drama going on with you? I don’t picture straight white cis men when I think of christianity, I picture hateful republicans.

*Nevermind, you posted religious crap in atheist communities on lemmy and previously asked why catholics and the catholic church aren’t respected on lemmy. No gods, no masters.

Same here, we’re left with AirVPN at that point.

My recommendations have been:

1. Need port forwarding? ProtonVPN or AirVPN.
2. Don’t need it? Mullvad.

Edit: Just learned Mullvad’s founder is funding racist far right crap. New recs I’ve found:

1. Port forwarding: AirVPN or crpytostorm.
2. Don’t need it? IVPN.