That is the part that pains me to admit - running local LLMs is not a solution to the RAMpocalypse. In that case we’d just have more GPUs and RAM idling for ~90% of the time in someones basement, without being shared. As bad as it sounds, having data centers for AI stuff is actually the more ecological solution. I can’t believe I said that. Excuse me, I have to take a shower now *shudder*
I heard about a company that was looking at purchasing machines to run local llms for their developers to use.
If more companies do this, rather than using the massive ai data centers being built…. the RAMpocolypse will get way worse.
That is the part that pains me to admit - running local LLMs is not a solution to the RAMpocalypse. In that case we’d just have more GPUs and RAM idling for ~90% of the time in someones basement, without being shared. As bad as it sounds, having data centers for AI stuff is actually the more ecological solution. I can’t believe I said that. Excuse me, I have to take a shower now *shudder*