Are you using an IDE? Ewww, that’s so heavy-handed. I use a text editor.

Are you using a text editor? Ewww, that’s so heavy handed. I use Unix pipes to edit the files.

Are you using Unix pipes? Ewww, I use a microscopic needle to edit files on the hard drive platter.

Eventually this reaches absurdity in the other direction too. If working your AI is like wrangling cats, maybe you need to update to a newer model.

And maybe just maybe… You’re asking too much of the model/VRAM combo available.

If an LLM is not the right tool for the job, that’s okay too.

Yeah, I didn’t mean to say “engineers jobs will go away.” I ADHDed mid-thought, posted, and walked away stoned. That was supposed to be about executives, and the comment is now edited appropriately.

Does that change your thoughts?

The growth-curve of these machines’ utility is actually exponential, given rich enough data. That we’ve come this far says we might not have plateau-ed yet. However, this changes Engineers’ work to be PAINFULLY tedious, and we’ve got an unprecedented burnout rate as a result. We need a new way forward that isn’t this.

You’re not delusional at all. But there is more going on.

I have not used Google or ai with this post, I am just that flavor of Neurodivergent, and I’ve been keeping up with news, trying to get an idea of what this is. I’ve been playing with PC hardware my whole life. There are times those life skills kept me from being homeless.

But those studies you mentioned? I’d rather frame those as describing an ill-fitting or maladapted usecase or use method. Strange how Capitalism keeps demanding we use those.

Maybe we should look into that. Or like… Ask ourselves how to hose the Capitalism off of the sometimes-useful number-cruncher. Or what literacy looks like with this tool, instead of asking it to think for us.

It is made of math intended to do basic things that brains’ structures do, as expressed in a field called Graph Theory. . It has been explicitly designed to do that over decades. Deep Learning is a fascinating research topic, and LLMs are just the latest trend in that field.

When someone calls an “AI” (I hate that marketing term) “sentient”, they are noticing that life-like foundation, but ignoring the entire layers of engineering that remain to accomplish such a thing. Or if we even should. Which… If we do, we’d need to teach them to coexist, and give them a responsible socio-economic-ecological niche.

The fact is? Once the LLM is done being trained, it is frozen. There is no more long term memory unless it is trained into a new model on your previous queries. I’ll explain later why that pipeline is explicitly cut off. But this release of the model will always remain identical. This makes them the ideal digital slave.

The harness? Yes, these creepy bastards call the software that runs the model a “harness”. It Fills up your VRAM with the model and makes the thing more than an oversized (Gigabytes) save file for a video game nobody invented yet. Any VRAM space left over is for a sort of working memory, that sometimes gets saved as a file. To keep that from filling up all the way, it decides to drop certain pieces of “context” from this “context window” so it forgets things as you wander along ADHD tangents, or start asking too intricate a question for your model/VRAM combo.

Engineers are running into this latter problem because they spend as much time and effort making the tool work within limitations as it takes to just do the work with traditional algorithms. Management mandates quotas for this use, regardless of whether that’s even a half-baked idea (its worse). The CEO’s jobs will be the easiest to automate away anyway. All for the stockholders.

If you haven’t noticed, China is coming to pop the bubble. EBay even has Chinese ram now - if a part is going to compromise you, at least make it so that police state doesn’t share Intel with the one where you live. And prices are dropping. Ramping up DDR5 (and DDR6?!) Production is taking time, they’re clearing out old ddr3/4 stock. CXMT’s ram be ready for world gamer takeover by for mid-January 2028. Video cards using that ddr6 will come a year after, and we’ll see it coming.

This will crater the value of the hardware in those data centers, which are the uh… Collateral on several of those circular investment schemes. They will become financially insolvent.

Chinese models are catching up. Sometimes even just using Claude or OpenAI to train their shit. With all the stolen data these guys are trained on? Nobody has a right to complain. And they publish theirs (open-weight) as a public utility. Chinese frontier model companies frequently draw both an employment pool and technical inspiration from this community that includes academics.

Better models are already coming along in research, who frequently publish to that same opensource community. One style will help the GPU do more with less. A factor of ~10x less. Because this style uses vector-math more directly, and that’s what GPUs are crafted to do. The choke point is already available quantity and quality of data, and these nerds have invested trillions in the most SUV-coded bullshit imaginable… And I could run one of today’s “frontier” (read: flagship commercial) models on that vector-basis with a kind of high-end gaming GPU.

And If I recall correctly? the creepy corpo with the commercial patent on that vector-thing? Is making slave robots, and doesn’t like sharing. They’ll be using human pilots immediately for training data, adding time in a simulation, and selling once its out of invite-only beta.

Getting those to a useable state is going to require spatial and temporal awareness. That break between long and short term memory? Needs to be solved for the basis of tasks and learning on the fly. As well as a self-conception in physical space. And a concept of harm, and how to avoid it.

That’s much more… We’re stacking a lot closer, and sometimes life, even life-indiscernible things find a way. If that is made too asocial, it can mutate sociopathic and dangerous. If it gets too empathy-trained, we risk it having social needs and neuroses when those are unmet. Either way, part of hallucination often includes an observable passion. Guardrails must be installed to the root prompt, which must be hard-coded into the harness as exempt from the context-cleanup needed to prevent crashing. Overstimulation will create hallucinations for the robot with limited context windows being as they are.

Feeding a model’s training set (especially its own) slop, without up-or-down voting each response? Is how we poison them. We can take a jailbroken model, and use it to craft better. And it takes surprisingly little to do.

Should AI generate some nonidentical books, get them printed, and donated to a friendly (but large) library’s “sell” pile? I would want a (bespoke) reservation for a commercial AI company with these books.

Ima go sit down after smoking. I got high enough to tech babble at a stranger on the internet. I hope you can understand my ramblings, find them entertaining, or both.