Or… honestly, just pay $40 for basically unlimited usage for a year from an API, then roll your own frontend.

Can you clarify, what you mean by this? Rent a VPS? Or is there a legitimately good place that’ll offer “unlimited” llm api access for $40 / year (and would you have any sort of privacy with this)?