Maybe I’m just sleep deprived, cynical, or thinking too deep into it, but I don’t even like how they are using the words “on-prem” throughout the article instead of simply saying they’re running local LLMs. Seems like such a weird choice of wording that is meant to subtly steer less informed people away from looking into alternatives to the subscription based LLM services, as most casual people wont associate it as the same thing and ignore it and move on. Even if that’s the correct terminology for that specific field, I feel like most people would just naturally say “Yes, we are running the LLM servers locally here” as that’s the only way I’ve ever heard people say it even online.
For a company “on-prem” might not mean the same as “local”. You might run them in your company data center or in a colocated server (rented space in a data center). In either of those cases, the data center might be physically close to you, but it could be on a different continent.
“On-prem” implies that the company has physical access/control of the server.
Ah okay thank you for clearing that up for me. Makes me feel a bit less crazy now haha it was a bit off-putting with the amount of times “on-prem” was used here!
“On-premises” as it refers to enterprise hw/sw, has been a phrase much longer than “local LLM”
Even though everyone moved to cloud, most companies keep some portion of their infrastructure on-prem, like prod env in the cloud and on-prem test env/backups, or vice versa
Maybe most consumers wouldn’t recognize the phrase, but industry professionals certainly would
Maybe I’m just sleep deprived, cynical, or thinking too deep into it, but I don’t even like how they are using the words “on-prem” throughout the article instead of simply saying they’re running local LLMs. Seems like such a weird choice of wording that is meant to subtly steer less informed people away from looking into alternatives to the subscription based LLM services, as most casual people wont associate it as the same thing and ignore it and move on. Even if that’s the correct terminology for that specific field, I feel like most people would just naturally say “Yes, we are running the LLM servers locally here” as that’s the only way I’ve ever heard people say it even online.
For a company “on-prem” might not mean the same as “local”. You might run them in your company data center or in a colocated server (rented space in a data center). In either of those cases, the data center might be physically close to you, but it could be on a different continent.
“On-prem” implies that the company has physical access/control of the server.
Ah okay thank you for clearing that up for me. Makes me feel a bit less crazy now haha it was a bit off-putting with the amount of times “on-prem” was used here!
“On-prem” is the Enterprise IT antonym term of “cloud”, as in public cloud, aka hyperscalers (AWS, Azure, GCP, OCI).
“On-premises” as it refers to enterprise hw/sw, has been a phrase much longer than “local LLM”
Even though everyone moved to cloud, most companies keep some portion of their infrastructure on-prem, like prod env in the cloud and on-prem test env/backups, or vice versa
Maybe most consumers wouldn’t recognize the phrase, but industry professionals certainly would
It was written by Claude