Also note Apple’s, AMD’s and NVIDIA’s (Spark) unified memory solutions for local LLMs/agents. AMD advertises 300B and NVIDIA advertises 200B models running locally. The question is whether Anthropic/OpenAI are going to be relevant at all in the future, with local models becoming increasingly capable and affordable. However: There are rumors the Chinese government wants to restrict access to its models. Not set in stone and also not sure whether this is true. Could this entail no more access to new open-source models? Who knows. But even then, energy and resources are going to be a bottleneck. I have not looked into the concrete numbers and this is not my field of expertise, but I find it highly unlikely that they are going to be able to capture the entire market.
Also note Apple’s, AMD’s and NVIDIA’s (Spark) unified memory solutions for local LLMs/agents. AMD advertises 300B and NVIDIA advertises 200B models running locally. The question is whether Anthropic/OpenAI are going to be relevant at all in the future, with local models becoming increasingly capable and affordable. However: There are rumors the Chinese government wants to restrict access to its models. Not set in stone and also not sure whether this is true. Could this entail no more access to new open-source models? Who knows. But even then, energy and resources are going to be a bottleneck. I have not looked into the concrete numbers and this is not my field of expertise, but I find it highly unlikely that they are going to be able to capture the entire market.