Apple has recently overhauled its entire M-Series chip plans, scrapping the launch of the M6 Pro and M6 Max processors and jumping straight to the M7 series. While the base M6 SoC is expected to launch, Apple is moving into the M7 series without the M6 Pro/Max variants, with plans to offer some...
There’s going to be a massive boom in local llms if we get there. Already I have replaced ~80% of my paid token usage with a small local model running on my 64gb macbook pro, but being able to run a full-fidelity multi-hundred-billion parameter llm locally would be a game changer for my use case at least.