Hacker News
Apple has new Mac app coming to make running local AI models easy
pen2l
|next
[-]
Distillation works: we can get models leaner, have better performance with lesser and lesser parameters, more efficient, running locally. Apple gets this and we'll see the result with M7 Max/ultra chips and I reckon this will be one of the titular apps when M7 line of chips are introduced.
I guess it explains the haste Anthropic and OpenAI are in to IPO, cash out and leave the the retail investor holding the bag.
n_u
|root
|parent
|next
[-]
Right now 128GB MacBook is the top of the line and you could do Qwen 3.8 Flash or similar.
There is a rumor that the M7 chip can use 1.5TB of memory which would imply Apple is aiming for more memory on devices.[1]
Would that imply the entry-level MacBook will have 128GB and top of the line models could run larger reasoning models? Then the question is price and if any of this will translate to iPhone for on-phone models.
With how expensive memory is, IDK if they can pull this off but I hope they do
[1] https://www.tomshardware.com/tech-industry/semiconductors/ap...
toufka
|root
|parent
|next
[-]
If Apple, in 2030 has a compute product that a worker can BYO(X) to work that has 2TB RAM, with an encrypted personalized context that can float between agents, then they will be in a very interesting place.
detourdog
|root
|parent
|previous
[-]
nomel
|root
|parent
|next
|previous
[-]
Where I am, it's cheaper to purchase multiple claude subscriptions than it is for the power bill from running a local model. Factor in the hardware costs, and you're looking at a break over a decade in the future, for comparable cloud models. Yes, there's privacy, etc, but now you're down into fractions of a percent of users who care about the government reading the memory of their computer.
api
|root
|parent
|next
|previous
[-]
It's not comparable to huge models of course, but given the power/size ratio here it shows that serious gains are on the table for models that can run fast on a high-end laptop.
cyanydeez
|root
|parent
|next
|previous
[-]
bigyabai
|root
|parent
|next
|previous
[-]
Factoring in the increased cost of memory, Apple's threatened service revenue and the stagnation of ecosystem products like the Mac and iPad, I think they have a really challenging future to navigate. The whole "sell people a B2C ecosystem" business model is more threatened than ever.
jedbrooke
|next
|previous
[-]
This seems like the main way it would differentiate itself over existing solutions like LMStudio etc.
gizmodo59
|next
|previous
[-]
simonw
|next
|previous
[-]
There's a name I haven't heard in a long time! Claris (always an Apple subsidiary, since being founded in 1987) renamed themselves to FileMaker in 1998, but apparently they rebranded back to Claris in 2019.
Looks like they've mostly just released annual upgrades to FileMaker for the past decade, but they did add MCP to it last year: https://www.claris.com/blog/2025/why-mcp-matters-for-claris-...
liuliu
|next
|previous
[-]
zf00002
|next
|previous
[-]
w10-1
|next
|previous
[-]
detourdog
|root
|parent
[-]
MBCook
|next
|previous
[-]
They desperately need to fix that.
myphpgothacked
|next
|previous
[-]
Users will praise it still. What's the phrase, Apple distortion field?