🏅 Top traders

This should have resolved YES before the question was asked if writing tools counts as LLM integration as it can run on an M1 chip.

This was about new hardware, not software updates...

@PaulBenjaminPhotographer new macbooks come with with an llm installed that you can run locally and it's built into apple intelligence

@PaulBenjaminPhotographer Writing Tools was added in MacOS Sequoia, in 2024, over a year after this question was created. It's an integration that did not exist when the question was written, and new MacBooks come with it built in.

What significant update has happened since 2024? Which features need a processor more modern than an M2?

If anything more is being done in the cloud now than then...

@PaulBenjaminPhotographer The update was adding this feature at all. When the question was written, there were no built-in LLM features on MacBooks, and there are now.

For an analogy, the iPad used to not have a calculator app until iPadOS 18. If there had been a question written "Will Apple release an iPad with a calculator integration built in" before then, it would be reasonable to resolve it YES when the calculator app was added, even though it works on older iPads and didn't require any new processor.

@Gabrielle It would indeed have been reasonable to resolve it when the calculator app was added.

Not 18 months later...

@mods This will need to be a mod resolution as FUH deleted their account. Should be an easy YES, see my comment.

@Gabrielle A while ago david? said they were giving all of FUH's markets to me to resolve since he was gone, so I just resolved it yes

@jacksonpolack Thank you both for being attentive to this entire class of markets!

This seems like a clear YES to me - on my M3 Macbook, with internet disabled, I can use the "Writing Tools" to do things like "Summarize", "Make Friendly", or "Proofread", which use a locally running LLM.

Apple's documentation: https://support.apple.com/guide/mac-help/find-the-right-words-with-writing-tools-mchldcd6c260/mac

It's not a chat interface, and it's not an extremely powerful LLM (after all, it's running locally on a laptop), but it's pretty clearly a built in LLM integration.

Even beyond that, there's also a feature with the Writing Tools called "Compose", which calls out to ChatGPT. This is undoubtedly an LLM integration that is built into the OS, albeit running on a remote computer.

@Gabrielle Writing tools was launched in 2024 and can run on any Apple Silicon chip.

Hardly a MacBook launch...

I'm confused. This question has no specific answer at all because this is already true in many different ways. Can we get any kind of clarity at all? I can run GPT-2 on the NPU. Is that built in?

@Kearm20 Ah, dang it. The user is deleted.

Judging by the dynamics of the processes they will no longer have time, unfortunately.

The question is extremely ambiguous

Does this mean:
1. Siri works with an LLM? (it already does on macOS Betas, an Apple Intelligence model + chatgpt)
2. API access for developers? meaning you can do 'llm "who is the CEO of apple"' or something like that via API and the answer comes from an Apple model (local + Apple Cloud + ChatGPT) with Apple doing all the routing and stuff?
3. Will Apple support LLM "integration" by providing access to the neural engine/gpu/cpu? (it already does).
4. Something else?

I really hope it's 2; in which case I would bet against.
If 1, then yeah, sure, Apple will have LLM integration (it already does!)

I don't get it

LLM integration is a software thing right? It can't be "integrated" inot a device

Unless :

A neural engine counts (in which case this is quite low) or

An analog processor with fixed weights is required (in which case this is really high)

Apple is working on several models of generative AI. In the coming year, the Siri team independently intends to integrate LLMs into its voice assistant. In line with Google's aim to enhance its voice assistant, this would enable users to automate complicated activities using natural language. Apple believes that GPT 3.5 from OpenAI is inferior to its advanced programming model, Ajax GPT.

@Priyadharshu Thank you for you insight but I believe there should be more data supporting your answer. It is true that Apple is investing in AI and in machine learning models. https://www.computerworld.com/article/3706472/wwdc-2024-is-apple-on-the-road-to-siri-20.html

Even if there is no data that supports the concrete actions of Apple towards the building of a MacBook with LLM integration, it is important to mention the impact that AI is having in economic terms. According to McKinsey, AI will add "the equivalent of $2.6 trillion to $4.4 trillion annually. This would increase the impact of all artificial intelligence by 15 to 40 percent". This means that the value that AI and large language models have in different industries such as retail can support the theory of Apple being working on AI technology. https://www.mckinsey.com/capabilities/mckinsey-digital/our-insights/the-economic-potential-of-generative-ai-the-next-productivity-frontier

Apple's slow to jump on things, but by 2025 they will probably replace Siri with an LLM which would count

@ShadowyZephyr I hope