Posts under Machine Learning & AI topic

Post

Replies

Boosts

Views

Activity

.messages.message reaction field type vs. error from macro
The documented template for @AppEntity(schema: .messages.message) at Integrating your messaging app with Apple Intelligence and on the MessagesEntity.message reference page shows: var reaction: <#ReadReaction#>? with <#ReadReaction#> rendered as a placeholder (the Xcode placeholder syntax). A natural reading is "fill in your own type that you want to use here". I tried several: Tapback? where Tapback is @AppEnum(schema: .messages.customReaction) MessageReaction? (same, renamed) MessageReaction? with manual AppEnum conformance (no schema decoration) AttributedString? AttributedString (non-optional) field omitted entirely Each variant produced one of: error: Property 'reaction' type does not match required AppSchemaEntity property type 'ReadReactionCases:(Schema<Tapback> | AttributedString)' error: Required AppSchemaEntity property 'reaction' must be optional error: Missing required property 'reaction' from AppSchemaEntity 'messages.message' The phrase ReadReactionCases:(Schema<Tapback> | AttributedString) is opaque — ReadReactionCases isn't a public type, Schema<Tapback> isn't constructable from outside, and the documentation doesn't mention @UnionValue in this context. The actual working pattern, which I only found by downloading the UnicornChat sample and reading MessageEntity.swift, is: @UnionValue enum MessageReaction: Sendable { case customReaction(CustomReaction) } @AppEnum(schema: .messages.customReaction) enum CustomReaction: String, AppEnum { case sticker static let caseDisplayRepresentations: [Self: DisplayRepresentation] = [ .sticker: "Sticker" ] } Two suggestions: Update the schema-template comment in the docs to either name MessageReaction explicitly with a @UnionValue annotation, or include a one-line note: "The reaction field is a @UnionValue enum wrapping the customReaction schema enum — see UnicornChat sample." The current placeholder <#ReadReaction#> plus the prose suggesting "you can generate the properties... with the @AppEntity(.messages.message) Swift macro" reads as if the developer just supplies any AppEnum-conformer. Improve the diagnostic. Property type does not match required AppSchemaEntity property type 'ReadReactionCases:(Schema<Tapback> | AttributedString)' is unhelpful because ReadReactionCases doesn't appear in any reachable type. Either rename to something developer-facing, or include a fix-it that suggests @UnionValue. iOS 27.0 beta, Xcode 27 beta, macOS Tahoe 26.4.
3
0
406
Jun ’26
Image playground and photorealistic images
I haven’t yet installed the iOS 27 beta on my iPhone so I can’t yet try out some of the new feature in Image Playground. But what I’d like to be able to do is: let our users upload a photo of an object and then have Image Playground create a more polished version of the same photo. in pre-iOS 27 Image Playground, I can do this and get an illustration back. Can I get a photo back with the new changes? Is this something we can do yet with Image Playground?
1
0
191
Jun ’26
Conforming existing App Intents / Entity to Schema
Our app already has a huge set of App Intents and Entities. Conceptually, our entities and intents matches well to the existing schemas (like the Notes schema). But because we have existing intents, we ran into two problems: Our existing intents/entities used different property names in the past and some properties are slightly different then the schema. Our existing intents are already used on older Versions of macOS / iOS. But the schema domain is only available on OS27 and later. What can we do to adopt the schema? Should we just duplicate all Intents / Entities and mark them as isAssistantOnly and limit their availability to OS27 and later?
0
1
240
Jun ’26
iPhone app memory limit seems capped to 6GB
Hi all :) I tried to raise this in the group lab and was pointed here. I’m seeing a flat per-app memory ceiling of about 6 GB on iPhone, even on devices with more physical RAM and with com.apple.developer.kernel.increased-memory-limit. Measured with os_proc_available_memory() plus task_vm_info.phys_footprint, the total process budget stays around 6144 MB on both: iPhone 16 Pro Max, 8 GB RAM iPhone 17 Pro Max, 12 GB RAM This came up while running Gemma 4 multimodal support in mlx-swift-lm (PR #343). The model loads at about 4.4 GB resident, leaving roughly 1.7 GB for inference/prefill. Reducing a GPU buffer cache from 512 MB to 64 MB recovered enough headroom to avoid jetsam and allowed a full image + video + audio multimodal test to complete, so the measurement seems to reflect a real per-process limit rather than free system memory. I re-measured the ceiling on the 12 GB phone with these capabilities: increased-memory-limit only: ~6144 MB increased-memory-limit + extended-virtual-addressing: ~6144 MB, no change increased-memory-limit + increased-debugging-memory-limit: ~6656 MB I have also observed that 12 GB iPad devices expose more memory to an app than 12 GB iPhone devices but I didn't measure specifically and no longer have the device to hand. Is the ~6 GB per-process tier on Pro iPhones expected, even with increased-memory-limit? Is there any supported way for a shipping app to access more of the available RAM on 12 GB iPhone models? FB23183521
0
0
677
Jun ’26
Generating Images of Real People Without Their Consent
I am concerned how easy they make it to generate photos of real people. And because it is so easy, people will likely just try it on people without their consent. At the WWDC26 keynote, they demonstrated how you can use any photo of a person to create a new photorealistic image based on modifications described using natural language. I would even describe this as creepy. Anyone who can find a photo of me online, can create a photo of me doing whatever they want! And of course, I have no control over who they share that with. I believe Apple could do better than the other AI companies. At minimum, they could display some warnings about the ethical considerations when using this feature.
1
0
147
Jun ’26
Siri AI - waitlist
i have been on the waitlist since the release , I have asked many of my friends and they got it at very different times , who got it in hours who in days , and then there's me , a whole week of waiting for nothing , as a developer this is affecting my workflow but there's nothing more to do than reporting it to apple via the feedback app. the thing that makes us all anxious its not being able to see our position in line if there even is one because users reported that who downloaded and joined the waitlist later got it sooner than someone who installed iOS 27 and joined the waitlist before . AS OF RIGHT NOW I NOTICED A PATTERN. NEWER DEVICES THAT FINISH THE INDEXING FASTER GET THRU THE WAITLIST , while others like iPhone 15 pro and iPad m1 GET TO WAIT EVEN IF THE INDEXING IS FINISHED . what can we do other than wait , is there any way of KNOWING YOUR CURRENT STATE IN WAITING IN LINE.
0
0
191
Jun ’26
Siri As Coding Agent
In the new Xcode we saw examples of Claude, OAI & Google coding agents that you can start conversations with inside your project, giving it access to your project files context. As far as I understand, this requires an API key for those models & the processing is run on Anthropic / Google servers, not locally nor on Private Cloud Compute. Is it possible to instead, use the LLM powering Foundation Models, for a “Siri Code Agent” which operates in the place of those models, but runs on device or in Private Cloud Compute? I like how this works for Siri AI requests, and would love to have a coding assistant agent that can operate in the same privacy preserving way! Is this possible with any of the open source frameworks or the command line tools? If not, what is the best way to request this feature?
2
1
447
Jun ’26
Rich SwiftUI Rendering in the Siri Overlay
For intents that return complex markdown, code snippets, or structured layouts, what are the rendering capabilities and resource constraints of custom SwiftUI views returned via Snippet inside the Siri voice overlay? Are interactive controls (like buttons, copy-to-clipboard, or scroll views) supported inside the Siri-overlay SwiftUI container?
1
0
503
Jun ’26
Custom vocabulary for speech and entity resolution
Whisper and other STT APIs let you pass a custom vocabulary or initial_prompt to bias recognition toward domain-specific proper nouns. In the App Intents / Siri stack, is there an equivalent way to supply dynamic, per-user term lists — for example favorites or recently used items — to improve how spoken names are transcribed or resolved?
1
0
373
Jun ’26
If you are having problems and find that you need to downgrade and then image playground doesn't work please follow these steps
Make sure that you have everything Apple Intelligence enabled because it took up to 24 to 48 hours for the image playground app to work for me. Note this is coming from a fellow developer not official update as we cannot do that on the forums. I am only sharing my own experience. It may take some time for the support files like it did for me to become available for image playground again. Sincerely, Donald Kirby
1
0
228
Jun ’26
Siri ai not working
So a few days ago I got the siri ai but after I got out of the waitlist it still won’t lat me use it I’m on ios 27 and PLEASE FIX I WANT A FULL HANDS FREE IPHONE PLZ!!!!!!
Replies
1
Boosts
0
Views
123
Activity
Jun ’26
.messages.message reaction field type vs. error from macro
The documented template for @AppEntity(schema: .messages.message) at Integrating your messaging app with Apple Intelligence and on the MessagesEntity.message reference page shows: var reaction: <#ReadReaction#>? with <#ReadReaction#> rendered as a placeholder (the Xcode placeholder syntax). A natural reading is "fill in your own type that you want to use here". I tried several: Tapback? where Tapback is @AppEnum(schema: .messages.customReaction) MessageReaction? (same, renamed) MessageReaction? with manual AppEnum conformance (no schema decoration) AttributedString? AttributedString (non-optional) field omitted entirely Each variant produced one of: error: Property 'reaction' type does not match required AppSchemaEntity property type 'ReadReactionCases:(Schema<Tapback> | AttributedString)' error: Required AppSchemaEntity property 'reaction' must be optional error: Missing required property 'reaction' from AppSchemaEntity 'messages.message' The phrase ReadReactionCases:(Schema<Tapback> | AttributedString) is opaque — ReadReactionCases isn't a public type, Schema<Tapback> isn't constructable from outside, and the documentation doesn't mention @UnionValue in this context. The actual working pattern, which I only found by downloading the UnicornChat sample and reading MessageEntity.swift, is: @UnionValue enum MessageReaction: Sendable { case customReaction(CustomReaction) } @AppEnum(schema: .messages.customReaction) enum CustomReaction: String, AppEnum { case sticker static let caseDisplayRepresentations: [Self: DisplayRepresentation] = [ .sticker: "Sticker" ] } Two suggestions: Update the schema-template comment in the docs to either name MessageReaction explicitly with a @UnionValue annotation, or include a one-line note: "The reaction field is a @UnionValue enum wrapping the customReaction schema enum — see UnicornChat sample." The current placeholder <#ReadReaction#> plus the prose suggesting "you can generate the properties... with the @AppEntity(.messages.message) Swift macro" reads as if the developer just supplies any AppEnum-conformer. Improve the diagnostic. Property type does not match required AppSchemaEntity property type 'ReadReactionCases:(Schema<Tapback> | AttributedString)' is unhelpful because ReadReactionCases doesn't appear in any reachable type. Either rename to something developer-facing, or include a fix-it that suggests @UnionValue. iOS 27.0 beta, Xcode 27 beta, macOS Tahoe 26.4.
Replies
3
Boosts
0
Views
406
Activity
Jun ’26
Image playground and photorealistic images
I haven’t yet installed the iOS 27 beta on my iPhone so I can’t yet try out some of the new feature in Image Playground. But what I’d like to be able to do is: let our users upload a photo of an object and then have Image Playground create a more polished version of the same photo. in pre-iOS 27 Image Playground, I can do this and get an illustration back. Can I get a photo back with the new changes? Is this something we can do yet with Image Playground?
Replies
1
Boosts
0
Views
191
Activity
Jun ’26
Still on Waitlist since Day 1
I am still on the waitlist since Day 1… Such a poor preparedness and leadership by Apple… That’s it… My primary Sim is going back to Samsung…
Replies
0
Boosts
1
Views
296
Activity
Jun ’26
STILL waiting for the new Siri update
still been on the waiting list ever since, don’t know what’s going on with this waitlist. I understand it’s not list list, but it’s taking forever!
Replies
0
Boosts
0
Views
97
Activity
Jun ’26
Conforming existing App Intents / Entity to Schema
Our app already has a huge set of App Intents and Entities. Conceptually, our entities and intents matches well to the existing schemas (like the Notes schema). But because we have existing intents, we ran into two problems: Our existing intents/entities used different property names in the past and some properties are slightly different then the schema. Our existing intents are already used on older Versions of macOS / iOS. But the schema domain is only available on OS27 and later. What can we do to adopt the schema? Should we just duplicate all Intents / Entities and mark them as isAssistantOnly and limit their availability to OS27 and later?
Replies
0
Boosts
1
Views
240
Activity
Jun ’26
Siri ai
Going on a week now and still on the waitlist 👎
Replies
0
Boosts
0
Views
119
Activity
Jun ’26
iPhone app memory limit seems capped to 6GB
Hi all :) I tried to raise this in the group lab and was pointed here. I’m seeing a flat per-app memory ceiling of about 6 GB on iPhone, even on devices with more physical RAM and with com.apple.developer.kernel.increased-memory-limit. Measured with os_proc_available_memory() plus task_vm_info.phys_footprint, the total process budget stays around 6144 MB on both: iPhone 16 Pro Max, 8 GB RAM iPhone 17 Pro Max, 12 GB RAM This came up while running Gemma 4 multimodal support in mlx-swift-lm (PR #343). The model loads at about 4.4 GB resident, leaving roughly 1.7 GB for inference/prefill. Reducing a GPU buffer cache from 512 MB to 64 MB recovered enough headroom to avoid jetsam and allowed a full image + video + audio multimodal test to complete, so the measurement seems to reflect a real per-process limit rather than free system memory. I re-measured the ceiling on the 12 GB phone with these capabilities: increased-memory-limit only: ~6144 MB increased-memory-limit + extended-virtual-addressing: ~6144 MB, no change increased-memory-limit + increased-debugging-memory-limit: ~6656 MB I have also observed that 12 GB iPad devices expose more memory to an app than 12 GB iPhone devices but I didn't measure specifically and no longer have the device to hand. Is the ~6 GB per-process tier on Pro iPhones expected, even with increased-memory-limit? Is there any supported way for a shipping app to access more of the available RAM on 12 GB iPhone models? FB23183521
Replies
0
Boosts
0
Views
677
Activity
Jun ’26
waiting for siri ai
I’ve been waiting for like a week, but still nothing show up. Can you guys do things faster?
Replies
0
Boosts
1
Views
103
Activity
Jun ’26
Generating Images of Real People Without Their Consent
I am concerned how easy they make it to generate photos of real people. And because it is so easy, people will likely just try it on people without their consent. At the WWDC26 keynote, they demonstrated how you can use any photo of a person to create a new photorealistic image based on modifications described using natural language. I would even describe this as creepy. Anyone who can find a photo of me online, can create a photo of me doing whatever they want! And of course, I have no control over who they share that with. I believe Apple could do better than the other AI companies. At minimum, they could display some warnings about the ethical considerations when using this feature.
Replies
1
Boosts
0
Views
147
Activity
Jun ’26
Siri AI - waitlist
i have been on the waitlist since the release , I have asked many of my friends and they got it at very different times , who got it in hours who in days , and then there's me , a whole week of waiting for nothing , as a developer this is affecting my workflow but there's nothing more to do than reporting it to apple via the feedback app. the thing that makes us all anxious its not being able to see our position in line if there even is one because users reported that who downloaded and joined the waitlist later got it sooner than someone who installed iOS 27 and joined the waitlist before . AS OF RIGHT NOW I NOTICED A PATTERN. NEWER DEVICES THAT FINISH THE INDEXING FASTER GET THRU THE WAITLIST , while others like iPhone 15 pro and iPad m1 GET TO WAIT EVEN IF THE INDEXING IS FINISHED . what can we do other than wait , is there any way of KNOWING YOUR CURRENT STATE IN WAITING IN LINE.
Replies
0
Boosts
0
Views
191
Activity
Jun ’26
Waitlist of SIRI AI
Hi everybody! Yesterday I requested for New siri in ios27, but nobody accepted my request yet. Can you help me pls?
Replies
2
Boosts
2
Views
836
Activity
Jun ’26
Siri As Coding Agent
In the new Xcode we saw examples of Claude, OAI & Google coding agents that you can start conversations with inside your project, giving it access to your project files context. As far as I understand, this requires an API key for those models & the processing is run on Anthropic / Google servers, not locally nor on Private Cloud Compute. Is it possible to instead, use the LLM powering Foundation Models, for a “Siri Code Agent” which operates in the place of those models, but runs on device or in Private Cloud Compute? I like how this works for Siri AI requests, and would love to have a coding assistant agent that can operate in the same privacy preserving way! Is this possible with any of the open source frameworks or the command line tools? If not, what is the best way to request this feature?
Replies
2
Boosts
1
Views
447
Activity
Jun ’26
New Siri
It has been been days since WWDC without Siri at this point as it says it is still indexing. Does anyone have any suggestions?
Replies
0
Boosts
1
Views
206
Activity
Jun ’26
What chip model will the China-launched Apple Intelligence use
I'm curious about what model Apple Intelligence will use when it is launched in China.
Replies
0
Boosts
0
Views
100
Activity
Jun ’26
Rich SwiftUI Rendering in the Siri Overlay
For intents that return complex markdown, code snippets, or structured layouts, what are the rendering capabilities and resource constraints of custom SwiftUI views returned via Snippet inside the Siri voice overlay? Are interactive controls (like buttons, copy-to-clipboard, or scroll views) supported inside the Siri-overlay SwiftUI container?
Replies
1
Boosts
0
Views
503
Activity
Jun ’26
Custom vocabulary for speech and entity resolution
Whisper and other STT APIs let you pass a custom vocabulary or initial_prompt to bias recognition toward domain-specific proper nouns. In the App Intents / Siri stack, is there an equivalent way to supply dynamic, per-user term lists — for example favorites or recently used items — to improve how spoken names are transcribed or resolved?
Replies
1
Boosts
0
Views
373
Activity
Jun ’26
If you are having problems and find that you need to downgrade and then image playground doesn't work please follow these steps
Make sure that you have everything Apple Intelligence enabled because it took up to 24 to 48 hours for the image playground app to work for me. Note this is coming from a fellow developer not official update as we cannot do that on the forums. I am only sharing my own experience. It may take some time for the support files like it did for me to become available for image playground again. Sincerely, Donald Kirby
Replies
1
Boosts
0
Views
228
Activity
Jun ’26
Running ML Models on software and hardware stack layer.
This year, new APIs were introduced such as l Metal Performance Shaders which provide access to high-performance Metal kernel. But this is still GPU. Are there APIs or plans to provide API and language to access ANE layer?
Replies
1
Boosts
0
Views
417
Activity
Jun ’26
Do we need to migrate SiriKit INIntent to AppIntent for Siri AI?
Can the new Siri correctly handle SiriKit INIntent? My app uses INIntent like INSendMessageIntent. It is used not only for Siri action but also used Communication notifications and CarPlay and more OS features. Is any migration required?
Replies
1
Boosts
0
Views
223
Activity
Jun ’26