App Intents + Siri AI

Hey,

Running iOS 27 beta and have App Intents working in the shortcuts app. When I ask the exact query via Siri it seems to say it can't do that and asks me to open the app to do it manually.

Is this expected behaviour? A bug? Anything I need to double check? The app doesn't map to a schema directly.

Same here. Also very flaky invoking app shortcuts by their phrases. Half the time it doesn't work.

Thanks for your post, I just answered a post like this here: https://developer.apple.com/forums/thread/835563

I would recommend you to go over the videos I have posted there and then if there are any specific questions go ahead and ask them in this thread I'll be monitoring and hopefully that team will be able to answer your questions.

Other resources https://developer.apple.com/documentation/appintents/making-actions-and-content-discoverable-by-apple-intelligence

Thanks

Albert  WWDR

I've gone over the videos, attended the QnA's, tried to follow the sample code, and Siri still won't invoke my intents that adhere to the Photos @Schema definitions.

I've added AppIntentsTesting tests to confirm that my intents and entities are available from the application.

I've confirmed that Shortcuts shows my intents actions, even the one that says my app has "Albums" even though it doesn't but I had to conform to it anyway because I have "galleries" and we can't make our own Schemas even after two years of that API existing....

I'm not convinced it actually works in Beta 1 and 2. I asked Apple several times what was not functional during the WWDC QnA sessions and they opted not to answer the question.

Is anyone able to say what is / is not expected to be working for developer seed 2?

I know it's still early in the cycle, but I'm not happy about the level of communication to developers about this one.

It's impossible to introspect what siri is able to see on screen.

It's impossible to ask what siri what it is able to do with a specific application.

It's impossible to figure out why when you tell siri to do something it will straight up say it can't and then you say "yes you can, this app uses AppEntities" and then it will magically work.

I figure I won't end up shipping the feature by the fall.

@J0hn

Thanks for your feedback on this.

Siri, relies on an on-device semantic index and language models to map a user's spoken request to your @AppIntent(schema: …) Please check with In Betas 2, to see the models that came out today and that your App Entities and Intents are indeed registered with the system.

Introspecting what Siri sees on screen. Siri relies on the OS scraping the accessibility tree and reading the App Entities you have donated or made available on screen.

The only way to get visibility into this is to trigger the failure, immediately capture a sysdiagnose, and file a report in Feedback Assistant. The Siri engineering teams rely heavily on these logs to see exactly where the routing confidence dropped.

I’m looking forward to see your progress working on the betas coming out.

Albert  WWDR

App Intents + Siri AI
 
 
Q