Discover advancements in iOS camera capture: Depth, focus, and multitasking

RSS for tag

Discuss the WWDC22 Session Discover advancements in iOS camera capture: Depth, focus, and multitasking

Posts under wwdc2022-110429 tag

13 Posts

Post

Replies

Boosts

Views

Activity

How to get real world distance with/from LiDAR ?
Hello folks! How can I get a real-world measurement between the device (iPad Pro 5th. gen) and an object measured with the LiDAR? Let's say I have a reticle in the middle of my CameraView and want to measure precisely from my position to that point I'm aiming?. Almost like the "Measure App" from Apple. sceneDepth doesn't give me anything. I also looked into the Sample Code "Capturing Depth Using the LiDAR Camera" Any ideas how to do that? A push in to the right direction might also be very helpful Thanks in advance!
2
0
5.1k
Jul ’23
Camera focus issues at close range on iOS 16
Since iOS 16, in third-party apps, the camera does not focus on objects at a distance of 10 to 12 cm. This renders all apps that require close-range focus, such as barcode scanners, QR code readers, and others, completely obsolete and non-functional. You can verify this by opening the camera from apps like Instagram or WhatsApp, for example. It does not focus at close range. As a developer, I have not found a solution yet. Can someone help me with this issue starting from iOS 16? Will there be any Apple update to fix this problem? I have tested this with an iPhone 14 and iPhone S6, both running iOS 16...
0
0
941
May ’23
isMultitaskingCameraAccessSupported returning false on most devices
Hi, Our team is wondering why the camera multitasking API are only supported on iPad with an extended display. Here is the quote from the documentation. https://developer.apple.com/documentation/avfoundation/avcapturesession/4013228-ismultitaskingcameraaccesssuppor This value returns true on iPads that support Stage Manager with an extended display. Is there intention from Apple team to support this API on more devices in the future. We would like to allow our users to be able to continue using their camera in a video call while our application is in background with Picture in Picture enabled; without having to use the com.apple.developer.avfoundation.multitasking-camera-access entitelment on iOS. Thank you in advance for the replies
0
6
921
Mar ’23
Setting Multitasking Camera Access Support
I have a question in regards to setting up isMultitaskingCameraAccessEnabled for Picture in Picture capabilities on iOS 16 intended for video calls. In my CaptureSession flow I have set up the requirement to enable "MultitaskingCameraAccess" as indicated in the developer documentation. https://developer.apple.com/documentation/avkit/accessing_the_camera_while_multitasking https://developer.apple.com/documentation/avkit/adopting_picture_in_picture_for_video_calls let captureSession = AVCaptureSession() // Configure the capture session. captureSession.beginConfiguration() if captureSession.isMultitaskingCameraAccessSupported { // Enable using the camera in multitasking modes. captureSession.isMultitaskingCameraAccessEnabled = true } captureSession.commitConfiguration() // Start the capture session. captureSession.startRunning() However isMultitaskingCameraAccessSupported is always false. My question is what dictates this setting? How can I support multitasking camera access by enabling this boolean to true?
9
2
5.1k
Jan ’23
isMultitaskingCameraAccessSupported stopped returning YES for iOS 16, iPhone Devices
This initially used to work but has stopped working for me for iOS 16 iPhone devices. Background Streaming used to work for video calls but has just abrupt stopped working. On further debugging, I found that isMultitaskingCameraAccessSupported is returning NO, instead of YES. I thought the BOOL isMultitaskingCameraAccessSupported would return YES for all iOS 16 devices. Is that not the case? On what conditions does this return YES? Is it only supported for iPad Devices?
0
1
1k
Oct ’22
Access both RGB images from builtindualcamera
I am trying to use stereoscopic distance measurements but the AVDepthdata isn’t as useful because it’s full of holes. I have reference markers that I would like to use to compute the distance myself. Is it possible to access both RGB images from the builtindualcamera? I don’t need the depth but would need the calibration data for the dual camera. thanks
3
1
1.3k
Oct ’22
How to connect AVCaptureVideoDataOutput to AVCaptureVideoPreviewLayer
In the attached picture, the presenter is implying that a video data output can be associated with a video preview layer. I don't see an explicit way to make such an association happen. Can someone drop sample code here or point to me to relevant documentation? From what I have gathered so far, a AVCaptureConnection can only be created between a video input port to a preview layer but that doesn't allow us to gain any of the benefits outlined in the presentation. Thanks
1
0
1.2k
Jul ’22
How to get real world distance with/from LiDAR ?
Hello folks! How can I get a real-world measurement between the device (iPad Pro 5th. gen) and an object measured with the LiDAR? Let's say I have a reticle in the middle of my CameraView and want to measure precisely from my position to that point I'm aiming?. Almost like the "Measure App" from Apple. sceneDepth doesn't give me anything. I also looked into the Sample Code "Capturing Depth Using the LiDAR Camera" Any ideas how to do that? A push in to the right direction might also be very helpful Thanks in advance!
Replies
2
Boosts
0
Views
5.1k
Activity
Jul ’23
Camera focus issues at close range on iOS 16
Since iOS 16, in third-party apps, the camera does not focus on objects at a distance of 10 to 12 cm. This renders all apps that require close-range focus, such as barcode scanners, QR code readers, and others, completely obsolete and non-functional. You can verify this by opening the camera from apps like Instagram or WhatsApp, for example. It does not focus at close range. As a developer, I have not found a solution yet. Can someone help me with this issue starting from iOS 16? Will there be any Apple update to fix this problem? I have tested this with an iPhone 14 and iPhone S6, both running iOS 16...
Replies
0
Boosts
0
Views
941
Activity
May ’23
isMultitaskingCameraAccessSupported returning false on most devices
Hi, Our team is wondering why the camera multitasking API are only supported on iPad with an extended display. Here is the quote from the documentation. https://developer.apple.com/documentation/avfoundation/avcapturesession/4013228-ismultitaskingcameraaccesssuppor This value returns true on iPads that support Stage Manager with an extended display. Is there intention from Apple team to support this API on more devices in the future. We would like to allow our users to be able to continue using their camera in a video call while our application is in background with Picture in Picture enabled; without having to use the com.apple.developer.avfoundation.multitasking-camera-access entitelment on iOS. Thank you in advance for the replies
Replies
0
Boosts
6
Views
921
Activity
Mar ’23
How to get the distance between two points using the LiDAR 15.4?
I'm able to get the distance between two points using ARKit easy but with AVFoundation the data doesn't make sense. I get wrong values Any help thank you!
Replies
1
Boosts
0
Views
1.1k
Activity
Jan ’23
Setting Multitasking Camera Access Support
I have a question in regards to setting up isMultitaskingCameraAccessEnabled for Picture in Picture capabilities on iOS 16 intended for video calls. In my CaptureSession flow I have set up the requirement to enable "MultitaskingCameraAccess" as indicated in the developer documentation. https://developer.apple.com/documentation/avkit/accessing_the_camera_while_multitasking https://developer.apple.com/documentation/avkit/adopting_picture_in_picture_for_video_calls let captureSession = AVCaptureSession() // Configure the capture session. captureSession.beginConfiguration() if captureSession.isMultitaskingCameraAccessSupported { // Enable using the camera in multitasking modes. captureSession.isMultitaskingCameraAccessEnabled = true } captureSession.commitConfiguration() // Start the capture session. captureSession.startRunning() However isMultitaskingCameraAccessSupported is always false. My question is what dictates this setting? How can I support multitasking camera access by enabling this boolean to true?
Replies
9
Boosts
2
Views
5.1k
Activity
Jan ’23
isMultitaskingCameraAccessSupported stopped returning YES for iOS 16, iPhone Devices
This initially used to work but has stopped working for me for iOS 16 iPhone devices. Background Streaming used to work for video calls but has just abrupt stopped working. On further debugging, I found that isMultitaskingCameraAccessSupported is returning NO, instead of YES. I thought the BOOL isMultitaskingCameraAccessSupported would return YES for all iOS 16 devices. Is that not the case? On what conditions does this return YES? Is it only supported for iPad Devices?
Replies
0
Boosts
1
Views
1k
Activity
Oct ’22
Camera multitasking doesn't work as expected in 16.0 Beta on iPad Pro 2nd Gen
Hello, My device is an iPad Pro 2nd generation. Model number MXDC2LL/A. iOS 16 build 20A5283p. When creating an AVCaptureSession, isMultiTaskingCameraAccessSupported is returning false. Is this expected on this device? Is a newer device needed or is it an issue in this particular iOS 16 build? Thanks
Replies
6
Boosts
2
Views
3.0k
Activity
Oct ’22
Access both RGB images from builtindualcamera
I am trying to use stereoscopic distance measurements but the AVDepthdata isn’t as useful because it’s full of holes. I have reference markers that I would like to use to compute the distance myself. Is it possible to access both RGB images from the builtindualcamera? I don’t need the depth but would need the calibration data for the dual camera. thanks
Replies
3
Boosts
1
Views
1.3k
Activity
Oct ’22
Questions about iPadOS new feature "Stage Manager"
Can another app window opens in Stage Manager when another apps' "UIRequiresFullScreen = TRUE" ? It seems that there is a limitation in the beta released yesterday... Not sure it's a bug or sth... Open only 1 app in windowed-screen once seems stupid
Replies
2
Boosts
1
Views
2.4k
Activity
Sep ’22
TrueDepth delivers relative depth now?
At around the 5 min mark of "Discover advancements in iOS camera capture: Depth, focus, and multitasking", you state that TrueDepth delivers relative depth. This appears to contradict official documentation. In Capturing Photos with Depth, you state explicitly that TrueDepth camera measures depth directly with absolute accuracy. Why the change?
Replies
4
Boosts
0
Views
2.4k
Activity
Aug ’22
LidarCamera Depth accuracy is always returned as relative
In the talk, it was mentioned that LidarCamera Depth accuracy is returned as absolute and and the True depth camera accuracy is absolute. In reality this is exactly opposite.
Replies
1
Boosts
0
Views
1.2k
Activity
Aug ’22
How to connect AVCaptureVideoDataOutput to AVCaptureVideoPreviewLayer
In the attached picture, the presenter is implying that a video data output can be associated with a video preview layer. I don't see an explicit way to make such an association happen. Can someone drop sample code here or point to me to relevant documentation? From what I have gathered so far, a AVCaptureConnection can only be created between a video input port to a preview layer but that doesn't allow us to gain any of the benefits outlined in the presentation. Thanks
Replies
1
Boosts
0
Views
1.2k
Activity
Jul ’22
Demo app available
Great session! Will the demo app source code be available? tks
Replies
0
Boosts
2
Views
1.2k
Activity
Jun ’22