Scribble

RSS for tag

Enable handwriting-to-text conversion in any text field on iPad with Apple Pencil using the UIScribbleInteraction and UIIndirectScribbleInteraction APIs.

Posts under Scribble tag

35 Posts

Post

Replies

Boosts

Views

Activity

Apple Pencil Pro not staying connected in iPadOS26 beta
I have a new M4 iPad Air and a brand new Apple Pencil Pro. It was working well until I installed iPadOS 26.0 (23A5297m) beta. Now, when using GoodNotes to write the Pencil functions for about 6-8 seconds and then disconnects for 2-3 seconds and then reconnects. You can imagine how disruptive this is. It does the same thing trying to highlight in the Kindle app, so I think it is an iOS issue. As I write this, I am discovering that the Pencil is not wanting to stay connected at all despite showing up in the list of Bluetooth devices and connecting temporarily. I've tried forgetting and reconnecting the Pencil several times. It is charged to 100%, and I receive the alert that the iPad detects the Pencil. Is anyone else having this issue? Do I need to assume this is being addressed?
2
0
509
Jul ’25
Disable Scribble in UITextView
There are use cases where someone who's using an Apple Pencil may not want to enter text via Scribble. A simple example is writing "UIViewController" in a text view is unlikely to be successful. I'd like to disable Scribble in this case and let the keyboard become the input mechanism. (Disabling Scribble system-wide in Settings is both cumbersome and overkill.) The closest I can come to making this happen is by adding a UIScribbleInteraction on a UITextView and returning false when scribbleInteraction(shouldBeginAt:) is called. This disables Scribble on the text view, and prevents writing from being converted into text, but the input widget still appears on screen and isn't very useful. Here is a sample project that demonstrates the problem: http://files.iconfactory.net/craig/bugs/Scribbler.zip Hopefully, I'm doing something wrong here. If not, I'm happy to submit this as a FB. -ch
3
0
3.3k
Nov ’24
Critical Rendering Bug in PencilKit on iPad with "More Space" Display Mode & Apple Pencil Hover Interaction
There is a significant rendering issue in PencilKit when using an iPad set to "More Space" display mode, combined with an Apple Pencil that supports hover functionality (e.g., Apple Pencil 2). This problem affects all applications that use PencilKit, including Apple's own Notes and Quick Note. The issue results in flickering black borders and subtle jittering while drawing, which is especially noticeable during tasks requiring precise handwriting, such as writing mathematical expressions. Due to the short strokes and frequent lifts and drops of the pencil, the jitter is much more pronounced, leading to visual discomfort and even dizziness after extended use. Steps to Reproduce: Open Settings on your iPad. Navigate to Display & Brightness > Display Zoom > More Space. Switch to the More Space display mode. Open the Notes app or trigger Quick Note from any application by swiping from the bottom-right corner. Start drawing or writing using the Apple Pencil (with hover functionality) in the writing area. Observe the display anomalies as you hover and write: Flickering black borders appear intermittently around the writing area. The strokes show subtle jittering whenever you lift and lower the pencil. This is particularly disruptive when writing short, precise strokes, such as those in mathematical expressions, where the frequent up-and-down motion makes the jitter more apparent. Expected Results: Smooth and stable drawing experience with no visual artifacts or jittering during interactions with the Apple Pencil, regardless of the display zoom settings. Actual Results: Flickering black borders intermittently appear during drawing. Jittering of strokes is noticeable, particularly when lifting and lowering the Apple Pencil for short strokes. This disrupts precise writing tasks, especially in cases like mathematical notation, where frequent pen lifts and short strokes make the jitter much more apparent. This can lead to discomfort (e.g., dizziness) after extended use. System-Wide Impact: This issue affects all apps that utilize PencilKit, including third-party apps such as Doodle Draw (link). Since PencilKit is a core framework, the rendering bug significantly degrades the user experience across multiple productivity and note-taking applications. Similar Reports: There are numerous discussions about this issue online, indicating that many users are experiencing the same problem. Reddit Discussion: https://www.reddit.com/r/ipad/comments/1f042ol/comment/ljvilv6/ Apple Support Thread Additionally, a feedback report (ID: FB15166022) related to this issue with Notes has been previously filed, but the bug remains unresolved. This bug severely impacts the usability of PencilKit-enabled apps, especially during tasks that involve frequent, precise pencil strokes, such as writing mathematical expressions. We kindly request the development team investigate this issue promptly to ensure a smooth, stable experience with the iPad's "More Space" display mode and Apple Pencil hover interaction.
1
0
740
Sep ’24
PKCanvasView working on preview, but not on simulator or app
Hey, so I am working on a note taking part of my app and I have been working on allowing different inputs. I got the PKCanvas to work on the preview and on the simulator when it is the only thing on the window group. But when I use this View as part of the tool selection in my app, when the user selects the Canvas view it loads but scribbles don't work, only in the preview in Xcode. I don't know why this behavior is happening. The flow in which the PKCanvasView appears is, user taps NavLink to see their notes, in the NotesView they tap to show the toolbar, toolbar has 4 types of input, text, images, audio, scribbles (all other inputs work accordingly), user taps scribbles the view loads correctly but doesn't allow them to draw. I have set the drawingPolicy to anyInput
0
0
592
Jun ’24
Static lines when using Scribble
I just got the iPad air 5th gen and also the Apple Pencil 2nd Gen and right when I started using the scribble function, I would get random static lines along the lettering or random parts of the screen. it only appears when I'm waiting and doesn't affect the actual things I'm writing. The iPad also automatically updated to the beta version of ios 18 because my iPhone is also on the beta. Is anyone else having this issue?
0
0
697
Jun ’24
PKToolPicker Available Tools
When I display the PKToolPicker in my app it looks similar to the image below If you use one of the apps from Apple like Pages or Freeform you see a picker similar to this one. Notice that the PKToolPicker from the Apple app has 6 tools not including the ruler. With the tool all the way to the left being the writing tool. How do you get the picker to display with the writing tool? I have looked over the API and I can see where you can set if the ruler is displayed or not but I can't find anything for the writing tool
1
0
1.2k
Jun ’24
WKInterfaceTextField input stops running WKInterfaceTimer?
In my Watch app, I have a WKInterfaceTimer running. When the user taps in a WKInterfaceTextField and inputs some text (watch keyboard, or Scribble, or iPhone keyboard), it seems the timer is stopped, even when the user is done entering text. I want the timer to continue running the whole time. Has anyone else seen this? Is there a way around it? I .start the timer when I get the text field's callback, but it doesn't seem to work consistently, plus the timer is stopped while the keyboard/scribble is showing. My only alternative I can see is to perform the input somewhere else in the app, when the timer is not running (much less elegant). Thoughts?
1
0
1.2k
Nov ’22
Shape detection for other apps? (PencilKit, iOS 15)
Tried to ask as a comment in the other thread: https://developer.apple.com/forums/thread/650386?answerId=628394022#reply-to-this-question But can't leave a comment in there for some reason (the thread is locked?). Asking exactly the same question, now for iOS 15. Anything changed in this area? When selecting a stroke path for object on PKCanvas, the option "Snap to Shape" appears. I understand this function is still in beta and has not made available natively to other PencilKit app. Is there a way using Stroke API to call this function directly after the user hold pencil for half a second when stroke is done drawing, just like how it behaves in native apps?
1
1
1.9k
Sep ’22
Is there a way to know if a WkWebView is using scribble?
I have a WkWebView that I use to run a text editor. It works fine with scribble, and I can enter text with the stylus. However, I would like to disable scrolling with the stylus while scribble is enabled (otherwise, the view moves around when the user writes). But I'd like to keep the scrolling ability if the user is not using scribble. Hence the question: is there a way to know when scribble has been enabled, or if it's been enabled for this specific WkWebView? It's actually a webView, using SwiftUI; I don't know if it changes something.
0
1
981
Sep ’22
How to get auto-suggested word based on drawn Chinese character or stroke info in the form of an array of CGPoint?
I have an array consists of the CGPoint representing the chinese character stroke paths and able to re-draw out the character on UIView. I would like to use this existing information to find out the most similar chinese word. I notice the chinese keyboard hand-writing pad can display the suggested words. However, I have no idea which functions in the documentation that get this to work ( pass the stroke info as CGPoint, and get back suggested Chinese words). What API calls can I use to get the suggested words?
0
0
1.7k
Aug ’22
Scribble on iPadOS 16 (Beta) not working as before
The scribble functionality for the iPad (using Apple Pencil 2) isn't working as good as it was before (on iOS 15+). I take daily journals and set the title as follows: "YYYY-MM-DD". Previously, the scribble could detect everything ideally and matched the "no spaces" and all the numbers. With iOS 16 beta, most of the time, it ends up catching up something like this: "YYYY - MM M- DD". This is irritating since I have to go and delete the third digit for the month, and remove the spaces that scribble applies in between symbols.
0
0
1.3k
Jul ’22
How to stop auto-capitalization / auto-correct capitalized words to small letters when using Apple pen on textView?
I have specifically mentioned textView.autocapitalizationType = .none but when an input is done with Apple pen, the words entered will be automatically changed to Capital letter for the first word and other middle words which are originally entered as capitalized words being changed to small letters. If using keyboard for text input, no such issue. Even when I change the setting->keyboard, turn off autocapitalization, the words will still be changed to Capital letter for first words and other words all to small letters as long as using Apple pen. How can I programmatically forced the input by Apple pen to be exactly as what user key in ( which word to be in small letters, and which to be capital letters ), instead of autoCapitalized them and auto-turn capitalized words by user to small letters when it is not needed to do so at all. Thanks.
3
2
2.9k
Jul ’22
Apple face
Apple face app is used to fore video calling and chatting and voice calling AP same a what’s app tango etc…
Replies
1
Boosts
0
Views
708
Activity
Aug ’25
Apple Pencil Pro not staying connected in iPadOS26 beta
I have a new M4 iPad Air and a brand new Apple Pencil Pro. It was working well until I installed iPadOS 26.0 (23A5297m) beta. Now, when using GoodNotes to write the Pencil functions for about 6-8 seconds and then disconnects for 2-3 seconds and then reconnects. You can imagine how disruptive this is. It does the same thing trying to highlight in the Kindle app, so I think it is an iOS issue. As I write this, I am discovering that the Pencil is not wanting to stay connected at all despite showing up in the list of Bluetooth devices and connecting temporarily. I've tried forgetting and reconnecting the Pencil several times. It is charged to 100%, and I receive the alert that the iPad detects the Pencil. Is anyone else having this issue? Do I need to assume this is being addressed?
Replies
2
Boosts
0
Views
509
Activity
Jul ’25
Disable Scribble in Website
I see that UIScribbleInteractionDelegate has scribbleInteraction(_:shouldBeginAt:) that you can always return false from in order to disable scribble. Is there any way to disable it in a website via javascript or dom attributes?
Replies
2
Boosts
1
Views
1.1k
Activity
Dec ’24
Disable Scribble in UITextView
There are use cases where someone who's using an Apple Pencil may not want to enter text via Scribble. A simple example is writing "UIViewController" in a text view is unlikely to be successful. I'd like to disable Scribble in this case and let the keyboard become the input mechanism. (Disabling Scribble system-wide in Settings is both cumbersome and overkill.) The closest I can come to making this happen is by adding a UIScribbleInteraction on a UITextView and returning false when scribbleInteraction(shouldBeginAt:) is called. This disables Scribble on the text view, and prevents writing from being converted into text, but the input widget still appears on screen and isn't very useful. Here is a sample project that demonstrates the problem: http://files.iconfactory.net/craig/bugs/Scribbler.zip Hopefully, I'm doing something wrong here. If not, I'm happy to submit this as a FB. -ch
Replies
3
Boosts
0
Views
3.3k
Activity
Nov ’24
Critical Rendering Bug in PencilKit on iPad with "More Space" Display Mode & Apple Pencil Hover Interaction
There is a significant rendering issue in PencilKit when using an iPad set to "More Space" display mode, combined with an Apple Pencil that supports hover functionality (e.g., Apple Pencil 2). This problem affects all applications that use PencilKit, including Apple's own Notes and Quick Note. The issue results in flickering black borders and subtle jittering while drawing, which is especially noticeable during tasks requiring precise handwriting, such as writing mathematical expressions. Due to the short strokes and frequent lifts and drops of the pencil, the jitter is much more pronounced, leading to visual discomfort and even dizziness after extended use. Steps to Reproduce: Open Settings on your iPad. Navigate to Display & Brightness > Display Zoom > More Space. Switch to the More Space display mode. Open the Notes app or trigger Quick Note from any application by swiping from the bottom-right corner. Start drawing or writing using the Apple Pencil (with hover functionality) in the writing area. Observe the display anomalies as you hover and write: Flickering black borders appear intermittently around the writing area. The strokes show subtle jittering whenever you lift and lower the pencil. This is particularly disruptive when writing short, precise strokes, such as those in mathematical expressions, where the frequent up-and-down motion makes the jitter more apparent. Expected Results: Smooth and stable drawing experience with no visual artifacts or jittering during interactions with the Apple Pencil, regardless of the display zoom settings. Actual Results: Flickering black borders intermittently appear during drawing. Jittering of strokes is noticeable, particularly when lifting and lowering the Apple Pencil for short strokes. This disrupts precise writing tasks, especially in cases like mathematical notation, where frequent pen lifts and short strokes make the jitter much more apparent. This can lead to discomfort (e.g., dizziness) after extended use. System-Wide Impact: This issue affects all apps that utilize PencilKit, including third-party apps such as Doodle Draw (link). Since PencilKit is a core framework, the rendering bug significantly degrades the user experience across multiple productivity and note-taking applications. Similar Reports: There are numerous discussions about this issue online, indicating that many users are experiencing the same problem. Reddit Discussion: https://www.reddit.com/r/ipad/comments/1f042ol/comment/ljvilv6/ Apple Support Thread Additionally, a feedback report (ID: FB15166022) related to this issue with Notes has been previously filed, but the bug remains unresolved. This bug severely impacts the usability of PencilKit-enabled apps, especially during tasks that involve frequent, precise pencil strokes, such as writing mathematical expressions. We kindly request the development team investigate this issue promptly to ensure a smooth, stable experience with the iPad's "More Space" display mode and Apple Pencil hover interaction.
Replies
1
Boosts
0
Views
740
Activity
Sep ’24
Apple Pencil Not Working 2nd Gen
I updated to the IOS 18 Beta and my Apple pencil won’t work on my device at all. I detach and reattach it and it recognizes its power level but it won’t write or highlight.
Replies
1
Boosts
0
Views
797
Activity
Jul ’24
PKCanvasView working on preview, but not on simulator or app
Hey, so I am working on a note taking part of my app and I have been working on allowing different inputs. I got the PKCanvas to work on the preview and on the simulator when it is the only thing on the window group. But when I use this View as part of the tool selection in my app, when the user selects the Canvas view it loads but scribbles don't work, only in the preview in Xcode. I don't know why this behavior is happening. The flow in which the PKCanvasView appears is, user taps NavLink to see their notes, in the NotesView they tap to show the toolbar, toolbar has 4 types of input, text, images, audio, scribbles (all other inputs work accordingly), user taps scribbles the view loads correctly but doesn't allow them to draw. I have set the drawingPolicy to anyInput
Replies
0
Boosts
0
Views
592
Activity
Jun ’24
Static lines when using Scribble
I just got the iPad air 5th gen and also the Apple Pencil 2nd Gen and right when I started using the scribble function, I would get random static lines along the lettering or random parts of the screen. it only appears when I'm waiting and doesn't affect the actual things I'm writing. The iPad also automatically updated to the beta version of ios 18 because my iPhone is also on the beta. Is anyone else having this issue?
Replies
0
Boosts
0
Views
697
Activity
Jun ’24
PKToolPicker Available Tools
When I display the PKToolPicker in my app it looks similar to the image below If you use one of the apps from Apple like Pages or Freeform you see a picker similar to this one. Notice that the PKToolPicker from the Apple app has 6 tools not including the ruler. With the tool all the way to the left being the writing tool. How do you get the picker to display with the writing tool? I have looked over the API and I can see where you can set if the ruler is displayed or not but I can't find anything for the writing tool
Replies
1
Boosts
0
Views
1.2k
Activity
Jun ’24
UIIndirectScribbleInteraction recognition result error
Write "slack" by pencil, recognition result is "stack".
Replies
1
Boosts
0
Views
678
Activity
Apr ’24
Error versión
Error al crear la version
Replies
1
Boosts
0
Views
787
Activity
Oct ’23
iPadOS 14 Scribble language support
Hello there, Does Scribble on iPadOS 14 support languages other than English? I tried switching to the Korean keyboard and when I write, it tries to convert to the English characters. If not currently, does Apple plan on supporting other languages for Scribble in the future? I think that would be a great addition. Thank you.
Replies
27
Boosts
0
Views
19k
Activity
May ’23
Is there a scribble gesture for new line/return?
When writing in a text view, it would be useful to be able to enter new lines with scribble. Is there such a gesture? If not, I will submit a feedback request.
Replies
51
Boosts
19
Views
51k
Activity
Feb ’23
WKInterfaceTextField input stops running WKInterfaceTimer?
In my Watch app, I have a WKInterfaceTimer running. When the user taps in a WKInterfaceTextField and inputs some text (watch keyboard, or Scribble, or iPhone keyboard), it seems the timer is stopped, even when the user is done entering text. I want the timer to continue running the whole time. Has anyone else seen this? Is there a way around it? I .start the timer when I get the text field's callback, but it doesn't seem to work consistently, plus the timer is stopped while the keyboard/scribble is showing. My only alternative I can see is to perform the input somewhere else in the app, when the timer is not running (much less elegant). Thoughts?
Replies
1
Boosts
0
Views
1.2k
Activity
Nov ’22
Shape detection for other apps? (PencilKit, iOS 15)
Tried to ask as a comment in the other thread: https://developer.apple.com/forums/thread/650386?answerId=628394022#reply-to-this-question But can't leave a comment in there for some reason (the thread is locked?). Asking exactly the same question, now for iOS 15. Anything changed in this area? When selecting a stroke path for object on PKCanvas, the option "Snap to Shape" appears. I understand this function is still in beta and has not made available natively to other PencilKit app. Is there a way using Stroke API to call this function directly after the user hold pencil for half a second when stroke is done drawing, just like how it behaves in native apps?
Replies
1
Boosts
1
Views
1.9k
Activity
Sep ’22
Is there a way to know if a WkWebView is using scribble?
I have a WkWebView that I use to run a text editor. It works fine with scribble, and I can enter text with the stylus. However, I would like to disable scrolling with the stylus while scribble is enabled (otherwise, the view moves around when the user writes). But I'd like to keep the scrolling ability if the user is not using scribble. Hence the question: is there a way to know when scribble has been enabled, or if it's been enabled for this specific WkWebView? It's actually a webView, using SwiftUI; I don't know if it changes something.
Replies
0
Boosts
1
Views
981
Activity
Sep ’22
How to get auto-suggested word based on drawn Chinese character or stroke info in the form of an array of CGPoint?
I have an array consists of the CGPoint representing the chinese character stroke paths and able to re-draw out the character on UIView. I would like to use this existing information to find out the most similar chinese word. I notice the chinese keyboard hand-writing pad can display the suggested words. However, I have no idea which functions in the documentation that get this to work ( pass the stroke info as CGPoint, and get back suggested Chinese words). What API calls can I use to get the suggested words?
Replies
0
Boosts
0
Views
1.7k
Activity
Aug ’22
Scribble on iPadOS 16 (Beta) not working as before
The scribble functionality for the iPad (using Apple Pencil 2) isn't working as good as it was before (on iOS 15+). I take daily journals and set the title as follows: "YYYY-MM-DD". Previously, the scribble could detect everything ideally and matched the "no spaces" and all the numbers. With iOS 16 beta, most of the time, it ends up catching up something like this: "YYYY - MM M- DD". This is irritating since I have to go and delete the third digit for the month, and remove the spaces that scribble applies in between symbols.
Replies
0
Boosts
0
Views
1.3k
Activity
Jul ’22
How to stop auto-capitalization / auto-correct capitalized words to small letters when using Apple pen on textView?
I have specifically mentioned textView.autocapitalizationType = .none but when an input is done with Apple pen, the words entered will be automatically changed to Capital letter for the first word and other middle words which are originally entered as capitalized words being changed to small letters. If using keyboard for text input, no such issue. Even when I change the setting->keyboard, turn off autocapitalization, the words will still be changed to Capital letter for first words and other words all to small letters as long as using Apple pen. How can I programmatically forced the input by Apple pen to be exactly as what user key in ( which word to be in small letters, and which to be capital letters ), instead of autoCapitalized them and auto-turn capitalized words by user to small letters when it is not needed to do so at all. Thanks.
Replies
3
Boosts
2
Views
2.9k
Activity
Jul ’22
Apple pen and gaming
Years ago I used to use the Apple Pencil to play pubg. I used to move with my left hand and use the pencil in my right to control the view and shoot. I played today for the first time in a while and the pencil no longer works if my hand is already using the left side. Please tell me there’s a fix for this!!
Replies
0
Boosts
0
Views
1k
Activity
Jun ’22