Blog / Build note

Pen Pal is open source: a handwriting AI assistant for the Kindle Scribe

By ·

Pen Pal is public. The code is on GitHub under the MIT licence, and the latest release has a zip with everything but the display tool, ready to copy over. When I first wrote about it I said you couldn’t download it. Now you can.

Pen Pal is the app that lets my jailbroken Kindle Scribe answer questions I write with the pen. I wrote about building it on October 5.

One real question on my Scribe. The writing is sped up 2x and the wait for the answer is cut. The calendar items on screen are samples.

What is Pen Pal?

You write on the page with the pen and tap a star. The answer appears underneath your handwriting, written out in a handwriting font. There’s no keyboard and no chat window.

It opens on a Today screen with your calendar events and your to-dos, and a blank page under them for whatever you want to write. Every page is backed up to a server you run.

Did it work the first time I installed it?

No. It took three tries, and the first failure was one character.

I had run Pen Pal on my own Scribe for weeks, but that’s the private version. Before telling anyone to install the public one, I installed the public one, fresh, following my own instructions. Claude ran the commands. I tapped the screen.

I wrote “Test” and tapped the star. The screen said, “I couldn’t take this page now. Your ink is safe here; tap the star to ask again.”

The cause was a carriage return. Windows puts one at the end of a line, and one was sitting at the end of my key file, where a key isn’t supposed to have a line ending. The server looked at the request, found no length on it, and refused every ask. One character.

I didn’t know what a carriage return was. When Claude named it, I said, “great, fix it,” with no idea what the fix would be. I approved a repair for a problem I couldn’t see. (Five lines across four files, it turned out.)

Then I wrote a real question, tapped the star, and watched the Scribe think about it. The screen went blank.

“WTF, Claude.”

The answer was fine. It had been written and saved on a blank placeholder day dated January 1, while the app moved on to the real one. The first launch had no key to fetch today’s page with, so it started on the placeholder, and the real day replaced it after my first question. The fix was ten lines, three of them comments. I approved that one too.

The next time, I wrote a question, tapped the star, and about eight seconds later it was answering in handwriting, with no reset. Both bugs are fixed in the public code, and a test now checks the first one.

What’s in the open-source version?

The Kindle app is a native program that draws straight to the e-ink screen, which is why the pen feels like a pen. The server is a small Python program that reads your handwriting with an AI model and writes the answer back.

For Today, you paste in your calendar’s secret iCal link and your events show up with their notes. TickTick is optional. The page backup keeps the strokes, a picture of each page and a text note with the transcript. There’s a setup guide, an install script and a set of tests too.

What isn’t in it?

My Hermes. At home, Pen Pal talks to Hermes, the personal assistant I run on my own server, and Hermes remembers things. The public version talks to a plain AI model that you choose, with a key you provide. It remembers the last two exchanges from the past few hours and nothing else. The assistant on the page is still called Hermes.

The jailbreak isn’t in it either. The Kindle modding community keeps good guides at kindlemodding.org, and I’d start there.

The small tool that puts the drawing onto the e-ink panel, fbink_xdamage, is also missing. It’s a separate project with no licence, so I can’t hand it out. You build it yourself, and the setup guide says how.

What do you need to run it?

You need a jailbroken Kindle Scribe with SSH working. I built and used it on a first-generation Scribe. KindleModding lists the second generation as covered by the same jailbreak, and I haven’t tried it. As far as I can tell the 2025 Scribe and the Colorsoft can’t be jailbroken yet, so Pen Pal can’t run on them.

You also need a computer or small server that stays on, because the Kindle talks to it, and an API key from an AI provider that can read images and speaks the common chat format. I ran my last test with a Qwen model through OpenCode Go. If you use OpenCode Go, it wants a session header on every request, so set INK_VISION_SESSION to any fixed string. Other providers don’t need that.

What does it cost?

The code is free. You pay your AI provider for each page it reads. I haven’t measured what a normal week costs on this setup, so I won’t guess at a number.

Why open source it?

Only the first two generations of Scribe can be jailbroken right now, so not many people can run this at all. Selling it would mean supporting it, and the jailbreak can break whenever Amazon ships an update. I’d rather put the code where anyone can read it and build on it. It also shows what I can build with AI.

What can’t it do yet?

I’ve tested exactly one Scribe: mine, first generation, over an SSH tunnel to a server on my laptop. My laptop’s firewall wouldn’t let the Scribe connect directly over Wi-Fi, so that path is untested. Other Scribe models are untested too.

It has no memory across days: it sees the last couple of exchanges and that’s all. It’s a hobby project, so I can’t promise support or fixes on any schedule. And a Kindle update can undo the jailbreak. I wrote more about that, and why you should think twice before jailbreaking your only e-reader, in the first post.

How do you set it up?

Jailbreak the Scribe and get SSH working. Start the server with your API key. Download the release zip and run install.sh with your Scribe’s address and your server’s address. It copies the files, makes up a matching key, and prints the command to start the server. If an install is already there, it stops until you add --replace, and then it moves the old one aside instead of deleting it. Open Pen Pal from the library. The setup guide has every step.

I used --replace on my own Scribe, ran the public version, and then put my private one back. It matched my backup file for file.

What did I learn getting it ready for strangers?

Before I deleted more than a thousand lines of old code that the Kindle app could never reach, I replayed a whole day through the real drawing code: Today, a calendar event, questions and answers, going offline, a new day. After the deletion I replayed it again. That’s 23 screenshots, and they matched to the pixel.

The best surprise came from my first test with a real AI model. It opened its answer with, “I read ‘soil mix for tomatoes’ as a request for a recipe.” My instructions said to mention how it read my writing only when it had clearly misread something. A small model took that as an invitation to narrate. I tightened the wording and it stopped.

What’s next?

I’ll keep using Pen Pal and writing down what happens. If you try it and something breaks, the fastest way to reach me is LinkedIn.

Quick answers

Is Pen Pal free?
The code is free under the MIT licence. You pay your AI provider directly for the pages it reads, and nothing goes through me.
Is there a ready-made download?
Yes. The latest release on GitHub has the built app, the install script and the fonts in one zip. It doesn't include fbink_xdamage, the small tool that draws on the e-ink panel, because that project has no licence. You build it yourself, and the setup guide says how.
Which Kindle Scribe models can run Pen Pal?
I built it on a first-generation Scribe, firmware 5.19.6, and that's the only one I've tested. The community jailbreak also covers the second generation, which I haven't tried. As far as I can tell, nothing jailbreaks the 2025 Scribe or the Colorsoft as of early November 2026, so Pen Pal can't run on those.
Do I need to know how to code to set it up?
You need SSH working on your jailbroken Scribe, a computer that stays on, and a little patience with a terminal. The install script copies the files for you, but the server is a Python program you start yourself. It isn't a one-click install.
Does Pen Pal send my handwriting anywhere?
Your handwriting goes to the AI provider you set up. That covers the pages you ask about and every page the backup reads to make a searchable transcript. If you switch on TickTick, task titles go to TickTick. The backup itself stays on a server you run.
Does it work with Google Calendar and TickTick?
Yes, both are optional. Google Calendar works through its secret iCal link, so there's no sign-in to set up. TickTick works with an API token, and once it's on, a box you draw with the pen becomes a task.