# Introducing BookLed: a paper book augmented with generative AI **URL:** \ **Category:** Community\ **Tags:** project, api, tts, image-reading, gpt-4o\ **Created:** [June 14, 2024, 2:57pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765 "2024-06-14T14:57:17Z")\ **Posts on this page:** 17\ **Page:** 1
**Author:** ![gravizza](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gravizza/32/283738_2.png) [@gravizza](https://community.openai.com/u/gravizza)\ **Post date:** [June 14, 2024, 2:57pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/1 "2024-06-14T14:57:17Z")
Hi everyone! I’m excited to share a project I’m working on called **BookLed**. BookLed is a hardcover **paper book** , containing electronic hardware, designed for experimenting new ways of storytelling using Generative AI. With a BookLed, a Python code and an **OpenAI API** account you can explore the world of AI storytelling starting from the pages of a paper book! ![094-358x239 medres](https://us1.discourse-cdn.com/openai1/original/4X/8/a/8/8a8c763b3595632627ad0ac24c97a90de7b99d72.jpeg) In the BookLed [GitHub repository](https://github.com/robotoons/BookLed) , examples of **Python** and Jupyter Notebook **open-source codes** are collected to explore interfacing this paper book with OpenAI APIs. See the [BookLed wiki](https://github.com/robotoons/BookLed/wiki) . ![085-307x205 medres](https://us1.discourse-cdn.com/openai1/original/4X/d/8/2/d826d38858f8096b66d23870277801417e8de8fd.jpeg) So, connecting BookLed to your PC and launching a **Jupyter Notebook** , the Python code identifies the book’s page and delivers the multimedia content synchronized with the turning of the pages: - Soundtrack of the book. - Contents generated through the indications of a **prompt**. ![BookLed_Diagram_Soundtrack-576x297](https://us1.discourse-cdn.com/openai1/original/4X/7/9/d/79d9c3c030df2b823445b29574ecbfe40403f7dd.jpeg) See the [BookLed video](https://youtu.be/s0RE-ibNndk) . I’m open to feedback and suggestions from the community to improve BookLed and and guide its future development. I look forward to your insights! Thank you! [www.bookled.com](https://www.bookled.com/) [www.robotoons.com](https://gravizza.wixsite.com/robotoons) ---
**Author:** ![jr.2509](https://avatars.discourse-cdn.com/v4/letter/j/76d3ee/32.png) [@jr.2509](https://community.openai.com/u/jr.2509)\ **Post date:** [June 14, 2024, 3:20pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/2 "2024-06-14T15:20:07Z")
That’s a pretty neat idea. Are you planning to make it interactive? ---
**Author:** ![gravizza](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gravizza/32/283738_2.png) [@gravizza](https://community.openai.com/u/gravizza)\ **Post date:** [June 14, 2024, 3:50pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/3 "2024-06-14T15:50:36Z")
Hi jr.2509, currently, there are two ways to interact with the paper book: - Turn the pages to navigate forward or backward through the story. - Use a small **navigation switch** to, for example, answer YES/NO questions posed by the LLM. The original project envisioned additional interaction methods, but these have not been implemented yet in order to keep the overall hardware cost low. ---
**Author:** ![PaulBellow](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/paulbellow/32/597962_2.png) [@PaulBellow](https://community.openai.com/u/PaulBellow)\ **Post date:** [June 14, 2024, 5:13pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/4 "2024-06-14T17:13:14Z")
Welcome to the OpenAI dev community forums! Thanks for adding the #project tag. If you keep updates in this thread, it’s easier for everyone to keep up to date on your progress. Are you storing API keys on the book, then? As a writer myself, I’m curious about the tech. ---
**Author:** ![gravizza](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gravizza/32/283738_2.png) [@gravizza](https://community.openai.com/u/gravizza)\ **Post date:** [June 14, 2024, 10:27pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/5 "2024-06-14T22:27:54Z")
Hi Paul, Thank you for your question. The current version of BookLed is designed for makers and AI enthusiasts who want to experiment with generative AI integrated with very low-cost hardware. Therefore, it is assumed that the BookLed user is quite experienced, has their own OpenAI API account, and knows how to write their API key to an .env file within the Python environment. As such, the API key is stored in the Python environment and not within the book itself. If the BookLed project were to reach the general public, the management of API keys and the pricing/billing model would need to be reconsidered and made more user-friendly. Since you’re a writer too, I’d love to hear your thoughts on this new narrative model I’m proposing. In BookLed, there are two components: - A “ **fixed** ” and immutable part, which is the content printed on paper (created by the writer). - A “ **dynamic** ” and modifiable part, which is the content generated in real-time by the generative AI. The AI is constrained by a predetermined path, dictated by the narrative printed on the pages. While the story’s framework remains unchanged, the AI can interpret and present it in infinitely diverse ways. What are your thoughts? Over the next month, I will continue experimenting and look forward to the new GPT-4o APIs to further enhance the interaction with the BookLed. ---
**Author:** ![gravizza](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gravizza/32/283738_2.png) [@gravizza](https://community.openai.com/u/gravizza)\ **Post date:** [June 15, 2024, 9:34am UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/6 "2024-06-15T09:34:39Z")
> [@gravizza](#): > > Hi jr.2509, What kind of further interaction did you imagine? Do you want to give me some suggestions that I could try? ---
**Author:** ![jr.2509](https://avatars.discourse-cdn.com/v4/letter/j/76d3ee/32.png) [@jr.2509](https://community.openai.com/u/jr.2509)\ **Post date:** [June 15, 2024, 11:11am UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/7 "2024-06-15T11:11:38Z")
It was just a thought on top of my mind that it could be nice to have an interaction between the reader and the content on the book as you go through the pages, such as with the reader making a comment or asking a question and the model then providing some additional response. Based on the picture it looked like this was a children’s book. As parents often read books together with their children and interact on the content, the model responses could further enrich this interaction perhaps. ---
**Author:** ![gravizza](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gravizza/32/283738_2.png) [@gravizza](https://community.openai.com/u/gravizza)\ **Post date:** [June 15, 2024, 5:52pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/8 "2024-06-15T17:52:38Z")
Hi jr.2509, thanks for sharing your ideas with me. I really appreciate it very much. With the APIs available at the moment, waiting for the truly multimodal gpt-4o API, I could test the interaction you propose with a code represented in the following diagram: ![BookLed Audio Input](https://us1.discourse-cdn.com/openai1/original/4X/c/a/0/ca00fda6d574a3138414e6c24bbe1f58b703a758.jpeg) It would work like this: - I’m waiting for a USER INPUT AUDIO. - When the user makes a request I transform it into text via the **OpenAI Whisper API**. - I elaborate it with an appropriate prompt throgh **GPT-4o** API call. - I produce the response again in MP3 via **TTS**. All this complexity could be useless as soon as the guys at OpenAI make the **multimodal API** (audio in → audio out) of gpt-4o available I’ll try to implement your suggestion in a Python code that I will put on [Jupyter Notebook examples section](https://github.com/robotoons/BookLed/wiki/9.-Jupyter-notebook-codes) of BookLed’s GitHub. As soon as it’s ready, I’ll post a test video here. Thanks again for the suggestion. Graziano ---
**Author:** ![anon10827405](https://avatars.discourse-cdn.com/v4/letter/a/ed8c4c/32.png) [@anon10827405](https://community.openai.com/u/anon10827405)\ **Post date:** [June 15, 2024, 6:17pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/9 "2024-06-15T18:17:06Z")
This is cool. Reminds me of point and click adventure games back in the day. Good luck! ---
**Author:** ![gravizza](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gravizza/32/283738_2.png) [@gravizza](https://community.openai.com/u/gravizza)\ **Post date:** [June 15, 2024, 8:03pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/10 "2024-06-15T20:03:26Z")
Thank you Ronald. The Secret of Paper&AI Island! 🤣 🤣 🤣 ---
**Author:** ![gravizza](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gravizza/32/283738_2.png) [@gravizza](https://community.openai.com/u/gravizza)\ **Post date:** [June 30, 2024, 2:40pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/11 "2024-06-30T14:40:39Z")
Hi everyone. Today I posted the BookLed project and the **open-source** Python codes on the makers website [hackaday.io](http://hackaday.io) > **[BookLed](https://hackaday.io/project/196739-bookled)** > > With a BookLed, a Python code and an OpenAI API account you can explore the world of AI storytelling starting from the pages of a paper book! In the BookLed GitHub repository, examples of Python and Jupyter notebook open source codes are collected to... I hope to have luck in spreading the project. Graziano ---
**Author:** ![khaled786](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/khaled786/32/147846_2.png) [@khaled786](https://community.openai.com/u/khaled786)\ **Post date:** [August 4, 2024, 12:01am UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/12 "2024-08-04T00:01:21Z")
How is the journey going? ---
**Author:** ![gravizza](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gravizza/32/283738_2.png) [@gravizza](https://community.openai.com/u/gravizza)\ **Post date:** [August 4, 2024, 12:21pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/13 "2024-08-04T12:21:22Z")
Hi Khaled, at this moment we are still in the initial phase of the journey 😉 We are writing the Business Plan of our company and we are starting to face practical problems. For example, the OpenaAI TTS model costs 15$ per million characters! It is a lot and with these costs a product like ours is not sustainable. We are looking for TTS that cost less or we are evaluating the idea of ​​doing text-to-speech within our SW with some appropriate library… ---
**Author:** ![MiddayEnglishman](https://avatars.discourse-cdn.com/v4/letter/m/bc8723/32.png) [@MiddayEnglishman](https://community.openai.com/u/MiddayEnglishman)\ **Post date:** [August 4, 2024, 2:52pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/14 "2024-08-04T14:52:37Z")
That was the dirtiest drop I’ve ever seen!, When and where can I buy one? Well done on this, I’m a Sci fi nerd and have been making custom GPT’s for awhile and experimenting on pushing the boundaries!. Do you use AIdungeon or character.ai? Just wondering what the next great story AI will be… please don’t give up on this!, waiting to preorder. ---
**Author:** ![gravizza](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gravizza/32/283738_2.png) [@gravizza](https://community.openai.com/u/gravizza)\ **Post date:** [August 4, 2024, 6:48pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/15 "2024-08-04T18:48:41Z")
Hi, as soon as the product will be available to the public (that is, as soon as we can complete the infrastructure) I will let you know right away. I saw that you have started selling your book on Amazon! I see also your web at bridgeofbits.ai Is the content of the book similar to the web content? ---
**Author:** ![MiddayEnglishman](https://avatars.discourse-cdn.com/v4/letter/m/bc8723/32.png) [@MiddayEnglishman](https://community.openai.com/u/MiddayEnglishman)\ **Post date:** [August 4, 2024, 7:48pm UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/16 "2024-08-04T19:48:46Z")
We’re you responding to me? Book? ---
**Author:** ![gravizza](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gravizza/32/283738_2.png) [@gravizza](https://community.openai.com/u/gravizza)\ **Post date:** [August 9, 2024, 9:33am UTC](https://community.openai.com/t/introducing-bookled-a-paper-book-augmented-with-generative-ai/819765/17 "2024-08-09T09:33:26Z")
Hi Midday, I was speaking about the book you are selling on Amazon. Are the contents of the book similar to the contents of the website?