# Conversational app that generates Conversational Apps, BUT **URL:** \ **Category:** API\ **Tags:** gpt-4, gpt-35-turbo, api\ **Created:** [May 26, 2023, 6:19pm UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460 "2023-05-26T18:19:45Z")\ **Posts on this page:** 15\ **Page:** 1
**Author:** ![ameramayreh](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ameramayreh/32/131427_2.png) [@ameramayreh](https://community.openai.com/u/ameramayreh)\ **Post date:** [May 26, 2023, 6:19pm UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/1 "2023-05-26T18:19:45Z")
I’m working on a [Conversational App Engine](https://github.com/ameramayreh/conversational-app-engine) based app to generate conversational apps based on the same engine. But I’m hitting the wall of tokens limit. ![image](https://us1.discourse-cdn.com/openai1/original/3X/5/4/543b60bba8e5d8b875a596c5c6f4ed84f06ac836.png) As you know, GPT-4 has more max tokens, but I did not get access yet, I tried several times from March 20th to get access to GPT-4 with no luck. I tried to reach OpenAI support and employees to help in get me access , with no luck. Is there any way to increase the tokens limit for gpt-35-turbo model, or is there any available model that has more tokens and is not `Beta Limited` as GPT-4? The aim of this app (and the open-source Conversational App Engine) is to make GPT app development more accessible to more innovators. If you have any advise it getting red of this obstacle, it will be appreciated. ---
**Author:** ![dliden](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/dliden/32/49952_2.png) [@dliden](https://community.openai.com/u/dliden)\ **Post date:** [May 26, 2023, 6:48pm UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/2 "2023-05-26T18:48:25Z")
Can you implement a “moving window” in the conversation? i.e. omit or truncate past messages when you approach the token limits? Even though the [chat.openai.com](http://chat.openai.com) conversations can go on endlessly, the earlier content in the chat is eventually “forgotten.” ---
**Author:** ![ameramayreh](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ameramayreh/32/131427_2.png) [@ameramayreh](https://community.openai.com/u/ameramayreh)\ **Post date:** [May 26, 2023, 7:28pm UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/3 "2023-05-26T19:28:16Z")
Thanks for your reply, It is the first message sent to the API (along with the setup messages). The prompt is complex with about 3K tokens. ---
**Author:** ![anon22939549](https://avatars.discourse-cdn.com/v4/letter/a/f14d63/32.png) [@anon22939549](https://community.openai.com/u/anon22939549)\ **Post date:** [May 26, 2023, 8:46pm UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/4 "2023-05-26T20:46:49Z")
> [@ameramayreh](#): > > The aim of this app (and the open-source Conversational App Engine) is to make GPT app development more accessible to more innovators. It sounds like you’re a little out of your depth here. Because later, when you wrote, > [@ameramayreh](#): > > It is the first message sent to the API (along with the setup messages). The prompt is complex with about 3K tokens. It becomes clear that whatever it is you’re trying to accomplish, this isn’t the right way to go about it. I imagine most (if not all) of the logic should be moved away from the LLM. ---
**Author:** ![ameramayreh](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ameramayreh/32/131427_2.png) [@ameramayreh](https://community.openai.com/u/ameramayreh)\ **Post date:** [May 27, 2023, 9:24am UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/5 "2023-05-27T09:24:52Z")
Thanks @anon22939549 I think I did not get your idea. The Conversational App Engine alowes developers to prototype gpt based apps as js class, just by implementing predefined methods that 1) define the initial prompts of the conversation (othe than the user input), and, 2) define the code that will process the API response and generate the presentation view of the response. The app will not deal with the chat management, nor communicating with chat API. This is a simple thing to do for developers with a knowledge in prompt engineering. The project has step by step instructions about this. The result from one example app included in the project will look like: ![image](https://us1.discourse-cdn.com/openai1/original/3X/f/8/f8b8fe0b195d62afb13a76c8c919ab18796af46f.png) The idea of the Conversational App Creator app is to allow non-developers to implement their ideas, by utilizing LLM to ‘understand’ the idea of the app and generate the needed JS class. The initial prompt of the app have a detailed instructions about generating the initial prompts and the response processing code, in addition to examples on the app classes. Considering this, in addition to the expected response tokens, 4k of tokens will not be enough to experiment different prompts or to fit with such a need. I thought about generating the parts of the app separately, but this could lead to lose the context. I hope I put more context about the chalange that I’ll win 😁. ---
**Author:** ![martinrobson](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/martinrobson/32/397924_2.png) [@martinrobson](https://community.openai.com/u/martinrobson)\ **Post date:** [June 1, 2023, 10:11pm UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/6 "2023-06-01T22:11:05Z")
Google gpt prompt management. You’re going to need to get creative or pay $$$$ to use 4K tokens every time. ---
**Author:** ![ameramayreh](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ameramayreh/32/131427_2.png) [@ameramayreh](https://community.openai.com/u/ameramayreh)\ **Post date:** [June 2, 2023, 1:18am UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/7 "2023-06-02T01:18:27Z")
Thanks @martinrobson , I agree, I’m working on this direction and getting knowledge in advanced prompting techniques, mainly I’m reading [Learn Prompting course](https://learnprompting.org/docs/intro), and I think I’ll benefit from the [new courses of deeplearning.ai](https://www.deeplearning.ai/short-courses/) that I started to watch. But I think advanced models like GTP4 will need less prompt tokens to achieve the same results as less advanced models. I’m planning to contribute this to the open-source community, so it can be used to build consumer ready app generators on different platforms. So, I’ll not pay a lot if the cost of innovating new apps will be distributed to a lot of providers. Thanks ---
**Author:** ![bill.french](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/bill.french/32/15015_2.png) [@bill.french](https://community.openai.com/u/bill.french)\ **Post date:** [June 2, 2023, 2:37am UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/8 "2023-06-02T02:37:25Z")
> [@ameramayreh](#): > > GTP4 will need less prompt tokens to achieve the same results as less advanced models. Even if it does, you need to think about breaking this into many inferencing steps. Have you considered Langchain, for example? ---
**Author:** ![ameramayreh](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ameramayreh/32/131427_2.png) [@ameramayreh](https://community.openai.com/u/ameramayreh)\ **Post date:** [June 2, 2023, 5:22am UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/9 "2023-06-02T05:22:57Z")
Thanks @bill.french , I totally agree, I’m trying to gain the knowledge to be able to take the right decisions about the design needed to support different prompting techniques in the Conversational App Engine itself. I have not reached Langchain yet, it is part of the courses that I’m learning from and mentioned on my previous reply. I’ll consider pushing the implementation of Conversation App Creator app when it reaches a decent reliability and accept the contributions to enhance it. Thanks ---
**Author:** ![ameramayreh](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ameramayreh/32/131427_2.png) [@ameramayreh](https://community.openai.com/u/ameramayreh)\ **Post date:** [June 2, 2023, 5:58am UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/10 "2023-06-02T05:58:32Z")
@bocchesegiacomo01 , thanks for helping me testing the Conversational App Creator with GPT-4, sincerely appreciated. We tested the Conversational App Creator app with GPT-4 and as expected, we got better results, from tokens count and from accuracy perspectives. Here is an example, the screen shots are from the Conversational App Creator app and from the generated app, called AWS SAM Generator: First attempt: ![CAC_01](https://us1.discourse-cdn.com/openai1/original/3X/1/6/16a606de002e2adba8295a6437b7d2e9297cdb2f.png) Tested the app (Did not change any character of the generated code): ![CAC_02](https://us1.discourse-cdn.com/openai1/original/3X/e/b/eb89d310c45995256785c28ac873a10da280b893.png) Requested updates on the app: ![CAC_03](https://us1.discourse-cdn.com/openai1/original/3X/a/c/ac93dca5676ba723b6d880207ce4c7a52ffad45a.png) Tested the updated app (Again, I did not change any character of the generated code): ![CAC_04](https://us1.discourse-cdn.com/openai1/original/3X/5/3/537373942540139067912c94db12a720777078b6.png) I requested to update the app to render the graph of the resources: ![CAC_05](https://us1.discourse-cdn.com/openai1/original/3X/8/a/8a0139779194a78e1ce31ff3d80a966ff186fa03.png) I think this demonstrates the concept. I will try to push this app to the conversational app engine repo ASAP. And I will work on enhancing this app to reduce the need to do any enhancements on the generated code, so it can be used by non-developer innovators. I will consider your advice regarding enhancing the prompting to reduce the token usage. @dliden , @martinrobson , @bill.french . Thanks ---
**Author:** ![bocchesegiacomo01](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/bocchesegiacomo01/32/7180_2.png) [@bocchesegiacomo01](https://community.openai.com/u/bocchesegiacomo01)\ **Post date:** [June 4, 2023, 1:12pm UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/11 "2023-06-04T13:12:29Z")
> [@ameramayreh](#): > > thanks for helping me testing the Conversational App Creator with GPT-4, sincerely appreciated. > > We tested the Conversational App Creator app with GPT-4 and as expected, we got better results, from tokens count and from accuracy perspectives. > > Here is an example, the screen shots are from the Conversational App Creator app and from the generated app, called AWS SAM Generator: Very cool! one day i would like to try it ---
**Author:** ![ameramayreh](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ameramayreh/32/131427_2.png) [@ameramayreh](https://community.openai.com/u/ameramayreh)\ **Post date:** [June 5, 2023, 7:37am UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/13 "2023-06-05T07:37:55Z")
Thanks @bocchesegiacomo01 Dears, I pushed the new app [Conversational App Creator](https://github.com/ameramayreh/conversational-app-engine#conversational-app-creator-alpha-gpt-4-only) to the Conversational App Engine project. I’ll keep improving considering your advice @dliden , @martinrobson , @bill.french . While testing, I created Project Planner app, I did not modify any character of code, all is GPT made 🙂 ![ConversationAppCreator-02](https://us1.discourse-cdn.com/openai1/original/3X/0/5/0547433bdbbe44cf9f6e6c552a75ae16061df5f3.png) ![ConversationAppCreator-03](https://us1.discourse-cdn.com/openai1/original/3X/2/d/2d53fcf601dad4b6c6ecde493dd202ac1964f4bc.png) The conversation that led to generating the Project Planner app: ![ConversationAppCreator-01-Error](https://us1.discourse-cdn.com/openai1/original/3X/6/2/62c17f3459bd59a536b6bcf0108c063c90d05aef.png) Wish you a happy GPT innovation 😉 Thanks a lot ---
**Author:** ![ameramayreh](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ameramayreh/32/131427_2.png) [@ameramayreh](https://community.openai.com/u/ameramayreh)\ **Post date:** [June 11, 2023, 3:51am UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/14 "2023-06-11T03:51:34Z")
Google assistant notified me about this video talking about **LLM as Tool Makers** , which is a [paper](https://arxiv.org/abs/2305.17126) that has been published recently (Actually it was published on the same day I stared this topic 🙂 ) [![](https://us1.discourse-cdn.com/openai1/original/3X/1/7/176385653624ce09815dfd37fe77c860b6085184.jpeg "LLMs as Tool Makers [LATM] - GPT-4 \*UPGRADES\* lower AI Models.") ](https://www.youtube.com/watch?v=qWI1AJ2nSDY) It talks about the same concept of letting LLM creates tools that can be run on LLM. It shows that GPT-4 can be used as Tool Maker. ---
**Author:** ![ameramayreh](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ameramayreh/32/131427_2.png) [@ameramayreh](https://community.openai.com/u/ameramayreh)\ **Post date:** [July 29, 2023, 6:48pm UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/15 "2023-07-29T18:48:37Z")
A quick update on this topic. I started to use gpt-3.5-turbo-16k-0613 model with this app, it showed good performance with less cost. I took further steps by generating a sample user input and testing the generated class at runtime and displaying all that to the user. Also I moved the generated code to a separate tab. Currently I’m working on enhancing the accuracy of dealing with modification requests from the user. Once I’m done, I’ll publish this app. ![Conversational APP Creator - First Response - Preview](https://us1.discourse-cdn.com/openai1/original/3X/b/3/b3bd3ffbeeccf520bf4c3fba35868db0eccdc6d6.png) ![Conversational APP Creator - First Response - Code](https://us1.discourse-cdn.com/openai1/original/3X/0/7/07de51b48b2578d6c9bceb15c78e529c5a5d2d6f.png) It will not be tool long until we move to requirements based software development with the help of LLMs like gpt. ---
**Author:** ![EricGT](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/ericgt/32/20571_2.png) [@EricGT](https://community.openai.com/u/EricGT)\ **Post date:** [December 18, 2023, 9:46am UTC](https://community.openai.com/t/conversational-app-that-generates-conversational-apps-but/230460/16 "2023-12-18T09:46:06Z")