I want to build a simple chat bot without making api calls to the website im trying to base it off of

Hi,

First thanks for helping me. I’m trying to build a gpt for veterans based off our own internally produced wiki. I kind of got it to work making api calls through scraperapi but it is returning a “ResponseTooLargeError” for some of the web pages. I see that max char limit is 15,000 I think?

ChatGPT gave me some code for our back end to optimize but we would have to pay money to the web hosting site to allow us access to the back end. Scraperapi already wanted 50 dollars a month for 100k api calls.

Is there anyway to do this for free or cheaper? I have chat gpt pro but with everything combined we are looking at 70+ dollars a month and I got to believe there is a way to do it for free or very cheap?

Edit: I found zyte will let me 10k api calls a month for 7 dollars. Is that the best option?

The internal wiki can be found if you google “veteransbenefitskb” I cant post the link here directly. Im not sure if you would need to see it but I imagine it would help.

Thanks again.