Any ideas on which APIs to use for searching answers in video subtitles, and also linking to the video and subtitle where the ‘answer’ was found/derived from?
For instance, there could be a series of videos on mental health covering depression, dealing with trauma, distress management, etc.
When a question related to depression is asked, like, what are the early signs of depression, then the answer (assuming it is present) should be derived from the subtitles of the video(s) on depression, and the source should also be linked.
In this case, getting the videos and their subtitles is not a challenge.
Thanks for your detailed response @linus. In this case, getting the videos and their subtitles is not a challenge. Should have made this explicit in the post.
What needs to be done is to search the subtitles and find related subtitles for what is searched and link that moment in the video.
please excuse my long reply time, I had no adequate solution for you at the time but when I came over a different thread here in the forum I thought this would be a viable approach for your use case:Embeddings - OpenAI API
Did you consider embeddings as a option for your project already?
Thanks, @linus for your responses and no problem about the delay. As you rightly guessed had started using OpenAI Embeddings with Vector Store and Langchain to build a solution. Works well overall. But randomly, for the same input text and question it ends up taking up to 7 minutes to generate a response.
i believe current long processing times are due to the infrastructure changes on open AI’s end so this should get better in the next couple of days. There are a lot of posts regarding related issued (timeouts, long processing times…) at the Moment. It’s nit the first time this happens and should become better soon (at least I hope so )