I have a large document. during my test with Pinecone. i found that i needed to split the document into chunk, and put into json format during the API Call to embedding with text-embedding-ada-002. ( i have few 800 words document, no split. i found that everytime i query the Pinecone, it always r…

Chunk & Embedding ( OpenAI + Pinecone )

SomebodySysop June 4, 2024, 4:23am 3

Topic		Replies	Views
Splitting text into chunks versus reducing the text API embeddings , ada	9	2086	April 5, 2024
Is there any sample code to split a json file into smaller chunks? API	11	11664	October 26, 2023
Embedding Longer Texts API	8	14151	December 25, 2023
How to Optimize Text Chunking for Improved Embedding Vectorization? API vector-db , semantic-search	6	9581	December 15, 2023
Creating embeddings for large text file from MongoDb API	2	865	April 2, 2024