Hi,
Could you please provide me with your top suggestions for indexing several million QA posts and storing them in vector Pinecone?
In terms of chunking, would it be better to process them on a post-by-post basis or to combine several hundred posts into a single document and then chunk that document?
How to keep context between chunks?