I have a large set of suggestions/ideas. Around 250 000. Many of them are similarly or almost exactly the same.
I want to reduce down the suggestions and categorize them.
I know I have to use embeddings for this but then how do I best reduce them down and categorize them?
I have two scenarios were I want to use this.
The first one.
Development suggestions that you get from customers. Many of them are the same but with different words and you want that list smaller removing duplicates.
The other one
Users can add sentences for different responses to users. Also these we want to go through and se how many are the same and how many times they are used and populate a condensed list.