Support Partial Indexing
We have a large collection but would only like to index the most recent entries, which would reduce the amount of space and resources it would take to index and query.
AdminDoug
(Director of Engineering, Atlas Search, MongoDB)
shared this idea
-
Dmytrii
commented
Our application uses the Mongo Atlas search engine for full-text searching. The application stores documents in a single collection, indexed by an arbitrary number of Atlas search indexes corresponding to the number of tenants. The document contains some common fields and each tenant can enrich the documents with exclusive/unique fields/attributes. Since each index indexes all the documents of a collection, this becomes very resource-intensive regarding indexing time, RAM, and disk.
At the moment, the only workaround that works for us is to move the tenants to their own collections, but this will make it difficult to access the whole set of documents. -
Maxym
commented
+1. This feature would help us too!
-
Dmitriy
commented
Critical for our needs
-
Mads
commented
Would be nice, we would like to ignore soft-deleted records
-
Andrii Hrachov
commented
Upvote. Highly needed, as we have to index circa 60% of our documents, it can save a lot of hardware resources
-
John
commented
Being able to keep non searchable documents out of the index is very important.
helps
- keep secure documents more secure by helping to avoid accidental query errors which leak protected content
- improves search performance -
Matan
commented
Sooooooooooo important!!!!!!!!!!!!!!!!!
-
Davide
commented
This would be strongly needed. The current workaround is to create a separate collection, but then we cannot use a $out stage to populate it without destroying the index as said here:
https://docs.atlas.mongodb.com/reference/atlas-search/create-index/We are currently solving with a $merge stage but a partial index would be definitely a better solution.
-
Jonathan
commented
We dont want this data to be searchable with mongo search, but searchable with mongodb basic indexing. Mongo Search index performance will be much better if we can have this option and keep old data to be retriever with mongot index.
-
AdminMarcus Eagan
(Admin, MongoDB)
commented
Today, you may be able to move documents in a collection that you do not want searchable to online archive.
-
Jonathan Gautier
commented
Any news about this feature ? We have more than 100 millions documents and only 600k public searchable. This can improuve the performance without upgrading server.
-
Eric
commented
In several collections, we have tens of millions documents, but only 1-5 million are public/searchable in any given collection. It seems tragic to index all 50 million documents when only 5 million are public.