Enable Removal of a Subset Documents From Online Archive
We'd like to have the ability to remove documents from an Online Archive. Mainly based on a date, but possibly other criteria.
We’re currently researching the best way to add support for this.
+1 as we are currently evaluating to use Atlas Online Archive. We are currently not taking it into consideration due to the lack of have TTL on archived data. We would like to have an TTL on archived data to be deleted from the storage automatically after e.g. 10 years.
AdminBenjamin (Admin, MongoDB) commented
Thanks for the suggestion Michael! We are actually planning on adding support for something similar in the coming quarters so please keep an eye on this idea, it will show progress updates as we proceed.
Agreed. Without any ability to automatically manage the size of the archive this feature is not viable for us.
Currently there is no way of managing an online archive besides nuking the entire collection. This means that the collection can only grow, so costs will continue to climb.
The TTL index can already be used to automatically delete documents from your database. If this could be expanded to also delete files which have been archived, there is an easy and built-in way of maintaining an archive in size.
We would like to see this feature in the future, too. That is particularly important for our log archival solution which deals with millions of audit logs per month. They should all expire and be deleted at some point to cut storage costs.