Enable Removal of a Subset Documents From Online Archive
We'd like to have the ability to remove documents from an Online Archive. Mainly based on a date, but possibly other criteria.
We’re currently researching the best way to add support for this.
This is very important to us as we want to use online archive but having immutable documents is an issue for us.
We want to be able to archive cold documents in online archive and periodically update them. Removing by ID would work very well.
The situation is the same with us, we are interested in using archive online, and at the moment it is problematic for us because it is not possible to set deletions of the data.
+1 Same here. We too stopped using this feature s there is no option to purge data after certain period.
+1 Wanted to use Online Archive, but cannot due to the inability to automatically expire/remove data (e.g. 7 days after creation).
+1 as we are currently evaluating to use Atlas Online Archive. We are currently not taking it into consideration due to the lack of have TTL on archived data. We would like to have an TTL on archived data to be deleted from the storage automatically after e.g. 10 years.
AdminBenjamin (Admin, MongoDB) commented
Thanks for the suggestion Michael! We are actually planning on adding support for something similar in the coming quarters so please keep an eye on this idea, it will show progress updates as we proceed.
Agreed. Without any ability to automatically manage the size of the archive this feature is not viable for us.
Currently there is no way of managing an online archive besides nuking the entire collection. This means that the collection can only grow, so costs will continue to climb.
The TTL index can already be used to automatically delete documents from your database. If this could be expanded to also delete files which have been archived, there is an easy and built-in way of maintaining an archive in size.
We would like to see this feature in the future, too. That is particularly important for our log archival solution which deals with millions of audit logs per month. They should all expire and be deleted at some point to cut storage costs.