Ability to stream logs to Cloudwatch Logs or Datadog
There's no way to stream logs from MongoDB on Atlas right now. I should be able to stream logs, either to Datadog or Cloudwatch or something!
Yes, I confirm the need to stream logs to the cloud provider streaming service ( example Azure Event Hub)
Any movement on this one that was raised back in 2019?
Logs, and activity feed also (like alerts, as datadog events)!
We believe shipping logs to S3 compatible object storage APIs such as AWS S3 or GCP Cloud Storage to be the highest priority and drive the most value. Many log routing frameworks support pulling logs from S3 or GCP and therefore you could cover more customer needs this way.
We would like to see database logs (all) prioritized first so that it is easy for our teams to view database status across all clusters and projects easily using our log provider (it's not Datadog/Cloudwatch/GCP).
The Atlas team should also consider https://feedback.mongodb.com/forums/924145-atlas/suggestions/43971369-send-atlas-logs-to-s3 when thinking about this functionality. Shipping to S3/GCP Storage would also allow Big Data frameworks such as GCP BigQuery or AWS Datalake to succeed. Therefore servicing the needs of internal data analysts as well as developers who need to view logs.
We really need this. Would be ideal if we can integrate with Splunk or DataDog to get database logs, audit logs, and atlas activity logs
This would be very nice to have; we are in some ways flying blind without this. Particularly I would like being able to stream out slow query logs to the datadog, to analyze using datadog's tooling and easily share it with other engineers.
I agree, stream the logs to Splunk for further security analysis will be great.
The ability to consolidate logs out of mongo private cloud (Atlas) into consumer cloud solution should be part of the base functionality framework of Atlas
looking forward to this integration to centralize all matrices in cloudwatch.
Syed Turab commented
need support to shop logs and metric into cloudwatch
+1 for sure. We're spending a significant time writing our own shipper that's polling the logs API (which only updates every 5min). Being able to provide an endpoint with an ElasticSearch or Splunk interface would be much appreciated.
We're shipping all the logs, server and audit, for all of our clusters.
This feature will be a lifesaver to us, we have a lot of monitoring/statistics using information from logs and we had to implement a job gathering it every 5 minutes. So, the time to download and process it, makes our analysis always be late.
+1 for streaming logs to Datadog. Having DB logs and slow query logs available on Datadog would make custom dashboards and debugging so much easier
I'm using data dog and would love to be able to stream logs there!
To push/stream logs into datadog can allow us to use one tool to monitor mongodb metrics and slow queries.
Sign me up for AWS CloudWatch. This would be almost as delicious as fried chicken.
Yes, this would be a huge benefit. We use Splunk, and there is no way to stream logs.
Same request for me. I need to have a continus integration of logs with corporate SIEM solution to analyse in real time events.
Same request for me: would be very usefull to gather logs and integrate them continuously in Cloud logging or Datadog. It could be very helpfull for security checks or app issue debug mainly. The most important is audit and database logs. Atlas logs are less "dynamic" once the service is up and running.