Ability to stream logs to Cloudwatch Logs or Datadog
There's no way to stream logs from MongoDB on Atlas right now. I should be able to stream logs, either to Datadog or Cloudwatch or something!
Idris
shared this idea
-
Charlie
commented
Another request for Datadog log file streaming or integration to automatically pull server logs over.
-
Björn
commented
Would appreciate a streaming solution for the audit logs to Splunk as well. The solution mentioned by Andrew (push-based integration for logs to S3) would work for us as well. So where can I upvote for this solution ;-)
-
Hi Dan,
Out of curiosity, what is your preferred cloud provider? We plan to introduce push-based integrations for logs to cloud object storage in the future, targeting S3 first: we believe it should be easy to go to any SIEM or log solution like Splunk from there. I'm sorry we don't have something to serve your needs yet.
Note that we have pull-based integrations with jSonar (they can push to Splunk I believe) and Sumo Logic today.
-Andrew
-
Dan
commented
I'm trying to get logs from MongoDB Atlas to Splunk, and there's currently no native interface to do it, so instead of streaming to Splunk directly, I'm having to execute https calls in intervals, unzip them and then ship them to Splunk. Many products have interfaces to stream to Splunk directly, and it would certainly be handy in this situation.
-
Abhilash
commented
Hi Todd,
looking for plugin to send mongo audit logs to splunk.
-
Hi Todd,
We'd love to see you provide this feedback to Splunk too. We do plan to introduce a push-based destination for logs to S3 in the future which will open up more options.
Otherwise, in the interim we have pull-based integrations from jSonar (they can in fact route to Splunk) and Sumo Logic.
Cheers
-Andrew -
Todd
commented
We need a way to easily ingest logs into Splunk. It needs to be all logs - node and web portal activity. Ideally a Splunk connector would be provided but a stop-gap measure would be the ability to configure Atlas to write all logs to an Azure storage account.
Lack of native log ingestion ability may be an Atlas deal killer for us.
-
TryTada
commented
It would be great if the Datadog was available for all cluster sizes, not just m10+.
-
Hey Idris!
Thanks for the feedback. Could I ask which logs you were most interested in being able to export/stream to a third party service: database logs, audit logs, or Atlas activity logs, etc? I'm sure you already know this but Atlas does currently integrate with Datadog for metric data (https://docs.atlas.mongodb.com/tutorial/third-party-service-integrations/), though we don't yet support pushing logs to Datadog at the moment.
Could you also add some color on why this is important to you? How does it fit into your workflow?
