Feedback

Kafka connector to support Kafka Schema Registry

One of the issues that our team has been talking about is when getting data from MongoDB, via a Kafka connector, and sending it through to Kafka we try to enforce schemas in Kafka but that schema is not enforced on the MongoDB data. This leads to ...

Guest over 4 years ago in Kafka Connector 1 Submitted

2 VOTE

Ability to replicate the data within a cluster to another cluster

Two different scenarios. One scenario is to have a DR cluster. 2 independant clusters that are one way synced. As of right now, a custom CDC solution (custom code + Kafka) is needed to achieve this. Another is because of latency and the requirem...

Guest over 4 years ago in Replication & Sharding 0 Submitted

1 VOTE

support regex in topic.namespace.map ( kafka source connector )

Currently, `topic.namespace.map` supports wildcard ( * ). It will be helpful if it also support regex as well. Or, since it can be breaking change, it would be nice if a new mapping is introduced that supports regex format. The workaround can be ...

Guest almost 3 years ago in Kafka Connector 0 Submitted

1 VOTE

Combine reshardCollection+mongosynd idea to support a remote collection on a separate new cluster

Great for prod productivity and 99.999 SLA if mongo could support this, for example, Given "mydb.mycoll" in current cluster being sharded with {zip:1} shard key 1/ New cluster: sh.shardCollection( "mydb.mycoll", {name:1, phone:1} ) 2/ "Mongocopy...

Guest about 3 years ago in Replication & Sharding 0 Submitted

1 VOTE

Dynamic Topic Mapping on the basis of message content

Currently mongodb source connector only supports dynamic topic mapping on the bases of collections/databases. Can we extend it to support routing on the basis of message content? Why it's important? We've currently setup connector for a very lar...

Guest over 3 years ago in Kafka Connector 0 Submitted

1 VOTE

Support $documents on shards

The new aggregation operator $documents cannot be used together with $merge in a sharded cluster, you get an error: ``` db.aggregate([ { $documents: [ { _id: ObjectId("6616b08a610fab3e84d2d4ee"), a: 'foo', shardKey: 1 }, ] }, { $merge: { in...

Wernfried Domscheit over 3 years ago in Replication & Sharding 0 Submitted

1 VOTE

Raise an error when "majority" writes not possible

This topic is related to https://www.mongodb.com/docs/v6.0/tutorial/mitigate-psa-performance-issues/ in a PSA ReplicaSet configuration. When you try to execute a command with writeConcern `{w: "majority"}` in a three-member Primary-Secondary-Arbi...

Wernfried Domscheit over 3 years ago in Replication & Sharding 0 Submitted

1 VOTE

Change stream total ordering within a transaction

Right now, change stream will flatten out a transaction into individual operations, i.e., if we do two operations within a transaction, change stream will generate two events. However there is no total ordering of the events that happens within t...

Guest over 3 years ago in Kafka Connector 0 Submitted

1 VOTE

URL Decode `readPreferenceTags`

If a url encoded value is set to readPreferenceTags it will be ignored causing for instance connecting to analytics node impossible from tooling that correctly encodes the urls. It can look like this for instance: `readPreferenceTags=nodeType:ANA...

Guest about 4 years ago in Replication & Sharding 0 Submitted

1 VOTE

built-in CDC to Kafka

Hi, it is still hard to set up a MongoDB oplog CDC connection to Kafka to publish changes from e.g. a microservice-local MongoDB. You typically have to use Kafka Connect and either the official MongoDB Atlas Connector, or the Debezium Open Source...

Guest over 4 years ago in Kafka Connector 0 Submitted

Please enter your email address

FILTER BY CATEGORY