Skip to content

Releases: woodlee/sqlserver-cdc-to-kafka

CDC-to-Kafka 2.1.1

05 Apr 14:01
Compare
Choose a tag to compare

Fixes a few minor bugs:

  1. Progress deletion tombstone message type not recognized when collecting stats
  2. Upon capture instance upgrades, exceptions were sometimes raised on LSNs being set to None
  3. Upon capture instance upgrades, tables that had no data in their capture instances would lead to the process restart that picks up the new instances being delayed indefinitely

CDC-to-Kafka 2.1.0

23 Mar 22:22
e561cba
Compare
Choose a tag to compare

Two minor improvements:

  • The process now specifies a different default Avro schema compatibility level for the "unified topic" messages. Previously, FORWARD compatibility was the default for all schema registry subjects created by this process. However, the unified topic's schema will often see a new record type added to its union type which represents the schemas of all tracked tables (i.e. whenever a new table starts being tracked), and adding a new member to an Avro union type is not a forward-compatible change. So we fall back to BACKWARD because it's about the best we can do. Single-table topics continue to default to FORWARD compatibility.
  • Prevents altering the compatibility level of a preexisting schema registry subject. The default compatibility levels are applied only if/when this process is creating a new subject in the registry.

CDC-to-Kafka 2.0.1

13 Jan 16:05
32f5a8a
Compare
Choose a tag to compare

This is a minor bugfix which upgrade fields in the Avro schema of progress-tracking messages from int to long, to handle cases where change data topics accumulate more than 2^31 messages.

CDC-to-Kafka 2.0.0

21 Feb 20:35
238117a
Compare
Choose a tag to compare

This is a major refactor providing several new features:

  • Production to "unified" topics that can contain properly-ordered changes across all or a selected subset of tables (i.e. a "DIY SQL Server tlog")
  • Enhanced detection and handling of capture instance changes, with schema evolution and restart-on-change capability
  • Improved data validation scripts
  • General performance improvements, particularly around speed of table snapshots

CDC-to-Kafka 1.2.1

10 Jan 16:29
75d012a
Compare
Choose a tag to compare
  • Fixes a performance issue with snapshot queries against tables with composite primary keys

CDC-to-Kafka 1.2.0

09 Jan 14:33
1c62aec
Compare
Choose a tag to compare

Adds the ability to specify a truncation length on specific fields, to work around large SQL rows causing Kafka producer errors due to oversized messages.

CDC-to-Kafka 1.1.2

07 Jan 17:17
3bf6171
Compare
Choose a tag to compare
  • Improves performance of change table queries that have different sets of clustered index columns

CDC-to-Kafka 1.1.1

06 Jan 19:32
22681d3
Compare
Choose a tag to compare
  • Resolves "sleep length must be non-negative" errors
  • Drops the confusing and relatively useless cdc_to_kafka_process_lag_sec metric (use the improved e2e_latency_* metrics instead!)

CDC-to-Kafka 1.1.0

03 Jan 22:20
dc11563
Compare
Choose a tag to compare

Improves process metrics reporting

CDC-to-Kafka 1.0.0

03 Jan 20:08
Compare
Choose a tag to compare

Initial release