Skip to content

CDC-to-Kafka 3.1.0

Compare
Choose a tag to compare
@woodlee woodlee released this 27 Mar 22:06
· 22 commits to master since this release
479e2ed

Changes in this version

  1. A new execution option, REPORT_PROGRESS_ONLY, was added. If set, the process starts, prints the table of its current progress against followed tables, and exits without making any changes.
  2. Tracking of snapshot completion was improved. Previously, tables that had a PK that was not monotonically increasing (such as a GUID) would, at process start, begin a new snapshot to pick up any rows with PK values lower than the lowest value seen by a prior invocation's snapshot. Since such rows also appear as inserts in the change data events, this represented an unnecessary duplication and caused confusion. In addition, it was possible that a table that contained no rows when it was first tracked would be snapshotted the next time the process restarted, if rows had been added in the interim. Again this was unnecessary since the added rows would be present in the change data events. Both issues have been fixed.
  3. Cleaned up confusing and overly verbose logging that would be printed when something changed in the tracked capture instances on the SQL Server side.
  4. Fixed a bug that could cause the process to incorrectly believe that there was a coverage gap in the LSNs between old and new capture instances for a given table, particularly for low-change-volume tables.
  5. Upgrade package dependencies and the Python version used for the Docker image.