Skip to content

Releases: crate/commons-codec

v0.0.22

28 Oct 12:50
Compare
Choose a tag to compare

What's Changed

  • DynamoDB/Testing: Use CrateDB nightly again
  • DynamoDB: Use ON CONFLICT DO NOTHING clause on CDC operations
    of type INSERT, to mitigate errors when events are relayed
    redundantly from retries after partially failed batches on the
    Lambda processor.

Details

  • Chore(deps): Update pyproject-fmt requirement from <2.3 to <2.4 by @dependabot in #70
  • Chore(deps): Update sphinxcontrib-mermaid requirement from <1 to <2 by @dependabot in #71
  • Chore(deps): Update mypy requirement from <1.12 to <1.13 by @dependabot in #72
  • Chore(deps): Update ruff requirement from <0.7 to <0.8 by @dependabot in #74
  • Chore(deps): Update pyproject-fmt requirement from <2.4 to <2.5 by @dependabot in #73
  • Chore(deps): Update validate-pyproject requirement from <0.21 to <0.22 by @dependabot in #75
  • DynamoDB/Testing: Use CrateDB nightly again by @amotl in #76
  • Chore(deps): Update validate-pyproject requirement from <0.22 to <0.23 by @dependabot in #78
  • Chore(deps): Update mypy requirement from <1.13 to <1.14 by @dependabot in #79
  • DynamoDB: Use ON CONFLICT DO NOTHING clause on INSERT CDC operations by @amotl in #77

Full Changelog: v0.0.21...v0.0.22

v0.0.21

09 Oct 08:32
Compare
Choose a tag to compare

What's Changed

  • MongoDB: Fixed BSON decoding of {"$date": 1180690093000} timestamps
  • DynamoDB: Use CrateDB 5.8.3 for testing because 5.8.4 can no longer
    store ARRAYs with varying inner types into OBJECT(IGNORED) columns.

Details

  • Chore(deps): Update toolz requirement from <0.13 to <1.1 by @dependabot in #66
  • Chore(deps): Update pymongo requirement from <4.10 to <4.11 by @dependabot in #68
  • DynamoDB and MongoDB: Fix CI and improve decoding by @amotl in #69

Full Changelog: v0.0.20...v0.0.21

v0.0.20

30 Sep 21:54
Compare
Choose a tag to compare

What's Changed

  • DynamoDB: Change CrateDB data model to use (pk, data, aux) columns
    Attention: This is a breaking change.
  • MongoDB: Handle too large $date.$numberLong values gracefully
  • Zyp/Moksha: Improve error reporting when rule evaluation fails

Details

  • Chore(deps): Update poethepoet requirement from <0.29 to <0.30 by @dependabot in #62
  • Chore(deps): Update validate-pyproject requirement from <0.20 to <0.21 by @dependabot in #63
  • DynamoDB: Change CrateDB data model to use (pk, data, aux) columns by @amotl in #64
  • Improvements for Zyp/Moksha error reporting and MongoDB $date.$numberLong values by @amotl in #65

Full Changelog: v0.0.19...v0.0.20

v0.0.19

25 Sep 23:41
Compare
Choose a tag to compare

What's Changed

  • DynamoDB CDC: Fix MODIFY operation by propagating NewImage fully by @amotl in #60
  • Zyp/Moksha: Improve error reporting when rule evaluation fails by @amotl in #61

Full Changelog: v0.0.18...v0.0.19

v0.0.18

25 Sep 10:57
Compare
Choose a tag to compare

What's Changed

  • MongoDB: Improved MongoDBCrateDBConverter.decode_canonical to also
    decode non-UUID binary values
  • Zyp/Moksha/jq: to_object function now respects a zap option, that
    removes the element altogether if it's empty
  • Zyp/Moksha/jq: Improve error reporting at MokshaTransformation.apply
  • MongoDB: Improved MongoDBCrateDBConverter.decode_extended_json

Details

  • Chore(deps): Update pymongo requirement from <4.9 to <4.10 by @dependabot in #55
  • Zyp and MongoDB: A few adjustments and refinements by @amotl in #57
  • MongoDB: Fix BSON decoder by @amotl in #59

Full Changelog: v0.0.17...v0.0.18

v0.0.17

22 Sep 09:10
Compare
Choose a tag to compare

What's Changed

  • MongoDB: Fix edge case when decoding MongoDB Extended JSON elements by @amotl in #52
  • Zyp: This and that: Mostly documentation and software tests by @amotl in #53
  • Zyp: Export main symbols via zyp namespace by @amotl in #54

Full Changelog: v0.0.16...v0.0.17

v0.0.16

19 Sep 14:07
Compare
Choose a tag to compare

What's Changed

  • MongoDB: Added MongoDBFullLoadTranslator and MongoDBCrateDBConverter
  • Zyp: Fixed execution of collection transformation
  • Zyp: Added software test and documentation about flattening lists
  • MongoDB: Use bson package to parse BSON CANONICAL representation
  • MongoDB: Complete and verify BSON data type mapping end-to-end
  • MongoDB: Use improved decoding machinery also for MongoDBCDCTranslator
  • Dependencies: Make MongoDB subsystem not strictly depend on Zyp
  • Zyp: Translate a few special treatments to jq-based MokshaTransformation again
  • Zyp: Improve documentation
  • Packaging: Add missing MANIFEST.in

Details

  • MongoDB: Code refactoring and generalization by @amotl in #49
  • Zyp: Improve jq-based Moksha transformations and general documentation by @amotl in #50

Full Changelog: v0.0.15...v0.0.16

v0.0.15

10 Sep 17:08
Compare
Choose a tag to compare

What's Changed

  • Zyp Treatments: A slightly tailored transformation subsystem by @amotl in #46

Full Changelog: v0.0.14...v0.0.15

v0.0.14

02 Sep 13:57
Compare
Choose a tag to compare

What's Changed

  • Replace poor man's relation name quoting with implementation
    quote_relation_name from sqlalchemy-cratedb package.
  • DynamoDB: Add special decoding for varied lists, storing them into a separate
    OBJECT(IGNORED) column in CrateDB.
  • DynamoDB: Improve to_sql() to accept list of records.

Details

  • DynamoDB: Add software test for decoding list of objects by @amotl in #37
  • Replace poor man's relation name quoting with implementation from sqlalchemy-cratedb by @amotl in #38
  • DynamoDB: Add special decoding for varied lists by @amotl in #39
  • DynamoDB: Compress transformation tests into single one. Naming things. by @amotl in #41
  • DynamoDB: Add integration test for full-load operation by @amotl in #42
  • DynamoDB: Improve to_sql() to accept list of records by @amotl in #43
  • Chore(deps): Update cattrs requirement from <24 to <25 by @dependabot in #44
  • Chore(deps): Update poethepoet requirement from <0.28 to <0.29 by @dependabot in #45

Full Changelog: v0.0.13...v0.0.14

v0.0.13

27 Aug 06:55
Compare
Choose a tag to compare

What's Changed

  • DMS/DynamoDB: Use parameterized SQL WHERE clauses instead of inlining by @amotl in #36

Full Changelog: v0.0.12...v0.0.13