Skip to content

v3.2.1 - Enhance harvester, field mapping validation lib and harvest templates

Compare
Choose a tag to compare
@mjanez mjanez released this 10 Jul 12:01
· 213 commits to main since this release
28163ed

Warning

This release introduces several improvements and updates to the ckanext-harvest extension, focusing on enhancing templates, improving validation, and optimizing functionality. Below are the key changes:

  • Template Enhancements: Improved the harvest panel and new source forms for better usability.
  • New Harvester Templates: Added templates for schemingdcat_ows and schemingdcat_xls harvesters to support new data formats.
  • Validation Improvements: Enhanced the FieldMappingValidator class to allow None as a valid value for the local field. Updated the validation logic and error messages accordingly.
  • i18n Updates: Updated internationalization for source templates and fixed translation issues in the schemingdcat_facet_list and admin/config templates.
  • Field Mapping Library Update: Updated the field_mapping library to provide more detailed information and improved validation.
  • Endpoint Template Fix: Fixed issues with the endpoints template when the sparql_interface is not active.
  • Configuration Enhancements: Improved configuration options and custom format rules, providing better flexibility and control.
  • Harvester Improvements: Enhanced the functionality and logging of various harvesters, including CKAN, XLS, and SchemingDCAT harvesters. Specific improvements include:
    • Updating _supported_schemas to use a set.
    • Enhancing default value handling in _update_package_dict_with_config_mapping_default_values.
    • Cleaning up tags and groups in _set_package_dict_default_values.
    • Improving the _update_custom_format method for better format/mimetype checking.
    • Adding log_export_to_csv method for improved logging during the harvesting process.

What's Changed

  • Enhance harvester, field mapping validation lib and harvest templates by @mjanez in #81
  • Update dependencies to specific versions by @mjanez in #82
  • Update pandas to 2.2.2 by @mjanez in #83
  • Improve mail validation by @mjanez in #84

Full Changelog: v3.2.0...v3.2.1