v3.2.1 - Enhance harvester, field mapping validation lib and harvest templates
Warning
- Custom extension, required:
mjanez/ckanext-dcat
,ckan/ckanext-spatial
,ckan/ckanext-scheming
andckan/kanext-harvest
more info at: README/Requirements - Contains several schemas as Spanish context for some codelists and metadata properties (GeoDCAT-AP ES) or GeoDCAT-AP EU version. All schema information is available in the README
This release introduces several improvements and updates to the ckanext-harvest
extension, focusing on enhancing templates, improving validation, and optimizing functionality. Below are the key changes:
- Template Enhancements: Improved the harvest panel and new source forms for better usability.
- New Harvester Templates: Added templates for
schemingdcat_ows
andschemingdcat_xls
harvesters to support new data formats. - Validation Improvements: Enhanced the
FieldMappingValidator
class to allowNone
as a valid value for the local field. Updated the validation logic and error messages accordingly. - i18n Updates: Updated internationalization for source templates and fixed translation issues in the
schemingdcat_facet_list
andadmin/config
templates. - Field Mapping Library Update: Updated the
field_mapping
library to provide more detailed information and improved validation. - Endpoint Template Fix: Fixed issues with the endpoints template when the
sparql_interface
is not active. - Configuration Enhancements: Improved configuration options and custom format rules, providing better flexibility and control.
- Harvester Improvements: Enhanced the functionality and logging of various harvesters, including CKAN, XLS, and SchemingDCAT harvesters. Specific improvements include:
- Updating
_supported_schemas
to use a set. - Enhancing default value handling in
_update_package_dict_with_config_mapping_default_values
. - Cleaning up tags and groups in
_set_package_dict_default_values
. - Improving the
_update_custom_format
method for better format/mimetype checking. - Adding
log_export_to_csv
method for improved logging during the harvesting process.
- Updating
What's Changed
- Enhance harvester, field mapping validation lib and harvest templates by @mjanez in #81
- Update dependencies to specific versions by @mjanez in #82
- Update pandas to 2.2.2 by @mjanez in #83
- Improve mail validation by @mjanez in #84
Full Changelog: v3.2.0...v3.2.1