v4.0.0-alpha - Update - CKAN 2.10 compatibility and UI/Schemas/Profiles improvements

What's Changed

• Add licenses.json by @mjanez in #94
• Add docker-compose tests by @mjanez in #100

Full Changelog: v3.2.2...v4.0.0-alpha

v3.2.2 - Improve CKAN Harvester

Warning

• Custom extension, required: mjanez/ckanext-dcat, ckan/ckanext-spatial, ckan/ckanext-scheming and ckan/kanext-harvest more info at: README/Requirements
• Contains several schemas as Spanish context for some codelists and metadata properties (GeoDCAT-AP ES) or GeoDCAT-AP EU version. All schema information is available in the README

This improve CKAN Harvester add dataset_field_mapping/distribution_field_mapping for CKAN instances harvesting.

What's Changed

• Feature/ckan harvester improve by @mjanez in #86
• Update v3.2.2 by @mjanez in #85
• Fix bug when schemingdcat.endpoints_yaml is None by @mjanez in #89
• Feature/ckan harvester improve by @mjanez in #90
• Fix harvester by @mjanez in #91
• Add allow_private_datasets to ckan harvester by @mjanez in #98
• Fixed bugs with localised_filesize snippet 43cc8b0

Full Changelog: v3.2.1...v3.2.2

v3.2.1 - Enhance harvester, field mapping validation lib and harvest templates

Warning

• Custom extension, required: mjanez/ckanext-dcat, ckan/ckanext-spatial, ckan/ckanext-scheming and ckan/kanext-harvest more info at: README/Requirements
• Contains several schemas as Spanish context for some codelists and metadata properties (GeoDCAT-AP ES) or GeoDCAT-AP EU version. All schema information is available in the README

This release introduces several improvements and updates to the ckanext-harvest extension, focusing on enhancing templates, improving validation, and optimizing functionality. Below are the key changes:

• Template Enhancements: Improved the harvest panel and new source forms for better usability.
• New Harvester Templates: Added templates for schemingdcat_ows and schemingdcat_xls harvesters to support new data formats.
• Validation Improvements: Enhanced the FieldMappingValidator class to allow None as a valid value for the local field. Updated the validation logic and error messages accordingly.
• i18n Updates: Updated internationalization for source templates and fixed translation issues in the schemingdcat_facet_list and admin/config templates.
• Field Mapping Library Update: Updated the field_mapping library to provide more detailed information and improved validation.
• Endpoint Template Fix: Fixed issues with the endpoints template when the sparql_interface is not active.
• Configuration Enhancements: Improved configuration options and custom format rules, providing better flexibility and control.
• Harvester Improvements: Enhanced the functionality and logging of various harvesters, including CKAN, XLS, and SchemingDCAT harvesters. Specific improvements include:
  • Updating _supported_schemas to use a set.
  • Enhancing default value handling in _update_package_dict_with_config_mapping_default_values.
  • Cleaning up tags and groups in _set_package_dict_default_values.
  • Improving the _update_custom_format method for better format/mimetype checking.
  • Adding log_export_to_csv method for improved logging during the harvesting process.

What's Changed

• Enhance harvester, field mapping validation lib and harvest templates by @mjanez in #81
• Update dependencies to specific versions by @mjanez in #82
• Update pandas to 2.2.2 by @mjanez in #83
• Improve mail validation by @mjanez in #84

Full Changelog: v3.2.0...v3.2.1

v3.2.1-alpha -Enhance harvester, field mapping validation lib and harvest templates

Warning

• Custom extension, required: mjanez/ckanext-dcat, ckan/ckanext-spatial, ckan/ckanext-scheming and ckan/kanext-harvest more info at: README/Requirements
• Contains several schemas as Spanish context for some codelists and metadata properties (GeoDCAT-AP ES) or GeoDCAT-AP EU version. All schema information is available in the README

What's Changed

• Enhance harvester, field mapping validation lib and harvest templates #81

Full Changelog: v3.2.0...v3.2.1-alpha

v3.2.0 - Improve schemas, theming, validators and remote sheets harvester

Warning

• Custom extension, required: mjanez/ckanext-dcat, ckan/ckanext-spatial, ckan/ckanext-scheming and ckan/kanext-harvest more info at: README/Requirements
• Contains several schemas as Spanish context for some codelists and metadata properties (GeoDCAT-AP ES) or GeoDCAT-AP EU version. All schema information is available in the README

What's Changed

• Improve schemas, theming, validators and remote sheets harvester by @mjanez in #68
  • Improved the package_item template for better UI presentation.
  • Replaced status_show with package_list for CKAN API endpoint to enhance data retrieval.
  • Updated styles for better user interface experience.
  • Added schemingdcat_spatial_uri_validator to obtain spatial data from spatial URI.
  • Improved schemingdcat_harvester schema for better data harvesting.
  • Updated README for harvesters with more detailed instructions.
  • Updated form placeholders with correct abbreviations for better user understanding.
  • Refactored interfaces and improved docstrings for better code readability and maintainability.
  • Added data-icons for provinces and province images based on autonomies for better data representation.
  • Updated schemingdcat_spatial_uri_validator to handle missing spatial bbox, preventing potential errors.
  • Added temporal_start and temporal_end fields to DATE_FIELDS for better date range representation.
  • Improved spatial_uri form_snippet for better user interaction.
• Refactor contact_info and publisher_info snippets for improved readability and maintainability by @mjanez in #69
• Fix schemingdcat_prettify_url_name by @mjanez in #70
• Fix icon class for university publisher type by @mjanez in #71
• Update sorted_choices to False for spatial_uri in geodcatap_es schema by @mjanez in #72
• Comprehensive Update to Harvesters, CSS, and More by @mjanez in #73
• Add metadata templates by @mjanez in #74
• Update metadata template rendering in header and index templates by @mjanez in #75
• Fix contact/publisher info snippets to avoid errors with emails by @mjanez in #76

Metadata templates ref for schemingdcat remote metadata harvester

The metadata templates allow large numbers of records to be created in CKAN in a simple and standardised way. They are all compatible with the metadata schema of the catalogue. More info: Remote Google Sheet/Onedrive Excel metadata upload Harvester

Form Groups

Form groups are a way to group related fields together in the same form. This makes it easier to navigate and manage metadata. A form group is defined with the following elements:

For more details on these enhancements check Form Groups documentation, please refer to the schema files in ckanext/schemingdcat/schemas.

Add multiple_choice_custom_tag preset

The multiple_choice_custom_tag preset allows controlled lists of fields with multiple choices to be used as metadata elements and automatically stored as tags.

Add commands to create tags based on schema themes and topics

1. create-inspire-tags: This command creates a CKAN tag vocabulary and adds INSPIRE themes to it. The language for the vocabulary can be specified with the -l or --lang option. The default language is English. To execute this command, use: ckan schemingdcat create-inspire-tags -l [language].

2. delete-inspire-tags: This command deletes the INSPIRE themes vocabulary and its respective tags. To execute this command, use: ckan schemingdcat delete-inspire-tags

3. create-dcat-tags: This command creates the DCAT themes vocabularies. The language for the vocabularies can be specified with the -l or --lang option. The default language is English. To execute this command, use: ckan schemingdcat create-dcat-tags -l [language]

4. delete-dcat-tags: This command deletes the DCAT themes vocabularies and their respective tags. To execute this command, use: ckan schemingdcat delete-dcat-tags

5. create-iso-topic-tags: This command creates the ISO 19115 topics vocabulary. The language for the vocabulary can be specified with the -l or --lang option. The default language is English. To execute this command, use: ckan schemingdcat create-iso-topic-tags -l [language]

6. delete-iso-topic-tags: This command deletes the ISO 19115 topics vocabulary and its respective tags. To execute this command, use: ckan schemingdcat delete_iso_topic_tags

Tip

Remember to replace [language] with the desired language code (e.g., en for English, es for Spanish, etc.) when executing the commands that accept the -l or --lang option.

Full Changelog: v3.1.0...v3.2.0

v3.1.0 - hvd_category, schema and theming enhancements

Warning

• Custom extension, required: mjanez/ckanext-dcat
• Contains several schemas as Spanish context for some codelists and metadata properties (GeoDCAT-AP ES) or GeoDCAT-AP EU version. All schema information is available in the README

What's Changed

• Improve schemas by @mjanez in #53
  • Add high-value dataset category field
  • Improve created/modified dates
  • Add fluent to all schemas
• Schema - Improve languages codelist #35
• Improve schemas (dcat_type) by @mjanez in #54
• Improve package_form and resource_form by @mjanez in #55
• Update version and add changelog by @mjanez in #56
• Improve forms and Add hvd_category to metadata_info template by @mjanez in #57
• Improve metadata form style by @mjanez in #58
• Improve metadata form style by @mjanez in #58
• Improve form styles by @mjanez in #59
• Develop by @mjanez in #60
• Add get_ckan_cleaned_name helper by @mjanez in #61
• Add enhacedments to schema, templates and endpoints by @mjanez in #62
• Refactor dataset scope validation logic (schemingdcat_dataset_scope) by @mjanez in #63
• Develop by @mjanez in #65
• Update facet_list_limit to 6 in config.py and fix link generation in dataset_categories.html by @mjanez in #66
• Refactor get_header_endpoint_url function for improved endpoint URL generation by @mjanez in #67

Form Groups

Form groups are a way to group related fields together in the same form. This makes it easier to navigate and manage metadata. A form group is defined with the following elements:

For more details on these enhancements check Form Groups documentation, please refer to the schema files in ckanext/schemingdcat/schemas.

Add multiple_choice_custom_tag preset

The multiple_choice_custom_tag preset allows controlled lists of fields with multiple choices to be used as metadata elements and automatically stored as tags.

Add commands to create tags based on schema themes and topics

1. create-inspire-tags: This command creates a CKAN tag vocabulary and adds INSPIRE themes to it. The language for the vocabulary can be specified with the -l or --lang option. The default language is English. To execute this command, use: ckan schemingdcat create-inspire-tags -l [language].

2. delete-inspire-tags: This command deletes the INSPIRE themes vocabulary and its respective tags. To execute this command, use: ckan schemingdcat delete-inspire-tags

3. create-dcat-tags: This command creates the DCAT themes vocabularies. The language for the vocabularies can be specified with the -l or --lang option. The default language is English. To execute this command, use: ckan schemingdcat create-dcat-tags -l [language]

4. delete-dcat-tags: This command deletes the DCAT themes vocabularies and their respective tags. To execute this command, use: ckan schemingdcat delete-dcat-tags

5. create-iso-topic-tags: This command creates the ISO 19115 topics vocabulary. The language for the vocabulary can be specified with the -l or --lang option. The default language is English. To execute this command, use: ckan schemingdcat create-iso-topic-tags -l [language]

6. delete-iso-topic-tags: This command deletes the ISO 19115 topics vocabulary and its respective tags. To execute this command, use: ckan schemingdcat delete_iso_topic_tags

Tip

Remember to replace [language] with the desired language code (e.g., en for English, es for Spanish, etc.) when executing the commands that accept the -l or --lang option.

Full Changelog: v3.0.0...v3.1.0

v3.0.0 - ckanext_schemingdcat with custom harvesters

What's Changed

• Feature/modern theme lod csw endpoints by @mjanez in #25
• Fix sd_config.endpoints by @mjanez in #26
• Feature/modern theme lod csw endpoints by @mjanez in #27
• Improve endpoints and README by @mjanez in #28
• Update develop by @mjanez in #31
• Fix ckanext-fluent with custom extensions by @mjanez in #32
• Update README blockquotes by @mjanez in #33
• Add scheming_dcat harvester plugins by @mjanez in #36
• Fix codelists folder by @mjanez in #38
• Fix groups and add default values to CKAN harvester by @mjanez in #39
• Fix scheming_dcat name to schemingdcat (PEP 503 y PEP 508) by @mjanez in #42
• Update develop by @mjanez in #43
• Fix map attribution acording to ckanext-spatial by @mjanez in #44
• Bug - Fix extras instance in SchemingDCATHarvester by @mjanez in #45
• Fix bugs ckan harvester by @mjanez in #46
• Fix resource updating for XLS harvester and old scheming_dcat prefixes by @mjanez in #48
• Fix source_date_format issue in SchemingDCATHarvester by @mjanez in #49
• Fix accented character handling in SchemingDCATHarvester by @mjanez in #51
• Fix bugs with XLS, CKAN and facet searchs by @mjanez in #52

Full Changelog: v2.1.0...v3.0.0

v1.2.2 - IEPNB compatible, schemingdcat fixed.

This is a custom extension with specific tools and schemas for spatial data and GeoDCAT-AP/INSPIRE metadata profiles.

Note

Without ckanext-fluent.

Warning

• Custom extension, required: mjanez/ckanext-dcat
• Contains several schemas as Spanish context for some codelists and metadata properties (GeoDCAT-AP ES) or GeoDCAT-AP EU version. All schema information is available in the README

Full Changelog: v1.2.1...v1.2.2

v2.1.0 - Harvest integration for CKAN and XLS

What's Changed

• Feature/modern theme lod csw endpoints by @mjanez in #25
• Fix sd_config.endpoints by @mjanez in #26
• Feature/modern theme lod csw endpoints by @mjanez in #27
• Improve endpoints and README by @mjanez in #28
• Update develop by @mjanez in #31
• Fix ckanext-fluent with custom extensions by @mjanez in #32
• Update README blockquotes by @mjanez in #33
• Add scheming_dcat harvester plugins by @mjanez in #36
• Fix codelists folder by @mjanez in #38
• Fix groups and add default values to CKAN harvester by @mjanez in #39

Full Changelog: v1.2.1...v2.1.0

v2.1.0a - Draft version

What's Changed

• Update develop by @mjanez in #31
• Update README blockquotes by @mjanez in #33

Full Changelog: v2.0.0...v2.1.0a