Admin Harvest

This page allows an administrator to upload into Comète a collection of metadata records from an existing external repository.

It is divided in two sections. The left part contains a list of the repositories with buttons at the bottom to Add, Modify, and Delete repository definitions. The right part contains the detailed information of the selected repository. It also contains control buttons to Start harvest or Stop harvest, and also, a View harvest reports button that gives access to a window listing all the previous harvesting reports that have been produced so far.

At this moment, it is not possible through the graphical interface to program harvest operations as scheduled tasks. A harvest must be launched manually. Nevertheless, an administrator can use the underlying operating system facilities and the Comète REST API to implement it externally.

When the administrator edits either a new or existing repository definition, he is shown this edition dialog:

Here is a description of the various attributes of a repository:

• ID: String identifying the repository. It must not contain whitespace or special characters.
• Name: String that will be used as a label representing the repository. It can contain any characters.
• Protocol: Type of communication protocol used to perform the harvest. Two protocols are supported: OAI-PMH or HTML.
• URL: Location of the endpoint of the external repository to harvest.
• Format: Format of the XML metadata records that will be harvested. Two formats are supported: IEEE LOM or OAI DC.
• Admin email: Address where we can reach the administrator of the repository. This information is usually found using the Identify verb to query a OAI-PMH repository for example. This attribute is optional.
• Actions:
• If you are not sure of the quality of the metadata records, you can opt to Mark resources as "Pending for approval". This way, the uploaded resources will be marked with a special flag and will NOT be immediately publicly available. The administrator will have the opportunity afterward to review the resources and evaluate them. Depending on the quality of a resource, he can either unset the flag and make the resource available and visible to all the users or delete the resource.
• If you want the system to verify whether the metadata record points to a dead link or not, you can check the Mark resources that have broken links. The marked resources will NOT be immediately publicly available. An administrator can review ulteriorly the marked metadata records and bring corrections, if needed, and reupload a fixed version of the metadata records.
• You can also check the Mark resources as "Invalid" when they are not compliant with this profile: and select a specific application profile to prevent the system from exposing undesired metadata records. Again, the administrator can review ulteriorly the marked metadata records and intervene.
• XSL: XSLT stylesheet that will be applied to each harvested metadata record before being digested by Comète. This is usually used to correct metadata records.