Create graph data item from input files

[makkus]

Description

The main source for graph data will probably come from tabular data of some form. We will always need a table describing the relations between nodes (edges), in addition, it's possible to have a table that describes attributes of each node (with the node id being the index that is used in the edges table).

Steps

1. onboard edges file

Copy a file containing tabular edges data (most likely csv, but possibly also json, yaml, ...) from the local file system (or possibly remote/url) into the kiara data store.

• Inputs:

  • file_path (type: string)

• Outputs:

  • file_item (type: file, qualities: tabular, at least 2 columns: 'source'/'target', optionally edge attributes like weight)

2. onboard nodes file (optional)

Copy a file containing tabular node data (most likely csv, but possibly also json, yaml, ...) from the local file system (or possibly remote/url) into the kiara data store.

• Inputs:

  • file_path (type: string)

• Outputs:

  • file_item (type: file, qualties: tabular, one column referring to the node id, other columns describing attributes for each node)

3. create network graph item

Read the onboarded file(s) from step 1 (and possibly 2) and parse their content into a database item.

• Inputs:

  • edges file_item: (type: file, from step 1)
  • nodes file_item: (type: file, optional, from step 2)

• Outputs:

  • network_graph (type: network_graph, stored as sqlite-db-file, qualities: two tables 'edges'/'nodes' -- 'nodes' can be empty)