31 May 2024 1230 US-Eastern

[ktoddbrown]

Agenda

(5 | 1230) Check ins

• Who is here
• Graham, Gabriel, Kathe, Kate, Vaasuki
• Note taking? - Gabriel
• How are you showing up? Feels wheel

(15 | 1235) Individual ToDo item checkins and stuck to unstuck

• KTB: wiki started!, FS-FIA status update FS-FIA #4
• Wiki has been started, including a workflow table for data addition. Annotation instructions (first draft) have been created. Read scripts (first draft) has been created as well. A similar doc with link for Integration heading, and the first three headings, needs to be created. On the Soil-DRaH workflow section, highlight that there is more info on the wiki on GitHub.
  ISRaD has those separate pages for users vs. contributors: https://soilradiocarbon.org/contribute/
• VM: CPEAT status update CPEAT #1
• Pushed some changes to the ICN. Added default google sheet to coded annotations. Reconcile the two coded annotation sheets. Find the data difference between google sheet and what is in the data parameters table.
• GL: unit testing and dev for checkAnnotations Check annotations #8
• Pushed changes to GitHub. Working on fixing errors that were pushed and writing last unit test.
• MJ & GT: project workflow diagram update
• Code workflow is streamlined and easy for outside users to integrate into their project
  Next steps - ISRaD
  https://github.com/International-Soil-Radiocarbon-Database/ISRaD/
  Mock soil annotations in a few days -- wait for email with updates

(15 | 1250) Soil-DRaH Workflow

• Review the data harmonization workflow here: https://github.com/ktoddbrown/SoilDRaH/wiki/Workflow-for-new-data-addition.
  • What are your questions?
  • What works well with this workflow?
  • What is missing?

(10 | 1305) Backlog and ToDo items

• What are you doing between now and then?
• What are we talking about next time?

(5 | 1315) Check outs [appreciations, curiosities, and ToDo]

[ktoddbrown]

Table for discussion that is also in the wiki

--	<<<<	Input	>>>>	<<<<	Transformation	>>>>	<<<<	Output	>>>>
--	find data	open ticket	evaluate	annotations	read script	integration	QA/QC	merge to main	publish
Lead	Identify what kinds of data we are interested in and where other people who are interested in that same kind of data are at.	Collect all available information on the data set including related papers, points of contact, and other documentation.	Identify overlap of the contribution with the broader collection (geolocation, time, observation, methods).	Read though documentation (including methods section) of the data contribution.	Understand the data model.	Identify shared variable-methods within the context of data collection purpose.	Identify needed visuals, min/max, and control vocabulary checks for new data contribution.	Create pull request and identify reviewer	Identify who is interested in the new updates
Do	Talk with people, search data archives, and/or read the literature to find relevant datasets.	Create a github issue with citation, point of contact, and initial why.	Extend issue to include what kind of data is in this data sets and how it intersects current collection.	Create a data annotation with id-variable-type-entry tuple. Create a development vignette to check/test.	Create a download script that transform the data to long (id, variable, type, entry) tuple. Integrate into development vignette.	Create a script to connect data contribution to data collection. Extend collection vignette.	QA/QC the data collection with this new data contribution. Extend development and collection vignettes	Update any metadata needed and merge into the main branch.	Send out announcement of new data availability and update website.
Measure	Do people follow up with conversations? Is there engagement? Are we finding data that matches our needs?	Can other people find the dataset? Do they understand what data is being proposed?	Can we make a decision on prioritization of this specific data contribution over other canidates?	Do the annotations match the data? Are the level of method descriptions clear?	Are the transformations that the data went through clear (good comments)?	Is it clear how the variables connected across the data and why? Could someone else resonably agree with your decisions?	How does the data contribution compare with the larger collection?	Did the main branch break? Does the collection still work? Can folks assemble the collection from scripts	Did we get new downloads of the repository? Were there questions that need to be added to the documentation that we missed?

[ktoddbrown]

@graham-louis I don't know if this will help you with the wiki draft or not but I started working up a formalized workflow for data additions.

@vaasukimarupaka @GabrielThrasher and @jonesmaggie You might be interested in this as well.

[ktoddbrown]

Agenda

(5 | 1230) Check ins

• Who is here : Graham, Gabriel, Kathe, Kate, Vaasuki
• Note taking? - Gabriel
• How are you showing up? Feels wheel

(15 | 1235) Individual ToDo item checkins and stuck to unstuck

• KTB: wiki started!, FS-FIA status update FS-FIA FS-FIA #4
  • Wiki has been started, including a workflow table for data addition. Annotation instructions (first draft) have been created. Read scripts (first draft) has been created as well. A similar doc with link for Integration heading, and the first three headings, needs to be created. On the Soil-DRaH workflow section, highlight that there is more info on the wiki on GitHub.
    ISRaD has those separate pages for users vs. contributors: https://soilradiocarbon.org/contribute/
• VM: CPEAT status update CPEAT CPEAT #1
  • Pushed some changes to the ICN. Added default google sheet to coded annotations. Reconcile the two coded annotation sheets. Find the data difference between google sheet and what is in the data parameters table.
• GL: unit testing and dev for checkAnnotations Check annotations Check annotations #8
  • Pushed changes to GitHub. Working on fixing errors that were pushed and writing last unit test.
• GT: project workflow diagram update
  • Code workflow is streamlined and easy for outside users to integrate into their project
  • Next steps - ISRaD https://github.com/International-Soil-Radiocarbon-Database/ISRaD/
  • Mock soil annotations in a few days -- wait for email with updates

(15 | 1250) Soil-DRaH Workflow

Review the data harmonization workflow here: https://github.com/ktoddbrown/SoilDRaH/wiki/Workflow-for-new-data-addition.

• What are your questions?
• What works well with this workflow?
• What is missing?

(10 | 1305) Backlog and ToDo items

• What are you doing between now and then?
• What are we talking about next time?

(5 | 1315) Check outs [appreciations, curiosities, and ToDo]