Changes for page Provenance of simulation and data analysis workflows
Last modified by adavison on 2022/05/23 22:24
Summary
-
Page properties (1 modified, 0 added, 0 removed)
-
Attachments (0 modified, 3 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -1,6 +1,6 @@ 1 1 == Introduction == 2 2 3 -Computational provenance is a record of all the steps in a computational scientific workflow, including the code that was run, input data, the computational environment (hardware, OS, compiler versions, library version...), and output data. 3 +Computational provenance is a record of all the steps in a computational scientific workflow, including the code that was run, input data, the computational environment (hardware, OS, compiler versions, library version...), the person who performed each step, and output data. 4 4 5 5 Capturing computational provenance facilitates: 6 6 ... ... @@ -8,16 +8,23 @@ 8 8 * management and tracking of workflows/projects by the scientists/engineers involved 9 9 * evaluation/review by other scientists and engineers 10 10 11 - 12 12 13 13 == Standards == 14 14 15 - Information about theW3CPROVontology and related tools14 +The [[W3C PROV standard>>https://www.w3.org/TR/2013/NOTE-prov-overview-20130430/||rel="noopener noreferrer" target="_blank"]] provides a data model and related tools for provenance interchange on the web. The following diagram shows the three base classes of the PROV data model: Entity, Activity, and Agent. These three classes form the basis for the representation of provenance in the EBRAINS Knowledge Graph: every node in the KG has a type which is a subclass of one of these base classes. 16 16 16 +[[image:starting-points.svg||alt="The three Starting Point classes of the W3C PROV ontology and the properties that relate them."]] 17 17 18 18 == Storage of provenance in the Knowledge Graph == 19 19 20 +We present here the current schemas for representing (a) data analysis and (b) simulations in the Knowledge Graph. These schemas will need to be extended to cover neurorobotics simulations, and probably a more explicit representation of pipelines/workflows (the chaining together of multiple analysis / simulation stages) will be needed. 20 20 22 +[[image:Workflow provenance in the EBRAINS KG.svg||alt="KG schema for data analysis"]][[image:Workflow provenance in the EBRAINS KG-2.png||alt="KG schema for data analysis"]] 23 + 24 +[[image:Workflow provenance in the EBRAINS KG.png||alt="KG schema for simulation"]] 25 + 26 +(note that the diagrams do not show Agents; the person who launched each analysis/simulation activity is linked to the activity with a ##wasAssociatedWith## connection). 27 + 21 21 == Tools for automated capture of provenance == 22 22 23 23 * on different systems: ... ... @@ -32,7 +32,6 @@ 32 32 33 33 * local cache and synchronization? 34 34 35 - 36 36 == User interfaces for browsing, visualizing, and searching provenance information == 37 37 38 38
- Workflow provenance in the EBRAINS KG-2.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +XWiki.adavison - Size
-
... ... @@ -1,0 +1,1 @@ 1 +58.6 KB - Content
- Workflow provenance in the EBRAINS KG.png
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +XWiki.adavison - Size
-
... ... @@ -1,0 +1,1 @@ 1 +49.9 KB - Content
- Workflow provenance in the EBRAINS KG.svg
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +XWiki.adavison - Size
-
... ... @@ -1,0 +1,1 @@ 1 +159.5 KB - Content