Changes for page Provenance of simulation and data analysis workflows
Last modified by adavison on 2022/05/23 22:24
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -19,17 +19,6 @@ 19 19 20 20 We present here the current schemas for representing (a) data analysis and (b) simulations in the Knowledge Graph. These schemas will need to be extended to cover neurorobotics simulations, and probably a more explicit representation of pipelines/workflows (the chaining together of multiple analysis / simulation stages) will be needed. 21 21 22 -[[image:Workflow provenance in the EBRAINS KG.svg||alt="KG schema for data analysis"]][[image:Workflow provenance in the EBRAINS KG-2.png||alt="KG schema for data analysis"]] 23 - 24 -[[image:Workflow provenance in the EBRAINS KG.png||alt="KG schema for simulation"]] 25 - 26 -(note that the diagrams do not show Agents; the person who launched each analysis/simulation activity is linked to the activity with a ##wasAssociatedWith## connection). 27 - 28 -(% class="box warningmessage" %) 29 -((( 30 -TODO: insert or link to the detailed schemas for each type 31 -))) 32 - 33 33 == Tools for automated capture of provenance == 34 34 35 35 * on different systems: ... ... @@ -42,17 +42,8 @@ 42 42 43 43 == Communication between computer systems and the KG == 44 44 45 - Twoissuesarise:34 +* local cache and synchronization? 46 46 47 -(i) fine-grained provenance information may need to be obtained on compute nodes, which may not have network access; 48 - 49 -(ii) failures of provenance upload should not cause the workflows to fail; 50 - 51 -An overall solution for both of these issues would perhaps involve a local cache and later synchronization. 52 - 53 53 == User interfaces for browsing, visualizing, and searching provenance information == 54 54 55 -(% class="box infomessage" %) 56 -((( 57 -DISCUSSION NEEDED: integrate visualization of prov information into KG Search UI, and/or develop separate app? 58 -))) 38 +