Last modified by adavison on 2022/05/23 22:24
From version 10.5
edited by adavison
on 2020/08/05 12:07
Change comment: There is no comment for this version
To version 10.1
edited by adavison
on 2020/08/05 11:42
Change comment: Uploaded new attachment "Workflow provenance in the EBRAINS KG.png", version {1}

Summary

Details

Page properties
Content
... ... @@ -19,23 +19,8 @@
19 19  
20 20  We present here the current schemas for representing (a) data analysis and (b) simulations in the Knowledge Graph. These schemas will need to be extended to cover neurorobotics simulations, and probably a more explicit representation of pipelines/workflows (the chaining together of multiple analysis / simulation stages) will be needed.
21 21  
22 -[[image:Workflow provenance in the EBRAINS KG.svg||alt="KG schema for data analysis"]][[image:Workflow provenance in the EBRAINS KG-2.png||alt="KG schema for data analysis"]]
23 -
24 -[[image:Workflow provenance in the EBRAINS KG.png||alt="KG schema for simulation"]]
25 -
26 -(note that the diagrams do not show Agents; the person who launched each analysis/simulation activity is linked to the activity with a ##wasAssociatedWith## connection).
27 -
28 -(% class="box warningmessage" %)
29 -(((
30 -TODO: insert or link to the detailed schemas for each type
31 -)))
32 -
33 33  == Tools for automated capture of provenance ==
34 34  
35 -(% class="wikigeneratedid" %)
36 -
37 -Issues to discuss:
38 -
39 39  * on different systems:
40 40  ** HPC systems
41 41  ** neuromorphic systems
... ... @@ -46,17 +46,8 @@
46 46  
47 47  == Communication between computer systems and the KG ==
48 48  
49 -Two issues arise:
34 +* local cache and synchronization?
50 50  
51 -(i) fine-grained provenance information may need to be obtained on compute nodes, which may not have network access;
52 -
53 -(ii) failures of provenance upload should not cause the workflows to fail;
54 -
55 -An overall solution for both of these issues would perhaps involve a local cache and later synchronization.
56 -
57 57  == User interfaces for browsing, visualizing, and searching provenance information ==
58 58  
59 -(% class="box infomessage" %)
60 -(((
61 -DISCUSSION NEEDED: integrate visualization of prov information into KG Search UI, and/or develop separate app?
62 -)))
38 +