Last modified by adavison on 2022/05/23 22:24
From version 10.3
edited by adavison
on 2020/08/05 11:46
Change comment: There is no comment for this version
To version 12.1
edited by adavison
on 2020/08/05 12:21
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -8,7 +8,6 @@
8 8  * management and tracking of workflows/projects by the scientists/engineers involved
9 9  * evaluation/review by other scientists and engineers
10 10  
11 -
12 12  == Standards ==
13 13  
14 14  The [[W3C PROV standard>>https://www.w3.org/TR/2013/NOTE-prov-overview-20130430/||rel="noopener noreferrer" target="_blank"]] provides a data model and related tools for provenance interchange on the web. The following diagram shows the three base classes of the PROV data model: Entity, Activity, and Agent. These three classes form the basis for the representation of provenance in the EBRAINS Knowledge Graph: every node in the KG has a type which is a subclass of one of these base classes.
... ... @@ -19,7 +19,7 @@
19 19  
20 20  We present here the current schemas for representing (a) data analysis and (b) simulations in the Knowledge Graph. These schemas will need to be extended to cover neurorobotics simulations, and probably a more explicit representation of pipelines/workflows (the chaining together of multiple analysis / simulation stages) will be needed.
21 21  
22 -[[image:Workflow provenance in the EBRAINS KG.svg||alt="KG schema for data analysis"]][[image:Workflow provenance in the EBRAINS KG-2.png||alt="KG schema for data analysis"]]
21 +[[image:Workflow provenance in the EBRAINS KG-2.png||alt="KG schema for data analysis"]]
23 23  
24 24  [[image:Workflow provenance in the EBRAINS KG.png||alt="KG schema for simulation"]]
25 25  
... ... @@ -32,6 +32,9 @@
32 32  
33 33  == Tools for automated capture of provenance ==
34 34  
34 +
35 +Issues to discuss:
36 +
35 35  * on different systems:
36 36  ** HPC systems
37 37  ** neuromorphic systems
... ... @@ -42,8 +42,17 @@
42 42  
43 43  == Communication between computer systems and the KG ==
44 44  
45 -* local cache and synchronization?
47 +Two issues arise:
46 46  
49 +(i) fine-grained provenance information may need to be obtained on compute nodes, which may not have network access;
50 +
51 +(ii) failures of provenance upload should not cause the workflows to fail;
52 +
53 +An overall solution for both of these issues would perhaps involve a local cache and later synchronization.
54 +
47 47  == User interfaces for browsing, visualizing, and searching provenance information ==
48 48  
49 -
57 +(% class="box infomessage" %)
58 +(((
59 +DISCUSSION NEEDED: integrate visualization of prov information into KG Search UI, and/or develop separate app?
60 +)))