Last modified by adavison on 2022/05/23 22:24

From version 4.2
edited by adavison
on 2020/08/05 08:40
Change comment: There is no comment for this version
To version 8.1
edited by adavison
on 2020/08/05 11:38
Change comment: Uploaded new attachment "Workflow provenance in the EBRAINS KG.svg", version {1}

Summary

Details

Page properties
Content
... ... @@ -1,6 +1,6 @@
1 1  == Introduction ==
2 2  
3 -Computational provenance is a record of all the steps in a computational scientific workflow, including the code that was run, input data, the computational environment (hardware, OS, compiler versions, library version...), and output data.
3 +Computational provenance is a record of all the steps in a computational scientific workflow, including the code that was run, input data, the computational environment (hardware, OS, compiler versions, library version...), the person who performed each step, and output data.
4 4  
5 5  Capturing computational provenance facilitates:
6 6  
... ... @@ -8,15 +8,16 @@
8 8  * management and tracking of workflows/projects by the scientists/engineers involved
9 9  * evaluation/review by other scientists and engineers
10 10  
11 -
12 12  
13 13  == Standards ==
14 14  
15 -Information about the W3C PROV ontology and related tools
14 +The [[W3C PROV standard>>https://www.w3.org/TR/2013/NOTE-prov-overview-20130430/||rel="noopener noreferrer" target="_blank"]] provides a data model and related tools for provenance interchange on the web. The following diagram shows the three base classes of the PROV data model: Entity, Activity, and Agent. These three classes form the basis for the representation of provenance in the EBRAINS Knowledge Graph: every node in the KG has a type which is a subclass of one of these base classes.
16 16  
16 +[[image:starting-points.svg||alt="The three Starting Point classes of the W3C PROV ontology and the properties that relate them."]]
17 17  
18 18  == Storage of provenance in the Knowledge Graph ==
19 19  
20 +We present here the current schemas for representing (a) data analysis and (b) simulations in the Knowledge Graph. These schemas will need to be extended to cover neurorobotics simulations, and probably a more explicit representation of pipelines/workflows (the chaining together of multiple analysis / simulation stages) will be needed.
20 20  
21 21  == Tools for automated capture of provenance ==
22 22  
... ... @@ -32,7 +32,6 @@
32 32  
33 33  * local cache and synchronization?
34 34  
35 -
36 36  == User interfaces for browsing, visualizing, and searching provenance information ==
37 37  
38 38  
Workflow provenance in the EBRAINS KG.svg
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.adavison
Size
... ... @@ -1,0 +1,1 @@
1 +159.5 KB
Content
starting-points.svg
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.adavison
Size
... ... @@ -1,0 +1,1 @@
1 +11.4 KB
Content
... ... @@ -1,0 +1,4 @@
1 +<?xml version="1.0"?>
2 +<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd">
3 +<svg xmlns="http://www.w3.org/2000/svg" xmlns:xl="http://www.w3.org/1999/xlink" version="1.1" viewBox="8 10 630 355" width="630pt" height="355pt"><metadata xmlns:dc="http://purl.org/dc/elements/1.1/"><dc:date>2012-11-25 17:39Z</dc:date><!-- Produced by OmniGraffle Professional 5.4.2 --></metadata><defs><font-face font-family="Georgia" font-size="16" panose-1="2 4 5 2 5 4 5 2 3 3" units-per-em="1000" underline-position="-88.378906" underline-thickness="49.316406" slope="0" x-height="481.4453" cap-height="692.8711" ascent="916.9922" descent="-219.23828" font-weight="500"><font-face-src><font-face-name name="Georgia"/></font-face-src></font-face><marker orient="auto" overflow="visible" markerUnits="strokeWidth" id="FilledArrow_Marker" viewBox="-1 -3 7 6" markerWidth="7" markerHeight="6" color="gray"><g><path d="M 4.8000002 0 L 0 -1.8000001 L 0 1.8000001 Z" fill="currentColor" stroke="currentColor" stroke-width="1"/></g></marker><marker orient="auto" overflow="visible" markerUnits="strokeWidth" id="FilledArrow_Marker_2" viewBox="-1 -3 7 6" markerWidth="7" markerHeight="6" color="black"><g><path d="M 4.8000002 0 L 0 -1.8000001 L 0 1.8000001 Z" fill="currentColor" stroke="currentColor" stroke-width="1"/></g></marker><marker orient="auto" overflow="visible" markerUnits="strokeWidth" id="FilledArrow_Marker_3" viewBox="-6 -3 7 6" markerWidth="7" markerHeight="6" color="#ff0080"><g><path d="M -4.8000002 0 L 0 1.8000001 L 0 -1.8000001 Z" fill="currentColor" stroke="currentColor" stroke-width="1"/></g></marker><marker orient="auto" overflow="visible" markerUnits="strokeWidth" id="FilledArrow_Marker_4" viewBox="-1 -3 7 6" markerWidth="7" markerHeight="6" color="#ff0080"><g><path d="M 4.8000002 0 L 0 -1.8000001 L 0 1.8000001 Z" fill="currentColor" stroke="currentColor" stroke-width="1"/></g></marker><font-face font-family="Georgia" font-size="16" panose-1="2 4 8 2 5 4 5 2 2 3" units-per-em="1000" underline-position="-87.890625" underline-thickness="59.570312" slope="0" x-height="484.375" cap-height="692.8711" ascent="916.9922" descent="-219.23828" font-weight="bold"><font-face-src><font-face-name name="Georgia-Bold"/></font-face-src></font-face></defs><g stroke="none" stroke-opacity="1" stroke-dasharray="none" fill="none" fill-opacity="1"><title>Canvas 1</title><rect fill="white" width="1278" height="801"/><g><title>Layer 1</title><rect x="341.84837" y="180.4197" width="44" height="29" fill="white"/><text transform="translate(346.84837 185.4197)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".48046875" y="15" textLength="33.039062">used</tspan></text><line x1="455.7823" y1="283.52519" x2="510.46198" y2="325.54177" marker-end="url(#FilledArrow_Marker)" stroke="gray" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><line x1="387.03948" y1="283.53818" x2="336.3846" y2="325.2067" marker-end="url(#FilledArrow_Marker)" stroke="gray" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><text transform="translate(497.15226 296.39702)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".015625" y="15" textLength="95.96875">endedAtTime</tspan></text><rect x="192.47014" y="228.09374" width="148" height="19" fill="white"/><text transform="translate(197.47014 228.09374)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".22265625" y="15" textLength="137.55469">wasAssociatedWith</tspan></text><rect x="8.368844" y="210.53593" width="132" height="19" fill="white"/><text transform="translate(13.368844 210.53593)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".203125" y="15" textLength="121.59375">actedOnBehalfOf</tspan></text><rect x="453.69215" y="150.13326" width="129" height="29" fill="white"/><text transform="translate(458.69215 155.13326)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".15234375" y="15" textLength="118.69531">wasGeneratedBy</tspan></text><rect x="211.47013" y="116.69822" width="129" height="19" fill="white"/><text transform="translate(216.47013 116.69822)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".03515625" y="15" textLength="118.92969">wasAttributedTo</tspan></text><rect x="351.0433" y="10.081995" width="132" height="19" fill="white"/><text transform="translate(356.0433 10.081995)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".26953125" y="15" textLength="121.46094">wasDerivedFrom</tspan></text><path d="M 424.76745 80.57143 C 429.47813 68.21273 447.59373 30.68857 419.03138 30.571429 C 396.97366 30.481023 404.24545 52.568385 410.85013 68.64262" marker-end="url(#FilledArrow_Marker_2)" stroke="black" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><rect x="355.65806" y="330.8197" width="123" height="19" fill="white"/><text transform="translate(360.65806 330.8197)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".40234375" y="15" textLength="112.19531">wasInformedBy</tspan></text><path d="M 424.7402 283.71702 C 429.45087 296.07572 447.59373 331.45429 419.03138 331.57143 C 397.0908 331.66135 404.20494 311.07593 410.7974 295.61202" marker-end="url(#FilledArrow_Marker_2)" stroke="black" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><path d="M 406.5677 228.77305 C 399.72294 215.04055 385.712 203.19351 386.03138 187.57143 C 386.28151 175.33617 395.32208 160.77952 402.8255 146.62993" marker-end="url(#FilledArrow_Marker_2)" stroke="black" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><path d="M 434.30098 135.01629 C 440.21052 146.533515 452.6941 153.95052 452.03138 169.57143 C 451.49823 182.13833 442.45644 200.02093 435.17428 216.80303" marker-end="url(#FilledArrow_Marker_2)" stroke="black" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><path d="M 127.59024 185.08037 C 107.01324 179.21836 72.15942 172.4132 72.612994 188.84755 C 73.18448 209.55223 95.32728 199.16384 140.36884 199.30667" marker-start="url(#FilledArrow_Marker_3)" stroke="#ff0080" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><path d="M 363.04477 107.916754 C 344.61697 125.51417 325.85744 149.86644 307.75584 160.71428 C 293.99226 168.96245 280.60278 169.407 267.1619 170.9479" marker-end="url(#FilledArrow_Marker_4)" stroke="#ff0080" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><path d="M 475.09058 283.22054 L 365.40638 283.22054 C 364.3018 283.22054 363.40638 282.3251 363.40638 281.22054 C 363.40638 281.22054 363.40638 281.22054 363.40638 281.22054 L 363.40638 231.22054 C 363.40638 230.11597 364.3018 229.22054 365.40638 229.22054 C 365.40638 229.22054 365.40638 229.22054 365.40638 229.22054 L 475.09058 229.22054 C 476.19515 229.22054 477.09058 230.11597 477.09058 231.22054 L 477.09058 281.22054 C 477.09058 282.3251 476.19515 283.22054 475.09058 283.22054 C 475.09058 283.22054 475.09058 283.22054 475.09058 283.22054 Z" fill="#cfceff"/><path d="M 475.09058 283.22054 L 365.40638 283.22054 C 364.3018 283.22054 363.40638 282.3251 363.40638 281.22054 C 363.40638 281.22054 363.40638 281.22054 363.40638 281.22054 L 363.40638 231.22054 C 363.40638 230.11597 364.3018 229.22054 365.40638 229.22054 C 365.40638 229.22054 365.40638 229.22054 365.40638 229.22054 L 475.09058 229.22054 C 476.19515 229.22054 477.09058 230.11597 477.09058 231.22054 L 477.09058 281.22054 C 477.09058 282.3251 476.19515 283.22054 475.09058 283.22054 C 475.09058 283.22054 475.09058 283.22054 475.09058 283.22054 Z M 465.72216 283.22054 L 465.72216 229.22054 M 374.7748 229.22054 L 374.7748 283.22054" stroke="#999" stroke-linecap="round" stroke-linejoin="round" stroke-width="1"/><text transform="translate(379.7748 246.72054)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="bold" x="9.110399" y="15" textLength="62.726562">Activity</tspan></text><path d="M 452.03138 80.57143 L 388.40638 80.57143 C 374.59926 80.57143 363.40638 91.76431 363.40638 105.57143 L 363.40638 109.57143 C 363.40638 123.37855 374.59926 134.57143 388.40638 134.57143 L 452.03138 134.57143 C 465.8385 134.57143 477.03138 123.37855 477.03138 109.571435 L 477.03138 105.57143 C 477.03138 91.76431 465.8385 80.57143 452.03138 80.57143 C 452.03138 80.57143 452.03138 80.57143 452.03138 80.57143 Z" fill="#fffedf"/><path d="M 452.03138 80.57143 L 388.40638 80.57143 C 374.59926 80.57143 363.40638 91.76431 363.40638 105.57143 L 363.40638 109.57143 C 363.40638 123.37855 374.59926 134.57143 388.40638 134.57143 L 452.03138 134.57143 C 465.8385 134.57143 477.03138 123.37855 477.03138 109.571435 L 477.03138 105.57143 C 477.03138 91.76431 465.8385 80.57143 452.03138 80.57143 C 452.03138 80.57143 452.03138 80.57143 452.03138 80.57143 Z" stroke="#999" stroke-linecap="round" stroke-linejoin="round" stroke-width="1"/><text transform="translate(368.40638 98.07143)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="bold" x="26.839844" y="15" textLength="49.945312">Entity</tspan></text><path d="M 140.36884 210.71741 L 140.36884 174.29784 C 140.36884 171.85943 141.84455 169.66355 144.10228 168.74242 L 194.94438 147.99929 C 196.39728 147.40652 198.0246 147.40652 199.4775 147.99929 L 250.3196 168.74242 C 252.57733 169.66355 254.05304 171.85943 254.05304 174.29784 L 254.05304 210.71741 C 254.05304 214.03112 251.36675 216.71741 248.05304 216.71741 L 146.36884 216.71741 C 143.05513 216.71741 140.36884 214.03112 140.36884 210.71741 Z" fill="#fc6" fill-opacity=".38999999"/><path d="M 140.36884 210.71741 L 140.36884 174.29784 C 140.36884 171.85943 141.84455 169.66355 144.10228 168.74242 L 194.94438 147.99929 C 196.39728 147.40652 198.0246 147.40652 199.4775 147.99929 L 250.3196 168.74242 C 252.57733 169.66355 254.05304 171.85943 254.05304 174.29784 L 254.05304 210.71741 C 254.05304 214.03112 251.36675 216.71741 248.05304 216.71741 L 146.36884 216.71741 C 143.05513 216.71741 140.36884 214.03112 140.36884 210.71741 Z" stroke="#999" stroke-linecap="round" stroke-linejoin="round" stroke-width="1"/><text transform="translate(145.36884 183.9567)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="bold" x="27.888975" y="15" textLength="47.90625">Agent</tspan></text><path d="M 363.06606 255.85426 C 346.20245 237.70235 330.55564 212.50016 312.47016 201.39307 C 298.32675 192.70697 282.68527 192.63697 267.30442 191.07628" marker-end="url(#FilledArrow_Marker_4)" stroke="#ff0080" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><rect x="520.69087" y="333.40178" width="114.63639" height="29.000002" fill="#e6e6e6"/><rect x="520.69087" y="333.40178" width="114.63639" height="29.000002" stroke="#999" stroke-linecap="round" stroke-linejoin="round" stroke-width="1"/><text transform="translate(525.69087 338.40178)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x="4.2674138" y="15" textLength="96.10156">xsd:dateTime</tspan></text><text transform="translate(245.98162 296.39702)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".4140625" y="15" textLength="102.171875">startedAtTime</tspan></text><rect x="211.78576" y="333.40178" width="114.63639" height="29.000002" fill="#e6e6e6"/><rect x="211.78576" y="333.40178" width="114.63639" height="29.000002" stroke="#999" stroke-linecap="round" stroke-linejoin="round" stroke-width="1"/><text transform="translate(216.78576 338.40178)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x="4.2674138" y="15" textLength="96.10156">xsd:dateTime</tspan></text></g></g></svg>
4 +