Changes for page Provenance of simulation and data analysis workflows
Last modified by adavison on 2022/05/23 22:24
Summary
-
Page properties (1 modified, 0 added, 0 removed)
-
Attachments (0 modified, 1 added, 0 removed)
-
Objects (0 modified, 1 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -1,35 +1,39 @@ 1 -(% class="jumbotron" %) 2 -((( 3 -(% class="container" %) 4 -((( 5 -= My Collab's Extended Title = 1 +== Introduction == 6 6 7 -My collab's subtitle 8 -))) 9 -))) 3 +Computational provenance is a record of all the steps in a computational scientific workflow, including the code that was run, input data, the computational environment (hardware, OS, compiler versions, library version...), the person who performed each step, and output data. 10 10 11 -(% class="row" %) 12 -((( 13 -(% class="col-xs-12 col-sm-8" %) 14 -((( 15 -= What can I find here? = 5 +Capturing computational provenance facilitates: 16 16 17 -* Noticehow the tableofcontentsonthe right18 -* isautomaticallyupdated19 -* to holdthispage'sheaders7 +* reproducibility of results 8 +* management and tracking of workflows/projects by the scientists/engineers involved 9 +* evaluation/review by other scientists and engineers 20 20 21 - =Who has access? =11 + 22 22 23 -Describe the audience of this collab. 24 -))) 13 +== Standards == 25 25 15 +The [[W3C PROV standard>>https://www.w3.org/TR/2013/NOTE-prov-overview-20130430/||rel=" noopener noreferrer" target="_blank"]] provides a data model and related tools for provenance interchange on the web. The following diagram shows the three base classes of the PROV data model: Entity, Activity, and Agent. These three classes form the basis for the representation of provenance in the EBRAINS Knowledge Graph: every node in the KG has a type which is a subclass of one of these base classes. 26 26 27 -(% class="col-xs-12 col-sm-4" %) 28 -((( 29 -{{box title="**Contents**"}} 30 -{{toc/}} 31 -{{/box}} 17 +[[image:starting-points.svg||alt="The three Starting Point classes of the W3C PROV ontology and the properties that relate them."]] 32 32 19 +== Storage of provenance in the Knowledge Graph == 20 + 21 + 22 +== Tools for automated capture of provenance == 23 + 24 +* on different systems: 25 +** HPC systems 26 +** neuromorphic systems 27 +** Jupyter notebooks 28 +** users' own computers 29 +* prospective/pre-emptive vs run-time provenance capture 30 +* capture of metadata vs capture of artefacts 31 + 32 +== Communication between computer systems and the KG == 33 + 34 +* local cache and synchronization? 35 + 36 + 37 +== User interfaces for browsing, visualizing, and searching provenance information == 38 + 33 33 34 -))) 35 -)))
- starting-points.svg
-
- Author
-
... ... @@ -1,0 +1,1 @@ 1 +XWiki.adavison - Size
-
... ... @@ -1,0 +1,1 @@ 1 +11.4 KB - Content
-
... ... @@ -1,0 +1,4 @@ 1 +<?xml version="1.0"?> 2 +<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd"> 3 +<svg xmlns="http://www.w3.org/2000/svg" xmlns:xl="http://www.w3.org/1999/xlink" version="1.1" viewBox="8 10 630 355" width="630pt" height="355pt"><metadata xmlns:dc="http://purl.org/dc/elements/1.1/"><dc:date>2012-11-25 17:39Z</dc:date><!-- Produced by OmniGraffle Professional 5.4.2 --></metadata><defs><font-face font-family="Georgia" font-size="16" panose-1="2 4 5 2 5 4 5 2 3 3" units-per-em="1000" underline-position="-88.378906" underline-thickness="49.316406" slope="0" x-height="481.4453" cap-height="692.8711" ascent="916.9922" descent="-219.23828" font-weight="500"><font-face-src><font-face-name name="Georgia"/></font-face-src></font-face><marker orient="auto" overflow="visible" markerUnits="strokeWidth" id="FilledArrow_Marker" viewBox="-1 -3 7 6" markerWidth="7" markerHeight="6" color="gray"><g><path d="M 4.8000002 0 L 0 -1.8000001 L 0 1.8000001 Z" fill="currentColor" stroke="currentColor" stroke-width="1"/></g></marker><marker orient="auto" overflow="visible" markerUnits="strokeWidth" id="FilledArrow_Marker_2" viewBox="-1 -3 7 6" markerWidth="7" markerHeight="6" color="black"><g><path d="M 4.8000002 0 L 0 -1.8000001 L 0 1.8000001 Z" fill="currentColor" stroke="currentColor" stroke-width="1"/></g></marker><marker orient="auto" overflow="visible" markerUnits="strokeWidth" id="FilledArrow_Marker_3" viewBox="-6 -3 7 6" markerWidth="7" markerHeight="6" color="#ff0080"><g><path d="M -4.8000002 0 L 0 1.8000001 L 0 -1.8000001 Z" fill="currentColor" stroke="currentColor" stroke-width="1"/></g></marker><marker orient="auto" overflow="visible" markerUnits="strokeWidth" id="FilledArrow_Marker_4" viewBox="-1 -3 7 6" markerWidth="7" markerHeight="6" color="#ff0080"><g><path d="M 4.8000002 0 L 0 -1.8000001 L 0 1.8000001 Z" fill="currentColor" stroke="currentColor" stroke-width="1"/></g></marker><font-face font-family="Georgia" font-size="16" panose-1="2 4 8 2 5 4 5 2 2 3" units-per-em="1000" underline-position="-87.890625" underline-thickness="59.570312" slope="0" x-height="484.375" cap-height="692.8711" ascent="916.9922" descent="-219.23828" font-weight="bold"><font-face-src><font-face-name name="Georgia-Bold"/></font-face-src></font-face></defs><g stroke="none" stroke-opacity="1" stroke-dasharray="none" fill="none" fill-opacity="1"><title>Canvas 1</title><rect fill="white" width="1278" height="801"/><g><title>Layer 1</title><rect x="341.84837" y="180.4197" width="44" height="29" fill="white"/><text transform="translate(346.84837 185.4197)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".48046875" y="15" textLength="33.039062">used</tspan></text><line x1="455.7823" y1="283.52519" x2="510.46198" y2="325.54177" marker-end="url(#FilledArrow_Marker)" stroke="gray" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><line x1="387.03948" y1="283.53818" x2="336.3846" y2="325.2067" marker-end="url(#FilledArrow_Marker)" stroke="gray" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><text transform="translate(497.15226 296.39702)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".015625" y="15" textLength="95.96875">endedAtTime</tspan></text><rect x="192.47014" y="228.09374" width="148" height="19" fill="white"/><text transform="translate(197.47014 228.09374)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".22265625" y="15" textLength="137.55469">wasAssociatedWith</tspan></text><rect x="8.368844" y="210.53593" width="132" height="19" fill="white"/><text transform="translate(13.368844 210.53593)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".203125" y="15" textLength="121.59375">actedOnBehalfOf</tspan></text><rect x="453.69215" y="150.13326" width="129" height="29" fill="white"/><text transform="translate(458.69215 155.13326)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".15234375" y="15" textLength="118.69531">wasGeneratedBy</tspan></text><rect x="211.47013" y="116.69822" width="129" height="19" fill="white"/><text transform="translate(216.47013 116.69822)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".03515625" y="15" textLength="118.92969">wasAttributedTo</tspan></text><rect x="351.0433" y="10.081995" width="132" height="19" fill="white"/><text transform="translate(356.0433 10.081995)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".26953125" y="15" textLength="121.46094">wasDerivedFrom</tspan></text><path d="M 424.76745 80.57143 C 429.47813 68.21273 447.59373 30.68857 419.03138 30.571429 C 396.97366 30.481023 404.24545 52.568385 410.85013 68.64262" marker-end="url(#FilledArrow_Marker_2)" stroke="black" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><rect x="355.65806" y="330.8197" width="123" height="19" fill="white"/><text transform="translate(360.65806 330.8197)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".40234375" y="15" textLength="112.19531">wasInformedBy</tspan></text><path d="M 424.7402 283.71702 C 429.45087 296.07572 447.59373 331.45429 419.03138 331.57143 C 397.0908 331.66135 404.20494 311.07593 410.7974 295.61202" marker-end="url(#FilledArrow_Marker_2)" stroke="black" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><path d="M 406.5677 228.77305 C 399.72294 215.04055 385.712 203.19351 386.03138 187.57143 C 386.28151 175.33617 395.32208 160.77952 402.8255 146.62993" marker-end="url(#FilledArrow_Marker_2)" stroke="black" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><path d="M 434.30098 135.01629 C 440.21052 146.533515 452.6941 153.95052 452.03138 169.57143 C 451.49823 182.13833 442.45644 200.02093 435.17428 216.80303" marker-end="url(#FilledArrow_Marker_2)" stroke="black" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><path d="M 127.59024 185.08037 C 107.01324 179.21836 72.15942 172.4132 72.612994 188.84755 C 73.18448 209.55223 95.32728 199.16384 140.36884 199.30667" marker-start="url(#FilledArrow_Marker_3)" stroke="#ff0080" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><path d="M 363.04477 107.916754 C 344.61697 125.51417 325.85744 149.86644 307.75584 160.71428 C 293.99226 168.96245 280.60278 169.407 267.1619 170.9479" marker-end="url(#FilledArrow_Marker_4)" stroke="#ff0080" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><path d="M 475.09058 283.22054 L 365.40638 283.22054 C 364.3018 283.22054 363.40638 282.3251 363.40638 281.22054 C 363.40638 281.22054 363.40638 281.22054 363.40638 281.22054 L 363.40638 231.22054 C 363.40638 230.11597 364.3018 229.22054 365.40638 229.22054 C 365.40638 229.22054 365.40638 229.22054 365.40638 229.22054 L 475.09058 229.22054 C 476.19515 229.22054 477.09058 230.11597 477.09058 231.22054 L 477.09058 281.22054 C 477.09058 282.3251 476.19515 283.22054 475.09058 283.22054 C 475.09058 283.22054 475.09058 283.22054 475.09058 283.22054 Z" fill="#cfceff"/><path d="M 475.09058 283.22054 L 365.40638 283.22054 C 364.3018 283.22054 363.40638 282.3251 363.40638 281.22054 C 363.40638 281.22054 363.40638 281.22054 363.40638 281.22054 L 363.40638 231.22054 C 363.40638 230.11597 364.3018 229.22054 365.40638 229.22054 C 365.40638 229.22054 365.40638 229.22054 365.40638 229.22054 L 475.09058 229.22054 C 476.19515 229.22054 477.09058 230.11597 477.09058 231.22054 L 477.09058 281.22054 C 477.09058 282.3251 476.19515 283.22054 475.09058 283.22054 C 475.09058 283.22054 475.09058 283.22054 475.09058 283.22054 Z M 465.72216 283.22054 L 465.72216 229.22054 M 374.7748 229.22054 L 374.7748 283.22054" stroke="#999" stroke-linecap="round" stroke-linejoin="round" stroke-width="1"/><text transform="translate(379.7748 246.72054)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="bold" x="9.110399" y="15" textLength="62.726562">Activity</tspan></text><path d="M 452.03138 80.57143 L 388.40638 80.57143 C 374.59926 80.57143 363.40638 91.76431 363.40638 105.57143 L 363.40638 109.57143 C 363.40638 123.37855 374.59926 134.57143 388.40638 134.57143 L 452.03138 134.57143 C 465.8385 134.57143 477.03138 123.37855 477.03138 109.571435 L 477.03138 105.57143 C 477.03138 91.76431 465.8385 80.57143 452.03138 80.57143 C 452.03138 80.57143 452.03138 80.57143 452.03138 80.57143 Z" fill="#fffedf"/><path d="M 452.03138 80.57143 L 388.40638 80.57143 C 374.59926 80.57143 363.40638 91.76431 363.40638 105.57143 L 363.40638 109.57143 C 363.40638 123.37855 374.59926 134.57143 388.40638 134.57143 L 452.03138 134.57143 C 465.8385 134.57143 477.03138 123.37855 477.03138 109.571435 L 477.03138 105.57143 C 477.03138 91.76431 465.8385 80.57143 452.03138 80.57143 C 452.03138 80.57143 452.03138 80.57143 452.03138 80.57143 Z" stroke="#999" stroke-linecap="round" stroke-linejoin="round" stroke-width="1"/><text transform="translate(368.40638 98.07143)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="bold" x="26.839844" y="15" textLength="49.945312">Entity</tspan></text><path d="M 140.36884 210.71741 L 140.36884 174.29784 C 140.36884 171.85943 141.84455 169.66355 144.10228 168.74242 L 194.94438 147.99929 C 196.39728 147.40652 198.0246 147.40652 199.4775 147.99929 L 250.3196 168.74242 C 252.57733 169.66355 254.05304 171.85943 254.05304 174.29784 L 254.05304 210.71741 C 254.05304 214.03112 251.36675 216.71741 248.05304 216.71741 L 146.36884 216.71741 C 143.05513 216.71741 140.36884 214.03112 140.36884 210.71741 Z" fill="#fc6" fill-opacity=".38999999"/><path d="M 140.36884 210.71741 L 140.36884 174.29784 C 140.36884 171.85943 141.84455 169.66355 144.10228 168.74242 L 194.94438 147.99929 C 196.39728 147.40652 198.0246 147.40652 199.4775 147.99929 L 250.3196 168.74242 C 252.57733 169.66355 254.05304 171.85943 254.05304 174.29784 L 254.05304 210.71741 C 254.05304 214.03112 251.36675 216.71741 248.05304 216.71741 L 146.36884 216.71741 C 143.05513 216.71741 140.36884 214.03112 140.36884 210.71741 Z" stroke="#999" stroke-linecap="round" stroke-linejoin="round" stroke-width="1"/><text transform="translate(145.36884 183.9567)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="bold" x="27.888975" y="15" textLength="47.90625">Agent</tspan></text><path d="M 363.06606 255.85426 C 346.20245 237.70235 330.55564 212.50016 312.47016 201.39307 C 298.32675 192.70697 282.68527 192.63697 267.30442 191.07628" marker-end="url(#FilledArrow_Marker_4)" stroke="#ff0080" stroke-linecap="round" stroke-linejoin="round" stroke-width="2"/><rect x="520.69087" y="333.40178" width="114.63639" height="29.000002" fill="#e6e6e6"/><rect x="520.69087" y="333.40178" width="114.63639" height="29.000002" stroke="#999" stroke-linecap="round" stroke-linejoin="round" stroke-width="1"/><text transform="translate(525.69087 338.40178)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x="4.2674138" y="15" textLength="96.10156">xsd:dateTime</tspan></text><text transform="translate(245.98162 296.39702)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x=".4140625" y="15" textLength="102.171875">startedAtTime</tspan></text><rect x="211.78576" y="333.40178" width="114.63639" height="29.000002" fill="#e6e6e6"/><rect x="211.78576" y="333.40178" width="114.63639" height="29.000002" stroke="#999" stroke-linecap="round" stroke-linejoin="round" stroke-width="1"/><text transform="translate(216.78576 338.40178)" fill="black"><tspan font-family="Georgia" font-size="16" font-weight="500" x="4.2674138" y="15" textLength="96.10156">xsd:dateTime</tspan></text></g></g></svg> 4 +
- XWiki.XWikiRights[2]
-
- Allow/Deny
-
... ... @@ -1,0 +1,1 @@ 1 +Allow - Groups
-
... ... @@ -1,0 +1,1 @@ 1 +Collabs.provenance-tracking._.groups.collab-provenance-tracking-administrator - Levels
-
... ... @@ -1,0 +1,1 @@ 1 +view,comment,edit,delete