Wiki source code of Extension tvb-ext-xircuits

Version 44.1 by paulapopa on 2023/03/08 16:08

Hide last authors
ldomide 1.1 1 Source code: [[https:~~/~~/github.com/the-virtual-brain/tvb-ext-xircuits>>https://github.com/the-virtual-brain/tvb-ext-xircuits]]
2
ldomide 28.1 3 Release on Pypi: [[https:~~/~~/pypi.org/project/tvb-ext-xircuits/>>https://pypi.org/project/tvb-ext-xircuits/]]
4
ldomide 1.1 5 == Jupyter Lab Extension for building and executing EBRAINS Workflows ==
6
rominabaila 2.1 7 == Purpose ==
ldomide 1.1 8
rominabaila 14.1 9 This is a Jupyter Lab extension with the role of offering graphical support for EBRAINS workflows. It allows users to utilize all the TVB and EBRAINS capabilities, while drastically reducing the complexity of configuring them inside a Jupyter Lab environment.
rominabaila 3.1 10
11 **Note: **This extension is still a WIP (Work In Progress).
12
rominabaila 14.1 13
14 == Acknowledgements ==
15
16 This extension is build on top of the [[Xircuits Jupyter extension>>https://xircuits.io/]], but it also comes with custom functionalities, specifically designed for TVB and EBRAINS. These functionalities are detailed in a section below.
17
rominabaila 3.1 18 == Installation ==
19
paulapopa 44.1 20 The extension can be installed using the official PyPi distribution ([[https:~~/~~/pypi.org/project/tvb-ext-xircuits/>>https://pypi.org/project/tvb-ext-xircuits/]]):
rominabaila 3.1 21
22 (% class="box" %)
23 (((
24 pip install tvb-ext-xircuits
25 )))
26
rominabaila 9.1 27 After installing the extension and opening a Jupyter Lab session, you should be able to see in the left panel of Jupyter Lab a new icon, which represents the Xircuits components tray:
rominabaila 4.1 28
paulapopa 31.1 29 [[image:side.png]]
rominabaila 9.1 30
rominabaila 13.1 31 == **Usage** ==
rominabaila 4.1 32
rominabaila 12.1 33 === **Step 1. Create a new Xircuits workflow** ===
rominabaila 10.1 34
paulapopa 43.1 35 From the Jupyter Lab launcher, click on the **Xircuits File** icon, as in the screenshot below.
rominabaila 10.1 36
paulapopa 43.1 37 [[image:newxircs.png]]
38
39 A new file with the .xircuits extension will be generated under your current working directory. This is where you can start building the workflow diagram interactively.
40
41 [[image:newfile.png]]
42
43 You will notice that 2 components are already placed inside the workflow: the __Start__ and the __Finish__ components. They cannot be modified or deleted, and they represent the starting and finishing point of the workflow.
44
rominabaila 12.1 45 === **Step 2.  Drag components into the workflow area** ===
rominabaila 10.1 46
paulapopa 43.1 47 Open the components tray, from the left-side bar icon highlighted below.
rominabaila 10.1 48
paulapopa 43.1 49 [[image:tray.png]]
50
51 Now, you can browse through the components, select the one you wish to use, then drag and drop it into the workflow area.
52
53 [[image:components.png]]
54
rominabaila 12.1 55 === **Step 3. Configure the components** ===
rominabaila 10.1 56
paulapopa 43.1 57 The components that are provided in this extensions are configurable, meaning you can set some parameters on almost every component. Some of the parameters are literals, while some parameters are results of other components.
rominabaila 12.1 58
paulapopa 43.1 59 In case of primitives you need to open the //General// tab from the components tray and drag the appropriate //literal//: float, int, string, dict, etc.
60
61 The parameters need to be linked to the inputs of the component by dragging and dropping a connection from the output port of a literal/component towards the corresponding input port of the other component (e.g. the gray connections in the screenshot below).
62
63 [[image:diagr.png]]
64
rominabaila 12.1 65 === **Step 4. Make connections** ===
66
paulapopa 43.1 67 After dragging all your desired components/literals in the workflow area, it's time to connect the components.
rominabaila 12.1 68
paulapopa 43.1 69 First, link the __Start__ node to the first component of your workflow. Then make the connections between all your components. The last component should be linked to the __Finish__ node, to indicate the end of your workflow (e.g. the blue connections in the screenshot below). These connections will dictate the order of execution of the components in your workflow.
rominabaila 12.1 70
paulapopa 43.1 71 [[image:diagram.png]]
72
rominabaila 12.1 73 === **Step 5. Run the workflow** ===
74
75 After connecting everything, you need to run the workflow to actually see its result. For this you can click on the Run button (▶), which will also implicitly compile the workflow.
76
paulapopa 43.1 77 [[image:run.png]]
78
rominabaila 12.1 79 After clicking on Run, a new Jupyter Output window should appear in the bottom of your Jupyter Lab environment. Here you will see the output of your workflow, such as logs, static plots, etc.
80
paulapopa 43.1 81 [[image:out.png]]
82
rominabaila 12.1 83 === **Step 6. Share your work*** ===
84
85 This step is, of course, optional, but it is worth mentioning that sharing your workflows with others is extremely easy. By just saving and sharing your workflow (*.xircuits) file, anyone can access the entire workflow, see the exact connections that you made and receive the same configuration for the components.
86
87
88
rominabaila 15.1 89 == Custom functionalities ==
rominabaila 12.1 90
rominabaila 15.1 91 As mentioned before, besides all the core functionalities provided by Xircuits, some other functionalities were added to better suit the needs of the EBRAINS users.
92
93 === 1. Configure TVB models using the Phase Plane widget. ===
94
95 This functionality was added to make it easier for users to provide the correct parameters to TVB models, using the Phase Plane widget.
96
rominabaila 20.1 97 To use this functionality, drag any model from the **TVB_MODELS** (inside the components tray) into the workflow area. Then right click on the model and select the **Open Viewer** option:
rominabaila 15.1 98
rominabaila 20.1 99
100 (% style="text-align:center" %)
101 [[image:image-20221116125354-2.png||height="800" width="1130"]]
102
103
104 A new Jupyter tab should open, which contains a read-only Jupyter notebook. After following the instructions provided there, you should be able to see the Phase Plane widget associated with this particular model.
105
106 (% style="text-align:center" %)
107 [[image:image-20221116125822-1.png||height="800" width="821"]]
108
109 After configuring the parameters with the desired values, go to the Exports tab of the widget and click on **Export model configuration**. Now all you have to do is to go back to the tab where your workflow is and you will see that the model will have values set for all the parameters that you modified in the Phase Plane widget (that is all the parameters there were assigned values different than the default ones).
110
111 (% style="text-align:center" %)
112 [[image:image-20221116130425-1.png||height="900" width="1069"]]
113
114
rominabaila 21.1 115 == Workflow examples ==
rominabaila 20.1 116
rominabaila 25.2 117 (((
118 === 1. Full TVB Simulation workflow ===
119 )))
rominabaila 25.1 120
rominabaila 25.2 121 Contains all TVB components necessary for running a TVB simulation (i.e. connectivity, coupling, model, integrator, monitor, simulator).
rominabaila 25.1 122
rominabaila 25.2 123 {{html}}
rominabaila 27.1 124 <iframe src="https://drive.google.com/file/d/14sVjWXmtfZB-Zt7i3MA26-MiNWwv3jZI/preview" width="1280" height="720" allow="autoplay"></iframe>
rominabaila 25.2 125 {{/html}}
126
127
128 === 2. Configuring model parameters using the PhasePlaneWidget: ===
129
130 Same workflow as before, but the parameter for the model used in simulation are set using the PhasePlaneWidget.
131
rominabaila 26.1 132 {{html}}
rominabaila 27.1 133 <iframe src="https://drive.google.com/file/d/1Puoi4-Ej4BhVwtdRzciPD_qNKMF0HvGT/preview" width="1280" height="720" allow="autoplay"></iframe>
rominabaila 26.1 134 {{/html}}
rominabaila 25.3 135
136
137 === 3. Using siibra to retrieve connectivities from the EBRAINS KG ===
138
139 A simulation workflow where **siibra **is used to retrieve a connectivity from the EBRAINS KG. That connectivity is fed into a TVB Simulator, where the rest of the parameters (coupling, model, etc.) are set to default values.
140
rominabaila 26.1 141 {{html}}
rominabaila 27.1 142 <iframe src="https://drive.google.com/file/d/1bakH6ZD96eMHnYSw1aasF_gNXt8sBS7D/preview" width="1280" height="720" allow="autoplay"></iframe>
rominabaila 26.1 143 {{/html}}
144
145
146 === 4. Run a workflow inside an HPB job ===
147
148 A workflow simulation which is run remotely, by submitting a job to an HPC site and getting back the results (TimeSeries object).
149
rominabaila 27.1 150 {{html}}<iframe src="https://drive.google.com/file/d/1rvcj_9lGtR069iXlL3Rm1czMNdA3qmGM/preview" width="1280" height="720" allow="autoplay"></iframe>{{/html}}
rominabaila 26.1 151
Public

TVB Widgets