Last modified by puchades on 2022/09/30 16:01
From version 53.1
edited by tomazvieira
on 2022/09/11 17:13
Change comment: There is no comment for this version
To version 45.1
edited by tomazvieira
on 2022/09/11 15:58
Change comment: Uploaded new attachment "image-20220911155827-1.png", version {1}

Summary

Details

Page properties
Content
... ... @@ -49,24 +49,20 @@
49 49  
50 50  === Opening a Dataset from the data-proxy ===
51 51  
52 -You can also load Neuroglancer Precomputed Chunks data from the data-proxy (e.g. the [[ana-workshop-event bucket>>https://wiki.ebrains.eu/bin/view/Collabs/ana-workshop-event/Bucket]]); The URLs for this kind of data follow the following scheme:
53 -\\##precomputed:~/~/https:~/~/data-proxy.ebrains.eu/api/v1/buckets/(% style="background-color:#3498db; color:#ffffff" %)my-bucket-name(% style="background-color:#ffffff; color:#000000" %)/(% style="background-color:#9b59b6; color:#ffffff" %)path/inside/your/bucket(%%)##
52 +You can also load Neuroglancer Precomputed Chunks data from the data-proxy; The URLs for this kind of data follow the following scheme:
53 +\\##precomputed:~/~/https:~/~/data-proxy.ebrains.eu/api/buckets/(% style="background-color:#3498db; color:#ffffff" %)my-bucket-name(% style="background-color:#9b59b6; color:#ffffff" %)/path/inside/your/bucket(%%)##
54 54  
55 -where (% style="background-color:#9b59b6; color:#ffffff" %)path/inside/your/bucket(%%)  should be the path to the folder containing the dataset "info" file.
55 +So, for example, to load the sample data inside the (% style="background-color:#3498db; color:#ffffff" %)ana-workshop(%%) bucket, under the path (% style="background-color:#9b59b6; color:#ffffff" %)tg-ArcSwe_mice_precomputed/hbp-00138_122_381_423_s001.precomputed(% style="color:#000000" %) (%%) like in the example below:
56 56  
57 57  
58 -So, for example, to load the sample data inside the (% style="background-color:#3498db; color:#ffffff" %)ana-workshop-event(%%) bucket, under the path (% style="background-color:#9b59b6; color:#ffffff" %)tg-ArcSwe_mice_precomputed/hbp-00138_122_381_423_s001.precomputed(% style="color:#000000" %) (%%) like in the example below:
58 +[[image:image-20220128142757-1.png]]
59 59  
60 -(% style="display:none" %) (%%)
60 +=== ===
61 61  
62 -[[image:webilastik_bucket_paths.png]]
63 -
64 -=== ===
65 -
66 66  you would type a URL like this:
67 67  
68 68  
69 -{{{precomputed://https://data-proxy.ebrains.eu/api/v1/buckets/ana-workshop-event/tg-ArcSwe_mice_precomputed/hbp-00138_122_381_423_s001.precomputed}}}
65 +##precomputed:~/~/https:~/~/data-proxy.ebrains.eu/api/buckets/(% style="background-color:#3498db; color:#ffffff" %)ana-workshop(%%)/(% style="background-color:#9b59b6; color:#ffffff" %)tg-ArcSwe_mice_precomputed/hbp-00138_122_381_423_s001.precomputed(%%)##
70 70  
71 71  this scheme is the same whether you're loading data into the Neuroglancer viewer or specifying an input URL in the export applet.
72 72  
... ... @@ -80,6 +80,7 @@
80 80  
81 81  [[image:image-20220125164557-4.png]]
82 82  
79 +You can also click the
83 83  
84 84  ==== A Note on Neuroglancer and 2D data ====
85 85  
... ... @@ -99,17 +99,18 @@
99 99  
100 100  Normal ilastik operation can be computationally intensive, requiring dedicated compute resources to be allocated to every user working with it.
101 101  
99 +
102 102  The "Session Management" widget allows you to request a compute session where webilastik will run; Select a session duration and click 'Create' to create a new compute session. Eventually the compute session will be allocated, opening up the other workflow widgets.
103 103  
104 -Don't forget to close your compute session by clicking the "Close Session" button once you're done to prevent wasting your quota in the HPC. If you have a long running job, though, you can just leave the session and rejoin it later by pasting its session ID in the "Session Id" field of the "Session Management" widget and clicking "rejoin Session".
105 105  
103 +
106 106  == Training the Pixel Classifier ==
107 107  
108 108  === Selecting Image Features ===
109 109  
110 -Pixel Classification uses different characteristics ("features") of each pixel from your image to determine which class that pixel should belong to. These take into account, for example, color and texture of each pixel as well as that of the neighboring pixels. Each one of this characteristics requires some computational power, which is why you can select only the ones that are sensible for your particular dataset.
108 +Pixel Classification uses different characteristics ("features") of your image to determine which class each pixel should belong to. These take into account, for example, color and texture of each pixel as well as that of the neighboring pixels. Each one of this characteristics requires some computational power, which is why you can select only the ones that are sensible for your particular dataset.
111 111  
112 -Use the checkboxes in the applet "Select Image Features" applet to select some image features and their corresponding sigma. The higher the sigma, the bigger the vicinity considered when computing values for each pixel, and the bigger its influence over the final value of that feature. Higher sigmas also require more computations to be done and can increase the time required to do predictions.
110 +Use the checkboxes in the applet "Select Image Features" applet to select some image features and their corresponding sigma (which determines the radius around the pixel that will be considered when computing that feature).
113 113  
114 114  You can read more about image features in [[ilastik's documentation.>>https://www.ilastik.org/documentation/pixelclassification/pixelclassification\]]
115 115  
... ... @@ -119,15 +119,12 @@
119 119  
120 120  === Labeling the image ===
121 121  
122 -In order to classify the pixels of an image into different classes (e.g.: 'foreground' and 'background') ilastik needs you to provide it with examples of each class.
120 +In order to classify the pixels of an image into different classes (e.g.: 'foreground' and 'background') ilastik needs you to provide it with samples of each class.
123 123  
122 +To do so, first select a particular resolution of your dataset (your viewer might interpolate between multiple scales of the dataset, but ilastik operates on a single resolution):
124 124  
125 -==== Picking an Image Resolution (for multi-resolution images only) ====
124 +[[image:image-20220125165642-1.png]]
126 126  
127 -If your data has multiple resolutions (**not the case in any of the sample datasets**), you'll have to pick one of them in the "Training" widget. Neuroglancer interpolates between multiple scales of the dataset, but ilastik operates on a single resolution:
128 -
129 -[[image:image-20220911155827-1.png]]
130 -
131 131  Once you've selected a resolution to train on, you should see a new "training" tab at the top of the viewer:
132 132  
133 133  [[image:image-20220125165832-2.png]]
... ... @@ -136,21 +136,16 @@
136 136  
137 137  [[image:image-20220222151117-1.png]]
138 138  
139 -==== ====
140 140  
141 -==== Painting Labels ====
135 +The status display in this applet will show "training on [datasource url]" when you're in training mode.
142 142  
143 -The status display in the "Training" applet will show "training on [datasource url]" when it's ready to start painting.
137 +Now you can start adding brush strokes. Select a color from the color picker, check the "Enable Brushing" checkbox to enable brushing (and disable navigation), and click and drag over the image to add brush strokes. Ilastik will map each used color to a "class", and will try to figure out a class for every pixel in the image based on the examples provided by the brush strokes. By painting, you provide ilastik with samples of what a pixel in that particular class should look like. The following image shows an example with 2 classes: teal, representing the "foreground" or the "cell class", and magenta, representing the "background" class.
144 144  
145 -Now you can start adding brush strokes. By default, webilastik will create two kinds of labels: "Background" and "Foreground". You can rename them to your liking or change their colors to something more suitable for you or your dataset. You can also add more labels if you'd like ilastik to classify the pixels of your image into more than two categories.
139 +[[image:image-20220222153157-4.png]]
146 146  
147 -Select one of the labels from the "Current Label" dropdown or by using the "Select Label" button, check the "Enable Brushing" checkbox to enable brushing mode (**and disable navigation**), and click and drag over the image to add brush strokes. Ilastik will map each used color to a "class", and will try to figure out a class for every pixel in the image based on the examples provided by the brush strokes. By painting, you provide ilastik with samples of what a pixel in that particular class should look like. The following image shows an example with 2 classes: magenta, representing the "foreground" and green, representing the "background" class.
148 -
149 -[[image:image-20220911162555-3.png]]
150 -
151 151  Once you have some image features selected and some brush annotation of at least 2 colors, you can check "Live Update" and ilastik will automatically use your examples to predict what classes the rest of your dataset should be, displaying the results in a "predictions" tab.
152 152  
153 -[[image:image-20220911163127-4.png]]
143 +[[image:image-20220222153610-5.png]]
154 154  
155 155  
156 156  You can keep adding or removing brush strokes to improve your predictions.
... ... @@ -161,34 +161,26 @@
161 161  1. Adjust the layer opacity to better view the predictions or underlying raw data;
162 162  1. Advanced users: edit the shader to render the predictions in any arbitrary way;
163 163  
164 -The image below shows the "predictions" tab with an opacity set to 0.88 using the steps described above:
154 +The image below shows the "predictions" tab with an opacity set to 0.68 using the steps described above:
165 165  
166 -[[image:image-20220911163504-5.png]]
156 +[[image:image-20220125172238-8.png]]
167 167  
168 -You can keep adding or removing features to your model, as well as adding and removing annotations, which will automatically refresh the predictions tab.
158 +You can keep adding or removing features to your model, as well as adding and removing annotations, which will automatically update the predictions tab.
169 169  
170 170  === Exporting Results and Running Jobs ===
171 171  
172 -Once you trained your pixel classifier with the previous applets, you can apply it to other datasets or even the same dataset that was used to do the training on. You can export your results in two ways:
162 +Once you trained your pixel classifier with the previous applets, you can apply it to other datasets or even the same dataset that was used to do the training on.
173 173  
174 -~1. As a "Predictions Map", which is a float32 image with as many channels as the number of Label colors you've used, or;
164 +To do so, select a data source by typing in the URL of the data source in the Data Source Url field and select a scale from the data source as they appear beneath the URL field.
175 175  
176 -2. As a "Simple Segmentation", which is one 3-channel uint8 image for each of the Label colors you've used. The imag will be red where that pixel is more likely to belong to the respective Label and black everywhere else.
166 +Then, configure a Data Sink, i.e., a destination that will receive the results of the pixel classification. For now, webilastik will only export to ebrains' data-proxy buckets; Fill in the name of the bucket and then the prefix (i.e.: path within the bucket) where the results in Neuroglancer's precomputed chunks format should be written to.
177 177  
178 -To do so, select a data source by typing in the URL of the data source in the "Url" field of the "Input" fieldset and select a scale from the data source as they appear beneath the URL field. You can also click the "Suggestions..." button to select one of the annotated datasources.
168 +[[image:image-20220125190311-2.png]]
179 179  
180 -Then, configure the Output, i.e., the destination that will receive the results of the pixel classification. For now, webilastik will only export to ebrains' data-proxy buckets:
181 -
182 -1. Fill in the name of the data-proxy bucket where the results in Neuroglancer's precomputed chunks format should be written to;
183 -1. Fill in the directory path inside the bucket where the results should be saved to. This path will also contain the "info" file of the precomputed chunks format.
184 -
185 -[[image:image-20220911170735-7.png]]
186 -
187 -
188 188  Finally, click export button and eventually a new job shall be created if all the parameters were filled in correctly.
189 189  
190 190  You'll be able to find your results in the data-proxy GUI, in a url that looks something like this:
191 191  
192 -https:~/~/data-proxy.ebrains.eu/your-bucket-name?prefix=your/info/directory/path
174 +https:~/~/data-proxy.ebrains.eu/your-bucket-name?prefix=your/selected/prefix
193 193  
194 194  [[image:image-20220125191847-3.png]]
image-20220911162525-2.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.tomazvieira
Size
... ... @@ -1,1 +1,0 @@
1 -124.5 KB
Content
image-20220911162555-3.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.tomazvieira
Size
... ... @@ -1,1 +1,0 @@
1 -154.7 KB
Content
image-20220911163127-4.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.tomazvieira
Size
... ... @@ -1,1 +1,0 @@
1 -136.9 KB
Content
image-20220911163504-5.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.tomazvieira
Size
... ... @@ -1,1 +1,0 @@
1 -49.9 KB
Content
image-20220911165711-6.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.tomazvieira
Size
... ... @@ -1,1 +1,0 @@
1 -138.8 KB
Content
image-20220911170735-7.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.tomazvieira
Size
... ... @@ -1,1 +1,0 @@
1 -138.9 KB
Content