Wiki source code of Model validation test suites

Version 3.1 by adavison on 2021/08/23 11:19

Show last authors
1 (% class="box infomessage" %)
2 (((
3 Note that this page was migrated from version 1 of the Collaboratory (old URL [[https:~~/~~/collab.humanbrainproject.eu/#/collab/8123/nav/61654>>https://collab.humanbrainproject.eu/#/collab/8123/nav/61654]] redirects here).
4 )))
5
6
7 This page gives an overview of CDP2 Product 2 - Single Model Benchmark and Validation Suite. The relevant Use Case is "Multi-scale validation: Validate the cellular level model behaviour against experiments at different scales, for example spiking behaviours at the single cell and microcircuit levels".
8
9
10 We have divided the overall test suite into a number of components, some containing validation tests specific to particular brain regions, others more generic. All validation tests are written in Python, using the SciUnit framework. This framework allows us to decouple the validation test definition from the model implementation, i.e. so that we can test different models of the same thing and/or change the implementation of our model, without having to modify or re-write the validation test.
11
12
13 The links in the list below lead to more information, and to the source code, for each test suite.
14
15 >COMING SOON: links to the results of running all the validation tests.
16
17
18 == Test suites for specific brain regions ==
19
20
21 * [[HippoUnit>>url:https://collab.humanbrainproject.eu/#/collab/8123/nav/61656?state=software,HippoUnit]] ([[https:~~/~~/github.com/KaliLab/hippounit>>url:https://github.com/KaliLab/hippounit]])
22 * [[CerebUnit>>url:https://github.com/lungsi/cerebellum-unit]] ([[https:~~/~~/github.com/lungsi/cerebellum-unit>>url:https://github.com/lungsi/cerebellum-unit]])
23 * [[BasalUnit>>url:https://collab.humanbrainproject.eu/#/collab/8123/nav/61656?state=software,BasalUnit]] ([[https:~~/~~/github.com/appukuttan-shailesh/basalunit>>url:https://github.com/appukuttan-shailesh/basalunit]])
24
25 == Test suites for model features, independent of cell type or brain region ==
26
27 * [[MorphoUnit>>url:https://collab.humanbrainproject.eu/#/collab/8123/nav/61656?state=software,MorphoUnit]] ([[https:~~/~~/github.com/appukuttan-shailesh/morphounit>>url:https://github.com/appukuttan-shailesh/morphounit]])
28 * [[NetworkUnit>>url:https://github.com/mvonpapen/simrest_validation]] ([[https:~~/~~/github.com/mvonpapen/simrest_validation>>url:https://github.com/mvonpapen/simrest_validation]])
29 * [[eFELUnit>>url:https://github.com/appukuttan-shailesh/eFELunit]] ([[https:~~/~~/github.com/appukuttan-shailesh/eFELunit>>url:https://github.com/appukuttan-shailesh/eFELunit]])
30
31 == Test suite for sub-cellular modelling (coming soon) ==
32
33 * [[SubCellUnit>>url:https://github.com/appukuttan-shailesh/subcellunit]] ([[https:~~/~~/github.com/appukuttan-shailesh/subcellunit>>url:https://github.com/appukuttan-shailesh/subcellunit]])