Wiki source code of Model validation test suites
Show last authors
author | version | line-number | content |
---|---|---|---|
1 | = Model validation test suites = | ||
2 | |||
3 | |||
4 | This page gives an overview of CDP2 Product 2 - Single Model Benchmark and Validation Suite. The relevant Use Case is "//Multi-scale validation: V//alidate the cellular level model behaviour against experiments at different scales, for example spiking behaviours at the single cell and microcircuit levels". | ||
5 | |||
6 | |||
7 | We have divided the overall test suite into a number of components, some containing validation tests specific to particular brain regions, others more generic. All validation tests are written in Python, using the SciUnit framework. This framework allows us to decouple the validation test definition from the model implementation, i.e. so that we can test different models of the same thing and/or change the implementation of our model, without having to modify or re-write the validation test. | ||
8 | |||
9 | |||
10 | The links in the list below lead to more information, and to the source code, for each test suite. | ||
11 | |||
12 | >COMING SOON: links to the results of running all the validation tests. | ||
13 | |||
14 | |||
15 | == Test suites for specific brain regions == | ||
16 | |||
17 | |||
18 | * [[HippoUnit>>url:https://collab.humanbrainproject.eu/#/collab/8123/nav/61656?state=software,HippoUnit]] ([[https:~~/~~/github.com/KaliLab/hippounit>>url:https://github.com/KaliLab/hippounit]]) | ||
19 | * [[CerebUnit>>url:https://github.com/lungsi/cerebellum-unit]] ([[https:~~/~~/github.com/lungsi/cerebellum-unit>>url:https://github.com/lungsi/cerebellum-unit]]) | ||
20 | * [[BasalUnit>>url:https://collab.humanbrainproject.eu/#/collab/8123/nav/61656?state=software,BasalUnit]] ([[https:~~/~~/github.com/appukuttan-shailesh/basalunit>>url:https://github.com/appukuttan-shailesh/basalunit]]) | ||
21 | |||
22 | |||
23 | == Test suites for model features, independent of cell type or brain region == | ||
24 | |||
25 | * [[MorphoUnit>>url:https://collab.humanbrainproject.eu/#/collab/8123/nav/61656?state=software,MorphoUnit]] ([[https:~~/~~/github.com/appukuttan-shailesh/morphounit>>url:https://github.com/appukuttan-shailesh/morphounit]]) | ||
26 | * [[NetworkUnit>>url:https://github.com/mvonpapen/simrest_validation]] ([[https:~~/~~/github.com/mvonpapen/simrest_validation>>url:https://github.com/mvonpapen/simrest_validation]]) | ||
27 | * [[eFELUnit>>url:https://github.com/appukuttan-shailesh/eFELunit]] ([[https:~~/~~/github.com/appukuttan-shailesh/eFELunit>>url:https://github.com/appukuttan-shailesh/eFELunit]]) | ||
28 | |||
29 | |||
30 | == Test suite for sub-cellular modelling (coming soon) == | ||
31 | |||
32 | * [[SubCellUnit>>url:https://github.com/appukuttan-shailesh/subcellunit]] ([[https:~~/~~/github.com/appukuttan-shailesh/subcellunit>>url:https://github.com/appukuttan-shailesh/subcellunit]]) |