Changes for page Methodology
Last modified by manuelmenendez on 2025/03/14 08:31
From version 17.1
edited by manuelmenendez
on 2025/02/09 13:01
on 2025/02/09 13:01
Change comment:
There is no comment for this version
To version 12.2
edited by manuelmenendez
on 2025/02/09 09:54
on 2025/02/09 09:54
Change comment:
There is no comment for this version
Summary
-
Page properties (1 modified, 0 added, 0 removed)
Details
- Page properties
-
- Content
-
... ... @@ -1,154 +1,273 @@ 1 -== **Overview** == 1 +==== **Overview** ==== 2 2 3 - Neurodiagnosesdevelops a **tridimensional diagnostic framework** for **CNS diseases**, incorporating **AI-powered annotation tools** to improve **interpretability, standardization, and clinical utility.**3 +This project develops a **tridimensional diagnostic framework** for **CNS diseases**, incorporating **AI-powered annotation tools** to improve **interpretability, standardization, and clinical utility**. The methodology integrates **multi-modal data**, including **genetic, neuroimaging, neurophysiological, and biomarker datasets**, and applies **machine learning models** to generate **structured, explainable diagnostic outputs**. 4 4 5 -This methodology integrates **multi-modal data**, including: 6 -**Genetic data** (whole-genome sequencing, polygenic risk scores). 7 -**Neuroimaging** (MRI, PET, EEG, MEG). 8 -**Neurophysiological data** (EEG-based biomarkers, sleep actigraphy). 9 -**CSF & Blood Biomarkers** (Amyloid-beta, Tau, Neurofilament Light). 5 +=== **Workflow** === 10 10 11 -By applying **machine learning models**, Neurodiagnoses generates **structured, explainable diagnostic outputs** to assist **clinical decision-making** and **biomarker-driven patient stratification.** 7 +1. ((( 8 +**We Use GitHub to [[Store and develop AI models, scripts, and annotation pipelines.>>https://github.com/Fundacion-de-Neurociencias/neurodiagnoses/discussions]]** 12 12 10 +* Create a **GitHub repository** for AI scripts and models. 11 +* Use **GitHub Projects** to manage research milestones. 12 +))) 13 +1. ((( 14 +**We Use EBRAINS for Data & Collaboration** 15 + 16 +* Store **biomarker and neuroimaging data** in **EBRAINS Buckets**. 17 +* Run **Jupyter Notebooks** in **EBRAINS Lab** to test AI models. 18 +* Use **EBRAINS Wiki** for structured documentation and research discussion. 19 +))) 20 + 13 13 ---- 14 14 15 -== **Data Integration & External Databases** ==23 +=== **1. Data Integration** === 16 16 17 -== =**How to UseExternal Databasesin Neurodiagnoses**===25 +== Overview == 18 18 19 -Neurodiagnoses integrates data from multiple **biomedical and neurological research databases**. Researchers can follow these steps to **access, prepare, and integrate** data into the Neurodiagnoses framework. 20 20 21 -**Potential Data Sources** 22 -**Reference:** [[List of Potential Databases>>url:https://github.com/Fundacion-de-Neurociencias/neurodiagnoses/blob/main/data/sources/list_of_potential_databases]] 28 +Neurodiagnoses integrates clinical data via the **EBRAINS Medical Informatics Platform (MIP)**. MIP federates decentralized clinical data, allowing Neurodiagnoses to securely access and process sensitive information for AI-based diagnostics. 23 23 24 -== =**RegisterforAccess**===30 +== How It Works == 25 25 26 -Each **external database** requires **individual registration** and approval. 27 -✔️ Follow the official **data access guidelines** of each provider. 28 -✔️ Ensure compliance with **ethical approvals** and **data-sharing agreements (DUAs).** 29 29 30 -=== **Download & Prepare Data** === 33 +1. ((( 34 +**Authentication & API Access:** 31 31 32 -Once access is granted, download datasets **following compliance guidelines** and **format requirements** for integration. 36 +* Users must have an **EBRAINS account**. 37 +* Neurodiagnoses uses **secure API endpoints** to fetch clinical data (e.g., from the **Federation for Dementia**). 38 +))) 39 +1. ((( 40 +**Data Mapping & Harmonization:** 33 33 34 -**Supported File Formats** 42 +* Retrieved data is **normalized** and converted to standard formats (.csv, .json). 43 +* Data from **multiple sources** is harmonized to ensure consistency for AI processing. 44 +))) 45 +1. ((( 46 +**Security & Compliance:** 35 35 36 -* **TabularData**:.csv,.tsv37 -* ** NeuroimagingData**: .nii,.dcm38 -* **GenomicData**: .fasta,.vcf39 - * **Clinical Metadata**: .json, .xml48 +* All data access is **logged and monitored**. 49 +* Data remains on **MIP servers** using **federated learning techniques** when possible. 50 +* Access is granted only after signing a **Data Usage Agreement (DUA)**. 51 +))) 40 40 41 - **MandatoryFields forIntegration**53 +== Implementation Steps == 42 42 43 -|=**Field Name**|=**Description** 44 -|**Subject ID**|Unique patient identifier 45 -|**Diagnosis**|Standardized disease classification 46 -|**Biomarkers**|CSF, plasma, or imaging biomarkers 47 -|**Genetic Data**|Whole-genome or exome sequencing 48 -|**Neuroimaging Metadata**|MRI/PET acquisition parameters 49 49 50 -=== **Upload Data to Neurodiagnoses** === 56 +1. Clone the repository. 57 +1. Configure your **EBRAINS API credentials** in mip_integration.py. 58 +1. Run the script to **download and harmonize clinical data**. 59 +1. Process the data for **AI model training**. 51 51 52 -**Option 1:** Upload to **EBRAINS Bucket** → [[Neurodiagnoses Data Storage>>url:https://wiki.ebrains.eu/bin/view/Collabs/neurodiagnoses/Bucket]] 53 -**Option 2:** Contribute via **GitHub Repository** → [[GitHub Data Repository>>url:https://github.com/Fundacion-de-Neurociencias/neurodiagnoses/tree/main/data]] 61 +For more detailed instructions, please refer to the **[[MIP Documentation>>url:https://mip.ebrains.eu/]]**. 54 54 55 - **For large datasets, please contact project administrators before uploading.**63 +---- 56 56 57 -= ==**IntegrateDataintoAI Models**===65 += Data Processing & Integration with Clinica.Run = 58 58 59 -Use **Jupyter Notebooks** on EBRAINS for **data preprocessing.** 60 -Standardize data using **harmonization tools.** 61 -Train AI models with **newly integrated datasets.** 62 62 63 - **Reference:**[[Data Processing Guide>>url:https://github.com/Fundacion-de-Neurociencias/neurodiagnoses/blob/main/docs/data_processing.md]]68 +== Overview == 64 64 65 ----- 66 66 67 - ==**AI-PoweredAnnotation& MachineLearningModels**==71 +Neurodiagnoses now supports **Clinica.Run**, an open-source neuroimaging platform designed for **multimodal data processing and reproducible neuroscience workflows**. 68 68 69 - Neurodiagnosesapplies **advanced machine learning models**toclassify CNS diseases, extract features from **biomarkersand neuroimaging**, and provide **AI-powered annotation.**73 +== How It Works == 70 70 71 -=== **AI Model Categories** === 72 72 73 -|=**Model Type**|=**Function**|=**Example Algorithms** 74 -|**Probabilistic Diagnosis**|Assigns probability scores to multiple CNS disorders.|Random Forest, XGBoost, Bayesian Networks 75 -|**Tridimensional Diagnosis**|Classifies disorders based on Etiology, Biomarkers, and Neuroanatomical Correlations.|CNNs, Transformers, Autoencoders 76 -|**Biomarker Prediction**|Predicts missing biomarker values using regression.|KNN Imputation, Bayesian Estimation 77 -|**Neuroimaging Feature Extraction**|Extracts patterns from MRI, PET, EEG.|CNNs, Graph Neural Networks 78 -|**Clinical Decision Support**|Generates AI-driven diagnostic reports.|SHAP Explainability Tools 76 +1. ((( 77 +**Neuroimaging Preprocessing:** 79 79 80 -**Reference:** [[AI Model Documentation>>url:https://github.com/Fundacion-de-Neurociencias/neurodiagnoses/blob/main/docs/models.md]] 79 +* MRI, PET, EEG data is preprocessed using **Clinica.Run pipelines**. 80 +* Supports **longitudinal and cross-sectional analyses**. 81 +))) 82 +1. ((( 83 +**Automated Biomarker Extraction:** 81 81 85 +* Standardized extraction of **volumetric, metabolic, and functional biomarkers**. 86 +* Integration with machine learning models in Neurodiagnoses. 87 +))) 88 +1. ((( 89 +**Data Security & Compliance:** 90 + 91 +* Clinica.Run operates in **compliance with GDPR and HIPAA**. 92 +* Neuroimaging data remains **within the original storage environment**. 93 +))) 94 + 95 +== Implementation Steps == 96 + 97 + 98 +1. Install **Clinica.Run** dependencies. 99 +1. Configure your **Clinica.Run pipeline** in clinica_run_config.json. 100 +1. Run the pipeline for **preprocessing and biomarker extraction**. 101 +1. Use processed neuroimaging data for **AI-driven diagnostics** in Neurodiagnoses. 102 + 103 +For further information, refer to **[[Clinica.Run Documentation>>url:https://clinica.run/]]**. 104 + 105 +==== ==== 106 + 107 +==== **Data Sources** ==== 108 + 109 +[[List of potential sources of databases>>https://github.com/Fundacion-de-Neurociencias/neurodiagnoses/blob/main/data/sources/list_of_potential_databases]] 110 + 111 +**Biomedical Ontologies & Databases:** 112 + 113 +* **Human Phenotype Ontology (HPO)** for symptom annotation. 114 +* **Gene Ontology (GO)** for molecular and cellular processes. 115 + 116 +**Dimensionality Reduction and Interpretability:** 117 + 118 +* **Evaluate interpretability** using metrics like the **Area Under the Interpretability Curve (AUIC)**. 119 +* **Leverage [[DEIBO>>https://github.com/Mellandd/DEIBO]] (Data-driven Embedding Interpretation Based on Ontologies)** to connect model dimensions to ontology concepts. 120 + 121 +**Neuroimaging & EEG/MEG Data:** 122 + 123 +* **MRI volumetric measures** for brain atrophy tracking. 124 +* **EEG functional connectivity patterns** (AI-Mind). 125 + 126 +**Clinical & Biomarker Data:** 127 + 128 +* **CSF biomarkers** (Amyloid-beta, Tau, Neurofilament Light). 129 +* **Sleep monitoring and actigraphy data** (ADIS). 130 + 131 +**Federated Learning Integration:** 132 + 133 +* **Secure multi-center data harmonization** (PROMINENT). 134 + 82 82 ---- 83 83 84 -== ** Clinical Decision Support& Tridimensional Diagnostic Framework** ==137 +==== **Annotation System for Multi-Modal Data** ==== 85 85 86 - Neurodiagnosesgenerates**structuredAI reports**forclinicians, combining:139 +To ensure **structured integration of diverse datasets**, **Neurodiagnoses** will implement an **AI-driven annotation system**, which will: 87 87 88 -**Probabilistic Diagnosis:** AI-generated ranking of potential diagnoses. 89 -**Tridimensional Classification:** Standardized diagnostic reports based on: 141 +* **Assign standardized metadata tags** to diagnostic features. 142 +* **Provide contextual explanations** for AI-based classifications. 143 +* **Track temporal disease progression annotations** to identify long-term trends. 90 90 91 -1. **Axis 1:** **Etiology** → Genetic, Autoimmune, Prion, Toxic, Vascular. 92 -1. **Axis 2:** **Molecular Markers** → CSF, Neuroinflammation, EEG biomarkers. 93 -1. **Axis 3:** **Neuroanatomoclinical Correlations** → MRI atrophy, PET. 145 +---- 94 94 95 -** Reference:** [[Tridimensional Classification Guide>>url:https://github.com/Fundacion-de-Neurociencias/neurodiagnoses/blob/main/docs/classification.md]]147 +=== **2. AI-Based Analysis** === 96 96 149 +==== **Machine Learning & Deep Learning Models** ==== 150 + 151 +**Risk Prediction Models:** 152 + 153 +* **LETHE’s cognitive risk prediction model** integrated into the annotation framework. 154 + 155 +**Biomarker Classification & Probabilistic Imputation:** 156 + 157 +* **KNN Imputer** and **Bayesian models** used for handling **missing biomarker data**. 158 + 159 +**Neuroimaging Feature Extraction:** 160 + 161 +* **MRI & EEG data** annotated with **neuroanatomical feature labels**. 162 + 163 +==== **AI-Powered Annotation System** ==== 164 + 165 +* Uses **SHAP-based interpretability tools** to explain model decisions. 166 +* Generates **automated clinical annotations** in structured reports. 167 +* Links findings to **standardized medical ontologies** (e.g., **SNOMED, HPO**). 168 + 97 97 ---- 98 98 99 -== **Dat aSecurity,Compliance & FederatedLearning** ==171 +=== **3. Diagnostic Framework & Clinical Decision Support** === 100 100 101 -✔ **Privacy-Preserving AI**: Implements **Federated Learning**, ensuring that patient data **never leaves** local institutions. 102 -✔ **Secure Data Access**: Data remains **stored in EBRAINS MIP servers** using **differential privacy techniques.** 103 -✔ **Ethical & GDPR Compliance**: Data-sharing agreements **must be signed** before use. 173 +==== **Tridimensional Diagnostic Axes** ==== 104 104 105 -** Reference:**[[Data Protection& Federated Learning>>url:https://github.com/Fundacion-de-Neurociencias/neurodiagnoses/blob/main/docs/security.md]]175 +**Axis 1: Etiology (Pathogenic Mechanisms)** 106 106 177 +* Classification based on **genetic markers, cellular pathways, and environmental risk factors**. 178 +* **AI-assisted annotation** provides **causal interpretations** for clinical use. 179 + 180 +**Axis 2: Molecular Markers & Biomarkers** 181 + 182 +* **Integration of CSF, blood, and neuroimaging biomarkers**. 183 +* **Structured annotation** highlights **biological pathways linked to diagnosis**. 184 + 185 +**Axis 3: Neuroanatomoclinical Correlations** 186 + 187 +* **MRI and EEG data** provide anatomical and functional insights. 188 +* **AI-generated progression maps** annotate **brain structure-function relationships**. 189 + 107 107 ---- 108 108 109 -== ** DataProcessing&Integrationwith Clinica.Run** ==192 +=== **4. Computational Workflow & Annotation Pipelines** === 110 110 111 - Neurodiagnosesnow supports**Clinica.Run**, an **open-source neuroimaging platform** for **multimodaldata processing.**194 +==== **Data Processing Steps** ==== 112 112 113 - ===**HowItWorks**===196 +**Data Ingestion:** 114 114 115 -✔ **Neuroimaging Preprocessing**: MRI, PET, EEG data is preprocessed using **Clinica.Run pipelines.** 116 -✔ **Automated Biomarker Extraction**: Extracts volumetric, metabolic, and functional biomarkers. 117 -✔ **Data Security & Compliance**: Clinica.Run is **GDPR & HIPAA-compliant.** 198 +* **Harmonized datasets** stored in **EBRAINS Bucket**. 199 +* **Preprocessing pipelines** clean and standardize data. 118 118 119 - ===**ImplementationSteps**===201 +**Feature Engineering:** 120 120 121 -1. Install **Clinica.Run** dependencies. 122 -1. Configure **Clinica.Run pipeline** in clinica_run_config.json. 123 -1. Run **biomarker extraction pipelines** for AI-based diagnostics. 203 +* **AI models** extract **clinically relevant patterns** from **EEG, MRI, and biomarkers**. 124 124 125 -** Reference:**[[Clinica.RunDocumentation>>url:https://github.com/Fundacion-de-Neurociencias/neurodiagnoses/blob/main/docs/clinica_run.md]]205 +**AI-Generated Annotations:** 126 126 207 +* **Automated tagging** of diagnostic features in **structured reports**. 208 +* **Explainability modules (SHAP, LIME)** ensure transparency in predictions. 209 + 210 +**Clinical Decision Support Integration:** 211 + 212 +* **AI-annotated findings** fed into **interactive dashboards**. 213 +* **Clinicians can adjust, validate, and modify annotations**. 214 + 127 127 ---- 128 128 129 -== ** Collaborative Development& Research** ==217 +=== **5. Validation & Real-World Testing** === 130 130 131 -** We UseGitHub to DevelopAI Models&Store Research Data**219 +==== **Prospective Clinical Study** ==== 132 132 133 -* ** GitHub Repository:** AImodeltrainingscripts.134 -* ** GitHub Issues:** Tracks ongoingresearchquestions.135 -* ** GitHubWiki:**Projectdocumentation& userguides.221 +* **Multi-center validation** of AI-based **annotations & risk stratifications**. 222 +* **Benchmarking against clinician-based diagnoses**. 223 +* **Real-world testing** of AI-powered **structured reporting**. 136 136 137 -** WeUse EBRAINS forData&Collaboration**225 +==== **Quality Assurance & Explainability** ==== 138 138 139 -* **EBRAINS Buckets:** Large-scale neuroimaging and biomarker storage. 140 -* **EBRAINS Jupyter Notebooks:** Cloud-based AI model execution. 141 -* **EBRAINS Wiki:** Research documentation and updates. 227 +* **Annotations linked to structured knowledge graphs** for improved transparency. 228 +* **Interactive annotation editor** allows clinicians to validate AI outputs. 142 142 143 - **Join the Project Forum:** [[GitHub Discussions>>url:https://github.com/Fundacion-de-Neurociencias/neurodiagnoses/discussions]]230 +---- 144 144 232 +=== **6. Collaborative Development** === 233 + 234 +The project is **open to contributions** from **researchers, clinicians, and developers**. 235 + 236 +**Key tools include:** 237 + 238 +* **Jupyter Notebooks**: For data analysis and pipeline development. 239 +** Example: **probabilistic imputation** 240 +* **Wiki Pages**: For documenting methods and results. 241 +* **Drive and Bucket**: For sharing code, data, and outputs. 242 +* **Collaboration with related projects**: 243 +** Example: **Beyond the hype: AI in dementia – from early risk detection to disease treatment** 244 + 145 145 ---- 146 146 147 -** ForAdditionalDocumentation:**247 +=== **7. Tools and Technologies** === 148 148 149 -* **GitHub Repository:** [[Neurodiagnoses AI Models>>url:https://github.com/Fundacion-de-Neurociencias/neurodiagnoses]] 150 -* **EBRAINS Wiki:** [[Neurodiagnoses Research Collaboration>>url:https://wiki.ebrains.eu/bin/view/Collabs/neurodiagnoses/]] 249 +==== **Programming Languages:** ==== 151 151 251 +* **Python** for AI and data processing. 252 + 253 +==== **Frameworks:** ==== 254 + 255 +* **TensorFlow** and **PyTorch** for machine learning. 256 +* **Flask** or **FastAPI** for backend services. 257 + 258 +==== **Visualization:** ==== 259 + 260 +* **Plotly** and **Matplotlib** for interactive and static visualizations. 261 + 262 +==== **EBRAINS Services:** ==== 263 + 264 +* **Collaboratory Lab** for running Notebooks. 265 +* **Buckets** for storing large datasets. 266 + 152 152 ---- 153 153 154 -**Neurodiagnoses is Open for Contributions – Join Us Today!** 269 +=== **Why This Matters** === 270 + 271 +* The annotation system ensures that AI-generated insights are structured, interpretable, and clinically meaningful. 272 +* It enables real-time tracking of disease progression across the three diagnostic axes. 273 +* It facilitates integration with electronic health records and decision-support tools, improving AI adoption in clinical workflows.