Changes for page Methodology

Last modified by manuelmenendez on 2025/03/14 08:31

From version 25.1
edited by manuelmenendez
on 2025/02/22 18:32
Change comment: There is no comment for this version
To version 4.2
edited by manuelmenendez
on 2025/01/29 19:10
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -1,121 +1,109 @@
1 -**Neurodiagnoses AI** is an open-source, AI-driven framework designed to enhance the diagnosis and prognosis of central nervous system (CNS) disorders. Building upon the Florey Dementia Index (FDI) methodology, it now encompasses a broader spectrum of neurological conditions. The system integrates multimodal data sources—including EEG, neuroimaging, biomarkers, and genetics—and employs machine learning models to deliver explainable, real-time diagnostic insights. A key feature of this framework is the incorporation of the **Generalized Neuro Biomarker Ontology Categorization (Neuromarker)**, which standardizes biomarker classification across all neurodegenerative diseases, facilitating cross-disease AI training.
1 +=== **Overview** ===
2 2  
3 -**Neuromarker: Generalized Biomarker Ontology**
3 +This section describes the step-by-step process used in the **Neurodiagnoses** project to develop a novel diagnostic framework for neurological diseases. The methodology integrates artificial intelligence (AI), biomedical ontologies, and computational neuroscience to create a structured, interpretable, and scalable diagnostic system.
4 4  
5 -Neuromarker extends the Common Alzheimer’s Disease Research Ontology (CADRO) into a comprehensive biomarker categorization framework applicable to all neurodegenerative diseases (NDDs). This ontology enables standardized classification, AI-based feature extraction, and seamless multimodal data integration.
5 +----
6 6  
7 -**Recommended Software**
7 +=== **1. Data Integration** ===
8 8  
9 -There is a suite of software that can help implement the workflow needed in Neurodiagnoses. Find a list of recommendations [[here>>https://github.com/Fundacion-de-Neurociencias/neurodiagnoses/blob/main/recommended_software]].
9 +==== **Data Sources** ====
10 10  
11 -**Core Biomarker Categories**
11 +* **Biomedical Ontologies**:
12 +** Human Phenotype Ontology (HPO) for phenotypic abnormalities.
13 +** Gene Ontology (GO) for molecular and cellular processes.
14 +* **Neuroimaging Datasets**:
15 +** Example: Alzheimer’s Disease Neuroimaging Initiative (ADNI), OpenNeuro.
16 +* **Clinical and Biomarker Data**:
17 +** Anonymized clinical reports, molecular biomarkers, and test results.
12 12  
13 -Within the Neurodiagnoses AI framework, biomarkers are categorized as follows:
14 14  
15 -|=**Category**|=**Description**
16 -|**Molecular Biomarkers**|Omics-based markers (genomic, transcriptomic, proteomic, metabolomic, lipidomic)
17 -|**Neuroimaging Biomarkers**|Structural (MRI, CT), Functional (fMRI, PET), Molecular Imaging (tau, amyloid, α-synuclein)
18 -|**Fluid Biomarkers**|CSF, plasma, blood-based markers for tau, amyloid, α-synuclein, TDP-43, GFAP, NfL, autoantiboides
19 -|**Neurophysiological Biomarkers**|EEG, MEG, evoked potentials (ERP), sleep-related markers
20 -|**Digital Biomarkers**|Gait analysis, cognitive/speech biomarkers, wearables data, EHR-based markers
21 -|**Clinical Phenotypic Markers**|Standardized clinical scores (MMSE, MoCA, CDR, UPDRS, ALSFRS, UHDRS)
22 -|**Genetic Biomarkers**|Risk alleles (APOE, LRRK2, MAPT, C9orf72, PRNP) and polygenic risk scores
23 -|**Environmental & Lifestyle Factors**|Toxins, infections, diet, microbiome, comorbidities
20 +==== **Data Preprocessing** ====
24 24  
25 -**Integrating External Databases into Neurodiagnoses**
22 +1. **Standardization**: Ensure all data sources are normalized to a common format.
23 +1. **Feature Selection**: Identify relevant features for diagnosis (e.g., biomarkers, imaging scores).
24 +1. **Data Cleaning**: Handle missing values and remove duplicates.
26 26  
27 -To enhance diagnostic precision, Neurodiagnoses AI incorporates data from multiple biomedical and neurological research databases. Researchers can integrate external datasets by following these steps:
26 +----
28 28  
29 -1. (((
30 -**Register for Access**
28 +=== **2. AI-Based Analysis** ===
31 31  
32 -* Each external database requires individual registration and access approval.
33 -* Ensure compliance with ethical approvals and data usage agreements before integrating datasets into Neurodiagnoses.
34 -* Some repositories may require a Data Usage Agreement (DUA) for sensitive medical data.
35 -)))
36 -1. (((
37 -**Download & Prepare Data**
30 +==== **Model Development** ====
38 38  
39 -* Download datasets while adhering to database usage policies.
40 -* (((
41 -Ensure files meet Neurodiagnoses format requirements:
32 +* **Embedding Models**: Use pre-trained models like BioBERT or BioLORD for text data.
33 +* **Classification Models**:
34 +** Algorithms: Random Forest, Support Vector Machines (SVM), or neural networks.
35 +** Purpose: Predict the likelihood of specific neurological conditions based on input data.
42 42  
43 -|=**Data Type**|=**Accepted Formats**
44 -|**Tabular Data**|.csv, .tsv
45 -|**Neuroimaging**|.nii, .dcm
46 -|**Genomic Data**|.fasta, .vcf
47 -|**Clinical Metadata**|.json, .xml
48 -)))
49 -* (((
50 -**Mandatory Fields for Integration**:
37 +==== **Dimensionality Reduction and Interpretability** ====
51 51  
52 -* Subject ID: Unique patient identifier
53 -* Diagnosis: Standardized disease classification
54 -* Biomarkers: CSF, plasma, or imaging biomarkers
55 -* Genetic Data: Whole-genome or exome sequencing
56 -* Neuroimaging Metadata: MRI/PET acquisition parameters
57 -)))
58 -)))
59 -1. (((
60 -**Upload Data to Neurodiagnoses**
39 +* Leverage [[DEIBO>>https://drive.ebrains.eu/f/8d7157708cde4b258db0/]] (Data-driven Embedding Interpretation Based on Ontologies) to connect model dimensions to ontology concepts.
40 +* Evaluate interpretability using metrics like the Area Under the Interpretability Curve (AUIC).
61 61  
62 -* (((
63 -**Option 1: Upload to EBRAINS Bucket**
42 +----
64 64  
65 -* Location: EBRAINS Neurodiagnoses Bucket
66 -* Ensure correct metadata tagging before submission.
67 -)))
68 -* (((
69 -**Option 2: Contribute via GitHub Repository**
44 +=== **3. Diagnostic Framework** ===
70 70  
71 -* Location: GitHub Data Repository
72 -* Create a new folder under /data/ and include a dataset description.
73 -* For large datasets, contact project administrators before uploading.
74 -)))
75 -)))
76 -1. (((
77 -**Integrate Data into AI Models**
46 +==== **Axes of Diagnosis** ====
78 78  
79 -* Open Jupyter Notebooks on EBRAINS to run preprocessing scripts.
80 -* Standardize neuroimaging and biomarker formats using harmonization tools.
81 -* Utilize machine learning models to handle missing data and feature extraction.
82 -* Train AI models with newly integrated patient cohorts.
48 +The framework organizes diagnostic data into three axes:
83 83  
84 -**Reference**: See docs/data_processing.md for detailed instructions.
85 -)))
50 +1. **Etiology**: Genetic and environmental risk factors.
51 +1. **Molecular Markers**: Biomarkers such as amyloid-beta, tau, and alpha-synuclein.
52 +1. **Neuroanatomical Correlations**: Results from neuroimaging (e.g., MRI, PET).
86 86  
87 -**AI-Driven Biomarker Categorization**
54 +==== **Recommendation System** ====
88 88  
89 -Neurodiagnoses employs advanced AI models for biomarker classification:
56 +* Suggests additional tests or biomarkers if gaps are detected in the data.
57 +* Prioritizes tests based on clinical impact and cost-effectiveness.
90 90  
91 -|=**Model Type**|=**Application**
92 -|**Graph Neural Networks (GNNs)**|Identify shared biomarker pathways across diseases
93 -|**Contrastive Learning**|Distinguish overlapping vs. unique biomarkers
94 -|**Multimodal Transformer Models**|Integrate imaging, omics, and clinical data
59 +----
95 95  
96 -**Collaboration & Partnerships**
61 +=== **4. Computational Workflow** ===
97 97  
98 -Neurodiagnoses actively seeks partnerships with data providers to:
63 +1. **Data Loading**: Import data from storage (Drive or Bucket).
64 +1. **Feature Engineering**: Generate derived features from the raw data.
65 +1. **Model Training**:
66 +1*. Split data into training, validation, and test sets.
67 +1*. Train models with cross-validation to ensure robustness.
68 +1. **Evaluation**:
69 +1*. Metrics: Accuracy, F1-Score, AUIC for interpretability.
70 +1*. Compare against baseline models and domain benchmarks.
99 99  
100 -* Enable API-based data integration for real-time processing.
101 -* Co-develop harmonized AI-ready datasets with standardized annotations.
102 -* Secure funding opportunities through joint grant applications.
72 +----
103 103  
104 -**Interested in Partnering?**
74 +=== **5. Validation** ===
105 105  
106 -If you represent a research consortium or database provider, reach out to explore data-sharing agreements.
76 +==== **Internal Validation** ====
107 107  
108 -**Contact**: [[info@neurodiagnoses.com>>mailto:info@neurodiagnoses.com]]
78 +* Test the system using simulated datasets and known clinical cases.
79 +* Fine-tune models based on validation results.
109 109  
110 -**Final Notes**
81 +==== **External Validation** ====
111 111  
112 -Neurodiagnoses AI is committed to advancing the integration of artificial intelligence in neurodiagnostic processes. By continuously expanding our data ecosystem and incorporating standardized biomarker classifications through the Neuromarker ontology, we aim to enhance cross-disease AI training and improve diagnostic accuracy across neurodegenerative disorders.
83 +* Collaborate with research institutions and hospitals to test the system in real-world settings.
84 +* Use anonymized patient data to ensure privacy compliance.
113 113  
114 -We encourage researchers and institutions to contribute new datasets and methodologies to further enrich this collaborative platform. Your participation is vital in driving innovation and fostering a deeper understanding of complex neurological conditions.
86 +----
115 115  
116 -**For additional technical documentation and collaboration opportunities:**
88 +=== **6. Collaborative Development** ===
117 117  
118 -* **GitHub Repository:** [[Neurodiagnoses GitHub>>url:https://github.com/neurodiagnoses]]
119 -* **EBRAINS Collaboration Page:** [[EBRAINS Neurodiagnoses>>url:https://ebrains.eu/collabs/neurodiagnoses]]
90 +The project is open to contributions from researchers, clinicians, and developers. Key tools include:
120 120  
121 -If you encounter any issues during data integration or have suggestions for improvement, please open a GitHub Issue or consult the EBRAINS Neurodiagnoses Forum. Together, we can advance the field of neurodiagnostics and contribute to better patient outcomes.
92 +* **Jupyter Notebooks**: For data analysis and pipeline development.
93 +** Example: [[probabilistic imputation>>https://drive.ebrains.eu/f/4f69ab52f7734ef48217/]]
94 +* **Wiki Pages**: For documenting methods and results.
95 +* **Drive and Bucket**: For sharing code, data, and outputs.
96 +* **Related projects: **For instance: [[//Beyond the hype: AI in dementia – from early risk detection to disease treatment//>>https://www.lethe-project.eu/beyond-the-hype-ai-in-dementia-from-early-risk-detection-to-disease-treatment/]]
97 +
98 +----
99 +
100 +=== **7. Tools and Technologies** ===
101 +
102 +* **Programming Languages**: Python for AI and data processing.
103 +* **Frameworks**:
104 +** TensorFlow and PyTorch for machine learning.
105 +** Flask or FastAPI for backend services.
106 +* **Visualization**: Plotly and Matplotlib for interactive and static visualizations.
107 +* **EBRAINS Services**:
108 +** Collaboratory Lab for running Notebooks.
109 +** Buckets for storing large datasets.
workflow neurodiagnoses.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.manuelmenendez
Size
... ... @@ -1,1 +1,0 @@
1 -157.5 KB
Content