Wiki source code of test-ir2

Version 48.1 by ingrreit on 2023/04/25 15:09

Hide last authors
ingrreit 47.2 1 == Publishing neuroscience data, models and software via EBRAINS ==
ingrreit 10.1 2
ingrreit 25.2 3 The aim of this collab is to provide you with all the information you need to publish your experimental data, simulations, computational models, and software via EBRAINS. Have you already published your data somewhere else? You can increase the exposure and impact of your shared dataset by also listing it on EBRAINS.
4
ingrreit 10.1 5 {{box title="**Contents**"}}
6 {{toc depth="3" start="2"/}}
7 {{/box}}
8
9
10 (% style="text-align: center;" %)
11 **Get started! **
12
13 (% style="text-align: center;" %)
14 **[[REQUEST CURATION>>https://nettskjema.no/a/277393#/]] **
15
16 (% style="text-align: center;" %)
ingrreit 26.1 17 Search existing data, models and software in [[the EBRAINS Knowledge Graph Search>>https://kg.ebrains.eu/search/?facet_type[0]=Dataset]]
ingrreit 10.1 18
19
20 ----
21
ingrreit 30.1 22 == **The EBRAINS curation process** ==
ingrreit 10.1 23
ingrreit 29.1 24 In EBRAINS, multimodal and heterogenous neuroscience data, models and software are categorised and described in a standardised manner so that they can be effectively searched, compared, and analysed. This effort is referred to as curation. 
ingrreit 10.1 25
ingrreit 30.1 26 >The EBRAINS curation process involves organising and annotating neuroscientific data to make the data discoverable and reusable.
ingrreit 10.1 27
ingrreit 30.1 28 Behind this process is the EBRAINS Curation team. Our mandate is to support you in sharing your data in line with the [[**FAIR principles**>>https://www.go-fair.org/fair-principles/]], whether you choose to describe only the key aspects of your data, or can invest in adding more detailed metadata.
ingrreit 10.1 29
ingrreit 47.2 30 (% style="text-align: center;" %)
31 (% style="color:#e74c3c" %)[PLACEHOLDER: ABOUT THE CURATION TEAM]
ingrreit 34.1 32
ingrreit 47.2 33
ingrreit 47.3 34 (% class="box successmessage" %)
35 (((
36 **Particular needs? Contact us! **The process of sharing data can be modified to fit the needs of researchers and large-scale projects. Contact us if you have such requests and we'll be happy to work with you to find a solution that suits us both.
37 )))
38
ingrreit 30.1 39 (% class="box floatinginfobox" %)
40 (((
ingrreit 35.1 41 **We strongly recommend to start preparing for data sharing as early as possible.** With a structured data repository and adequate notes on how the data was acquired, you greatly minimize the effort required to publish your data. The time it takes to share data on EBRAINS heavily depends on on the engagement from the researcher and how well the data and metadata is prepared before-hand. **[[Contact us for personalised guidance on how to prepare for sharing>>mailto:curation-support@ebrains.eu]]. **
ingrreit 30.1 42 )))
ingrreit 10.1 43
44
ingrreit 30.1 45
ingrreit 34.1 46
47
48
49
50 ----
51
ingrreit 10.1 52 === Step by step - Experimental data ===
53
54
ingrreit 23.2 55 [[image:image-20230326054341-1.png]]
ingrreit 10.1 56
ingrreit 36.1 57 ==== ====
58
ingrreit 10.1 59 ==== **1. Provide some general information about your dataset** ====
60
61 The [[Curation request form>>https://nettskjema.no/a/277393#/]] collects preliminary information about your data, allowing us to assess whether the dataset fits within the scope of EBRAINS. The submission generates a curation ID allowing us to track the case.
62
63 The [[Ethics and Regulatory compliance form>>https://nettskjema.no/a/224765]] collects the necessary information needed for us to evaluate whether we can safely and legally share the data on the EBRAINS platforms.
64
65
66 ==== **2. Upload data ** ====
67
68 EBRAINS offers secure, long-term storage at [[CSCS Swiss National Supercomputing Centre>>url:https://www.cscs.ch/]], with currently no upper limit of storage capacity. The data must be consistently structured prior to upload. 
69
ingrreit 35.1 70 For smaller datasets with a reasonable amount of files, we recommend using the Collab-Bucket solution (drag-and-drop). A Collab Bucket must first be assigned to a dataset, which happens when a datasets is accepted for sharing.
ingrreit 10.1 71
ingrreit 35.1 72 For larger datasets or datasets with a large amount of files, we recommend using a programmatic approach. The [[python script>>https://github.com/eapapp/ebrains-data-storage/tree/main/data-proxy]] is interactive and does not require any additional programming.
ingrreit 10.1 73
74
75 If a data collection is already uploaded elsewhere, we may link to the already existing repository.
76
77
78 ==== **3. Submit metadata** ====
79
80 Easily submit openMINDS-compatible metadata via our [[metadata wizard>>https://ebrains-metadata-wizard.apps.hbp.eu/]]. This form covers all the required metadata for sharing data via EBRAINS. When you're ready to 'Submit', the metadata and all uploaded files will be sent to the Curation team.
81
82 For power-users interested in exploring the full span of the openMINDS framework, please check out the [[openMINDS GitHub>>https://github.com/HumanBrainProject/openMINDS]] to learn more about how to programmatically gather your metadata. A stable version of the openMINDS package can be found on [[PyPi>>https://pypi.org/project/openMINDS/]]. We accept openMINDS metadata as JSON-LD (share these with us via curation-support@ebrains.eu). Additional documentation of openMINDS metadata submodules and schemas can be found on [[the openMINDS GitHub Wiki>>https://humanbrainproject.github.io/openMINDS/]].
83
84
85 ==== **4. Write a Data Descriptor ** ====
86
87 The Data Descriptor is a document helping others interpret and reuse (and prevent misuse) of your data, and is critical to achieve a basic level of FAIR. The document will be uploaded in the repository of the data, shared as a PDF. 
88
89 [[The template >>https://drive.ebrains.eu/f/a2e07c95b1a54090bbbc/?dl=1]]safely guides you through the process of making one. Check out previous examples in the KG Search, e.g. the Data Descriptor for a dataset containing histology images of the rat brain stained for an anterograde tracer (see [[an example>>https://doi.org/10.25493/2MX9-3XF]]).
90
91
92 Journal publications sufficiently describing the shared data, such as made available through [[Nature Scientific Data>>http://www.nature.com/sdata/about]], [[Elsevier Data in Brief>>http://www.journals.elsevier.com/data-in-brief/]], [[BMC Data note>>https://bmcresnotes.biomedcentral.com/submission-guidelines/preparing-your-manuscript/data-note]] and more, can replace the EBRAINS Data Descriptor.
93
94
95 ==== **5. Preview and publish ** ====
96
97 A Curator will assemble a dataset in the EBRAINS Knowledge Graph that combines the data, metadata and data descriptor. Once ready, the data provider will receive a private URL for previewing the dataset prior to release. We need an official approval from the data custodian{{footnote}}The Data Custodian is responsible for the content and quality of the Data and metadata, and is the person to be contacted by EBRAINS CS in case of any misconduct related to the Data. It is the obligation of a Data Custodian to keep EBRAINS informed about changes in the contact information of the authors of the Datasets provided by them ([[EBRAINS Data Provision Protocol - version 1.1>>https://strapi-prod.sos-ch-dk-2.exo.io/EBRAINS_Data_Provision_Protocol_dfe0dcb104.pdf]]).{{/footnote}} to release the dataset. Once released, a [[DataCite DOI>>https://datacite.org/]] will be generated for the dataset. If the identical data collection has received a DOI elsewhere, we recommend re-using the already issued DOI.
98
99
100 ----
101
102 ==== **Sharing human data ** ====
103
104 We must ensure data shared on EBRAINS comply with [[GDPR >>https://gdpr-info.eu/]]and [[EU directives>>https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=celex%3A32010L0063]]. The information we need to assess this is collected via our [[Ethics and Regulatory Compliance Survey>>https://nettskjema.no/a/224765]].
105
106 (% class="box floatinginfobox" %)
ingrreit 1.1 107 (((
ingrreit 10.1 108 For **Human subject data**, the data must be //either//
ingrreit 1.1 109
ingrreit 10.1 110 - Post-mortem data
111
112 - Aggregated data
113
114 - Pseudonymized subject data with a legal basis for sharing (e.g. Informed Consent)
115
116 (% class="small" %)//If you have human data that do not classify as any of the above, please get in touch and we will clarify the available options. //
ingrreit 1.1 117 )))
118
ingrreit 10.1 119 Pseudonymized data is shared via the Human Data Gateway (HDG) due to GDPR regulations. The HDG adds an authentication layer to the data.
ingrreit 1.1 120
ingrreit 10.1 121 **Data users** must request access to the data (via their EBRAINS account) and will receive access provided they actively accept the [[EBRAINS Access Policy>>https://ebrains.eu/terms#access-policy]], the [[EBRAINS General Terms of Use>>https://ebrains.eu/terms#general-terms-of-use]], and the [[EBRAINS Data Use Agreement>>https://ebrains.eu/terms#data-use-agreement]]. The account holder also have to accept that information about their request and access to specific data under HDG is being tracked and stored.
122 \\**Data owners** must be aware that sharing under the HDG affects the legal responsibilities for the data. They must agree to joint control of the data (see the [[Data Provision Protocol v1>>url:https://strapi-prod.sos-ch-dk-2.exo.io/EBRAINS_Data_Provision_Protocol_dfe0dcb104.pdf]], section 1.4 - 1.5) and the Data Protection Officers of the responsible institutions must have accepted that the data can be shared under HDG.
ingrreit 35.1 123 \\The Human Data Gateway (HDG) was introduced in February 2021 and developed across multiple teams in the HBP. The initiative to create the service and the initial design originated from EBRAINS Curation in close collaboration with the Data compliance team and the HBP Data Governance Working Group. HDG is a response to the needs of multiple data providers who are bringing data of human origin to EBRAINS. HDG covers the sharing of a limited range of data of human origin, i.e., data without direct identifiers and with very few indirect identifiers (strongly pseudonymized, de-identified). It is an extension of the existing services and does not replace the future EBRAINS Service for sensitive data (planned for 2024) which is outside the domain of the current EBRAINS Data and Knowledge services.
ingrreit 1.1 124
125
ingrreit 10.1 126 ----
127
128 === Step by Step - Models ===
129
130 [place-holder-process-diagram]
131
132 ==== **1. model step 1 ** ====
133
134 Text
135
136
137 ==== **2. model step 2** ====
138
139 Text
140
141
142 ----
143
144 === Step by Step - Code ===
145
146 [place-holder-process-diagram]
147
148 ==== **1. code step 1 ** ====
149
150 Text
151
152
153 ==== **2. code step 2** ====
154
155 Text
156
157 ----
158
ingrreit 27.2 159 === Output / result, when you've completed the curation process, what do you get ===
160
161 Curated data, models and software are made available in the [[the EBRAINS Knowledge Graph>>https://kg.ebrains.eu/]]. This makes the data and metadata discoverable in the [[Knowledge Graph Search>>url:https://search.kg.ebrains.eu/]] and programmatically via the [[Knowledge Graph API>>url:https://docs.kg.ebrains.eu/8387ccd27a186dea3dd0b949dc528842/api_endpoints.html]]. The data, models and software are integrated in the EBRAINS Knowledge Graph by interoperable metadata schemas as defined in [[openMINDS>>url:https://github.com/HumanBrainProject/openMINDS/wiki]].
162
163 Data and models are linked to and discoverable via the species-specific [[EBRAINS Interactive Atlas Viewer>>url:https://ebrains.eu/services/atlases/brain-atlases]] by using interoperable metadata schemas as defined in [[SANDS>>url:https://github.com/HumanBrainProject/SANDS/wiki]].
164
165 ----
166
ingrreit 37.1 167 == **Information and resources for researchers looking to share data** ==
ingrreit 10.1 168
169 Below you can find some resources that can come in handy if you are looking to share data via EBRAINS, or in general.
170
171 ----
172
ingrreit 37.1 173 === **The benefits of sharing data ** ===
ingrreit 27.1 174
ingrreit 44.1 175 (% style="color:#000000" %)Sharing your data, models or code (research products) via EBRAINS makes it discoverable amongst other research products available in the (%%)[[(% style="color:#000000" %)EBRAINS Knowledge Graph>>https://kg.ebrains.eu/]](%%). This is made possible by the highly flexible metadata framework describing neuroscience data in detail.
ingrreit 33.1 176
ingrreit 43.1 177 (% style="color:#000000" %)EBRAINS is gradually implementing interconnected tools and analysis workflows developed in the Human Brain Project (HBP) to further enhance the output from adding your dataset to the database.
ingrreit 33.1 178
179
ingrreit 27.1 180 By sharing your data via EBRAINS, you gain access to the following benefits:
181
182 [[image:image-20230324170841-3.png]]
183
184
185
ingrreit 30.1 186 We support you to better follow the FAIR^^ ^^guiding principles for data management and stewardship{{footnote}}Wilkinson, M., Dumontier, M., Aalbersberg, I. et al. The FAIR Guiding Principles for scientific data management and stewardship. Sci Data 3, 160018 (2016). https://doi.org/10.1038/sdata.2016.18 {{/footnote}}.  Publishing data, models or code via EBRAINS will provide you with a citeable [[DataCite DOI>>https://www.doi.org/the-identifier/resources/handbook/]] for your research product.
ingrreit 27.1 187
ingrreit 30.1 188
ingrreit 27.1 189 ----
190
191 (% style="font-family:inherit" %) (% style="color:#1a202c; font-family:inherit; font-size:26px" %)**What can I share on EBRAINS? **
192
193 (% class="wikigeneratedid" id="H" %)
194 [[image:image-20230324170829-2.png]]
195
196
197 ----
198
ingrreit 40.1 199 === **At a glance: "Sharing experimental data on EBRAINS" ** ===
ingrreit 10.1 200
201
ingrreit 46.1 202 |(% style="width:439px" %)(((
ingrreit 47.1 203 [[[[image:image-20230324171114-2.png||height="354" width="250"]]>>https://drive.ebrains.eu/f/dfd374b9b43a458192e9/]]
ingrreit 46.1 204 )))|(% style="width:461px" %)(((
ingrreit 47.1 205 [[[[image:image-20230324171109-1.png||height="352" width="250"]]>>https://drive.ebrains.eu/f/c1ccb78be52e4bdba7cf/]]
206 )))|(% style="width:416px" %)[[[[image:image-20230330120354-1.png||height="352" width="250"]]>>https://drive.ebrains.eu/f/707147a883b94fae8e69/]]
ingrreit 46.1 207 |(% style="width:439px" %)//Collection of useful information for researchers looking to share experimental data on EBRAINS.//|(% style="width:461px" %)//The EBRAINS data descriptor: a general overview //|(% style="width:416px" %)//Introduction to data organization: A [[collection of guidelines>>https://drive.ebrains.eu/smart-link/25299f04-c4e5-4028-8f5f-3b8208f9a532/]] on how to organise files and folders to ensure consistency and reproducibility in the future. //
ingrreit 1.1 208
ingrreit 10.1 209 ----
210
211 === **Integrate your data in the EBRAINS atlas services** ===
212
213 EBRAINS supports viewers for a variety of data, and is continuously looking to improve the services for visualising data. For 2D histology image data that is registered to an EBRAINS supported brain atlas, the data and the overlying atlas plates can be uploaded to the LocaliZoom viewer. See for example the [[LocaliZoom links available for this dataset>>https://doi.org/10.25493/T686-7BX]] as an example.
214
215 To learn more about how to integrate your data to atlases, check out the [[Atlas services>>https://ebrains.eu/services/atlases#Integratedatatoanatlas]] on ebrains.eu.
216
217 ----
218
219 === **Common concerns - and answers ** ===
220
ingrreit 1.1 221 (((
ingrreit 10.1 222 ==== ====
ingrreit 1.1 223
ingrreit 23.2 224 (((
ingrreit 20.1 225 >The curation process is time consuming and difficult
ingrreit 1.1 226 )))
ingrreit 19.1 227 )))
ingrreit 10.1 228
229 (% class="wikigeneratedid" id="HHowcanIshareA0models3F" %)
230 Publishing your data naturally takes some time and effort but we will support you as much as possible. If communication is on a regular basis, we are able to finish basic curation - from the initial contact to dataset release - within two weeks.
231
232 >Sharing my data is not beneficial for me - only for others
233
234
235 When you publish your data via EBRAINS, we provide comprehensive data management support and safe long term storage - all free of charge. Additionally, your data can be cited, just like a scientific journal article. Sharing your data may even lead to new funding opportunities. Many funders specifically support projects that are part of the “Open Science” initiative.
236
237 >My data is too insignificant to share
238
239
240 There is no such thing as insignificant data. Data that is considered insignificant for a given topic, may have great significance for another. By making “insignificant” data publicly available, other researchers may find something interesting that was off-topic for your own purposes.
241
242 >My data can easily be misused if I share it with the world
243
244
245 Your data will be covered by a Creative Commons license of your choice. There are a variety of licenses available, enabling you to prevent use for specific purposes, e.g. commercial use.
246
247 >I don't think I'm allowed to share my data
248
249
250 Many institutions are still very careful about what can be shared and how, but the situation is constantly evolving. As a researcher providing data, you will be asked to fill out an ethics compliance survey which survey to ensure that data published through the EBRAINS platform has been collected according to EU regulations. We are working on solutions for sharing anonymised human data that complies with GDPR standards to protect the identity of research subjects.
251
252 >I can't share my data before my paper is published
253
254
255 If you do not want to share your data before publishing the results in an article, you can publish your dataset with an embargo status. This will make it possible to find information about the data without making the data itself available, and give you a citeable DOI.
256
257 >If I share my data before I publish the associated paper, I will lose my competitive edge
258
259
260 Publishing your data does not mean that others can use it however they want. Use of your data will require citation, and by choosing an appropriate Creative Commons licence you decide what others are allowed to do with it. If you still feel worried, you can publish your data under embargo, and in this way delay the date of data release, but still make it possible for others to find the information about the data.
261
262
263 ----
264
265 == Contact ==
266
267 [[curation-support@ebrains.eu>>mailto:curation-support@ebrains.eu]]
268
269
270 {{putFootnotes/}}