Last modified by alexisdurieux on 2022/03/25 08:38
From version 23.1
edited by alexisdurieux
on 2021/04/16 21:32
Change comment: There is no comment for this version
To version 18.1
edited by alexisdurieux
on 2021/04/12 15:26
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -5,7 +5,7 @@
5 5  (% style="text-align: justify;" %)
6 6  = Data Proxy =
7 7  
8 -The data proxy allows you to access object storage (Swift) on the Fenix infrastructure as an authenticated EBRAINS user without a Fenix user account.
8 +The data-proxy allows you to access CSCS Object Swift storage as an authenticated ebrains user without requiring a Fenix account.
9 9  )))
10 10  )))
11 11  
... ... @@ -13,35 +13,32 @@
13 13  (((
14 14  (((
15 15  (% style="text-align: justify;" %)
16 -The data proxy core is the application that acts as a proxy to the object storage (Swift).
16 +The data proxy core is the application that acts as a proxy to the CSCS Swift storage.
17 17  
18 18  (% style="text-align: justify;" %)
19 19  === Object Storage ===
20 20  
21 -The documentation of Swift object storage can be found here:
22 22  
23 -[[https:~~/~~/docs.openstack.org/swift/pike/admin/objectstorage-intro.html>>https://docs.openstack.org/swift/pike/admin/objectstorage-intro.html]]
22 +The documentation on the swift object storage can be found here: [[https:~~/~~/docs.openstack.org/swift/pike/admin/objectstorage-intro.html>>https://docs.openstack.org/swift/pike/admin/objectstorage-intro.html]]
24 24  
24 +
25 25  (% style="text-align: justify;" %)
26 26  === Authentication ===
27 27  
28 28  (% style="text-align: justify;" %)
29 -The Data Proxy authenticates its users with the EBRAINS (Collaboratory) IAM service.
29 +The application itself is connected to the CSCS storage. The user is authenticated against the data-proxy application using authorization headers. The user is then authenticated against the EBRAINS platform. That means the user only needs to have an EBRAINS account to access the data proxy and the Swift storage capabilities
30 30  
31 31  (% style="text-align: justify;" %)
32 -Prior to the availability of the Data Proxy, EBRAINS users had to request a Fenix user account in order to access object storage capabilities on the Fenix infrastructure. With the Data Proxy, a user only needs to have an EBRAINS account to access the data stored on the same Fenix object storage. Data stored in this way is held in the name of the data proxy service account on Fenix, and the Data Proxy tracks who has access to which data.
32 +=== Bucket system ===
33 33  
34 34  (% style="text-align: justify;" %)
35 -=== Permissions ===
35 +We use the Collaboratory authorization system for the buckets.
36 36  
37 37  (% style="text-align: justify;" %)
38 -We use the Collaboratory authorization system to manage permissions in the Data Proxy.
38 +For every collab, it is possible to access a Swift container as a user. The action the user can perform on the buckets depend on the rights the user has in the collab
39 39  
40 -(% style="text-align: justify;" %)
41 -A Swift object container can be associated to each collab. Object containers are also known as "buckets"  to avoid confusion with other containers (e.g. Docker containers). An EBRAINS user can perform the following actions on a bucket depending on the user's permissions (as defined by the collab's Team) in the collab associated with the bucket.
42 -
43 43  (% border="3" %)
44 -|=(% style="text-align: justify;" %)Team permissions of a collab|=(% style="text-align: justify;" %)Available actions on that collab's bucket
41 +|=(% style="text-align: justify;" %)Collab Right|=(% style="text-align: justify;" %)Available actions on bucket
45 45  |(% style="text-align:justify" %)Viewer|(% style="text-align:justify" %)Read
46 46  |(% style="text-align:justify" %)Editor|(% style="text-align:justify" %)Create, Read, Update, Delete
47 47  |(% style="text-align:justify" %)Admin|(% style="text-align:justify" %)Create, Read, Update, Delete
... ... @@ -48,18 +48,10 @@
48 48  |(% style="text-align:justify" %)Not a collab member|(% style="text-align:justify" %)No actions
49 49  
50 50  (% class="wikigeneratedid" %)
51 -You can access the buckets in the "Bucket" navigation element in every collab.
48 +You can access the buckets in the "Buckets" menu in every collab
52 52  
53 -=== Collaboratory bucket vs drive ===
50 +=== ===
54 54  
55 -A collab offers 2 main locations to store files: a drive and a bucket. The drive offers more advanced features like recognition of file formats (Office, Markdown, PDF) with applications specific to each, simplified version control, smart links. The bucket on the other hand offers larger storage capacity and better bandwidth. The bucket is recommended for datasets (brain scans, EEG, derived data) and videos (including for streaming).
56 -
57 -=== API ===
58 -
59 -The API is self-documented using Swagger UI. You can access it here: [[https:~~/~~/data-proxy.ebrains.eu/api/docs>>https://data-proxy.ebrains.eu/api/docs]] or in the [[API Documentation>>doc:API Documentation]] wiki page of this collab.
60 -
61 -==== buckets vs tempurl ====
62 -
63 -The buckets endpoint gives you a direct access to swift storage through the data-proxy. However, it means that the performances are limited by the performances of the data-proxy. This means that you should use the tempurl endpoint in **priority.**
52 +The API is self-documentated using Swagger UI. You can access it here: [[https:~~/~~/data-proxy.ebrains.eu/api/docs>>https://data-proxy.ebrains.eu/api/docs]] or in the "API Documentation".
64 64  )))
65 65  )))
Screenshot_2021-01-06 FastAPI - Swagger UI.png
Author
... ... @@ -1,0 +1,1 @@
1 +XWiki.alexisdurieux
Size
... ... @@ -1,0 +1,1 @@
1 +38.4 KB
Content
XWiki.XWikiRights[5]
Allow/Deny
... ... @@ -1,1 +1,0 @@
1 -Allow
Levels
... ... @@ -1,1 +1,0 @@
1 -view
Users
... ... @@ -1,1 +1,0 @@
1 -XWiki.XWikiGuest
XWiki.XWikiRights[6]
Allow/Deny
... ... @@ -1,1 +1,0 @@
1 -Allow
Groups
... ... @@ -1,1 +1,0 @@
1 -XWiki.XWikiAllGroup
Levels
... ... @@ -1,1 +1,0 @@
1 -view
XWiki.XWikiRights[3]
Allow/Deny
... ... @@ -1,0 +1,1 @@
1 +Allow
Levels
... ... @@ -1,0 +1,1 @@
1 +view
Users
... ... @@ -1,0 +1,1 @@
1 +XWiki.XWikiGuest
XWiki.XWikiRights[4]
Allow/Deny
... ... @@ -1,0 +1,1 @@
1 +Allow
Groups
... ... @@ -1,0 +1,1 @@
1 +XWiki.XWikiAllGroup
Levels
... ... @@ -1,0 +1,1 @@
1 +view