Summary

• Page properties (1 modified, 0 added, 0 removed)

Details

Page properties

Content

...	...	@@ -1,16 +1,52 @@
	1	+=== **Issue on the OpenShift server at CSCS (2021-12-28)** ===
	2	+
	3	+The EBRAINS OpenShift server running at CSCS was detected as having come down. This issue affects all the services running on that OpenShift server including:
	4	+
	5	+* Collaboratory Lab,
	6	+* image service,
	7	+* atlas viewers,
	8	+* simulation services (NEST desktop, TVB, Brain Simulation Platform)
	9	+
	10	+We are working with the CSCS team to reactivate the service ASAP.
	11	+
	12	+The service was reestablished at around 14:15 CET. The infrastructure team will continue looking into the potential causes of the problem with RedHat. The suspected cause lies in network access to the storage.
	13	+
	14	+=== **Issue on the Forum service (2021-12-27)** ===
	15	+
	16	+The Forum service went down over the weekend along with one of the redundant OpenShift servers. The issue was due to a problem at the infrastructure level.
	17	+
	18	+The Forum was unavailable for a few hours on Monday. There was not perceptible effect on the services running on OpenShift.
	19	+
	20	+=== **Issue on the OpenShift server at CSCS (2021-11-24)** ===
	21	+
	22	+The EBRAINS OpenShift server running at CSCS was detected as having come down at 16:00 CEST. This issue affects all the services running on that OpenShift server including:
	23	+
	24	+* Collaboratory Lab,
	25	+* image service,
	26	+* atlas viewers,
	27	+* simulation services (NEST desktop, TVB, Brain Simulation Platform)
	28	+
	29	+We are working with the CSCS team and RedHat (provider of the OpenStack solution on which OpenShift runs) to reactivate the service ASAP.
	30	+
	31	+The issue affected the central VM node of the OpenShift service. Restarting the VM required that we resolve multiple issues including restarting at the same IP address and unlocking the storage volumes of that VM. (% style="color:#16a085" %)The central node has now been restarted. The same issue has occurred on three other instances of OpenShift VMs. They have been restarted too. OpenShift is up and running again. The DNS redirection(s) to the maintenance page is being removed. The services should be operational again.
	32	+
	33	+(% style="color:#16a085" %)The root cause seems to be at the infrastructure level and RedHat is involved in analyzing that.
	34	+
	35	+We will keep updating this page with more information as it comes in.
	36	+
1	1	=== **Maintenance of multiple services (2021-11-11 to 2021-11-19)** ===
2	2
3		-We are migrating the last of our services away from an old cloud infrastructure. The services were taken down on Wednesday November 17.
	39	+We are migrating the last of our services away from an old cloud infrastructure. The production services were taken down on Wednesday November 17 and are now all back online. We will continue working on the non-production services, to return the services to the redundancy level prior to the migration, and various final tweaks.
4	4
5		-We are facing issues restarting some services on the new cloud infrastructure. There is no data loss. The issues seem to be linked to network problems. We are actively trying to resolve them in collaboration with the infrastructure provider in order to restart the services as promptly as possible.
	41	+Please contact [[support>>https://ebrains.eu/support]] about any new issues you identify on our services.
6	6
7	7	The services which were migrated during this maintenance include:
8	8
9	9	* Collaboratory Bucket (% style="color:#2ecc71" %)**DONE**
10	10	* Knowledge Graph Search and API (% style="color:#2ecc71" %)**DONE**
11		-* OpenShift servers which includes: (% style="color:#e74c3c" %)**ONGOING...**
12		-** Collaboratory Lab,
13		-** image service,
	47	+* OpenShift servers which includes: (% style="color:#2ecc71" %)**DONE**
	48	+** Collaboratory Lab, (% style="color:#2ecc71" %)**DONE**
	49	+** image service, (% style="color:#2ecc71" %)**DONE**
14	14	** atlas viewers,
15	15	** simulation services (NEST desktop, TVB, Brain Simulation Platform)
16	16
...	...	@@ -18,7 +18,7 @@
18	18	* the Forum linked from the Collaboratory Wiki, (% style="color:#2ecc71" %)**DONE** (may have login issues)
19	19	* the Education website. (% style="color:#2ecc71" %)**DONE**
20	20
21		-We apologize for the inconvenience. We strive to make the interruption of service as short as possible.
	57	+We apologize for the inconvenience and thank you for your understanding.
22	22
23	23	=== **Technical difficulties on the Drive (2021-11-03)** ===
24	24