Troubleshooting

Version 33.1 by kindler on 2021/12/15 14:55

Jupyter notebook environment ("Lab") related

Error message "Error in Authenticator.pre_spawn_start: ... 401: Unauthorized"

When a new user accesses the Lab in a new collab for the first time, it is possible, that the JuypterLab is not starting and instead shows a "...401 Unauthorized" message.

To fix this error, please access the "Drive" link in the collab once (the "Drive" is also in the left hand navigation menu of the Collab). After the "Drive" has been accesses once the JupyterLab should start.

No example notebooks in the Jupyter notebook environment ("Lab")

When starting the Jupyter notebook environment for the first time it takes about a minute (without visible "in progress" indication) until the example files appear in the file-chooser. Until then the list is just empty. So the fix here is "have a minute patience"

NoFiles.png

Timeout when starting the Jupyter notebook environment ("Lab")

It is possible, that accessing the "Lab" link results in a "timeout" message. This can happen, when the lab environment is started for the first time on one of the virtual machines providing the service, as the very first start per machine takes quite some time (in the order of 2 minutes). Accessing the "Lab" link again after a few minutes usually works.

Lab error message "Cannot open - Could not find path..."

When first opening the Lab it is possible, that it can not open the path /shared/name-of-the-collab, even though in the drive the path is already accessible (see the two screenshots below from the Lab and the Drive). This is due to some delay in synchronisation between the file systems. Fix: Wait a few minutes and try again... (If that does not fix the problem, please contact support@ebrains.eu)

1623846216460-541.png

In the "Drive" the path is visible:

1623846323177-898.png

Test jobs make problems at Jülich

Since August 2021 accessing the "Lab" link in the left hand navigation menu brings up a new site selection menu:

Screenshot 2021-08-30 at 19.00.59.png

Via choosing a different lab execution site it is be possible to choose a specific site, if there are specific needs for the created Jupyter virtual machine for a given task (e.g. a large memory requirement). Currently all the examples do not need any site specific features, so you can select in principle any site. BUT (as of end of August 21) there is a sporadic problem with the NMPI communication, if running at Jülich. Thus for now, please use CSCS as the primary execution site.

BrainScaleS-2 specific

The BrainScaleS external user chat has service announcements (e.g. when a system is down due to maintenance) and is also a good place to ask general questions.

BrainScaleS-2 inhibitory synapse weights (October 2021)

21 October 2021: the pyNN version for BrainScaleS has been updated. Since then, inhibitory synapse weights need to negative numbers, otherwise the error message:    

    "pyNN.errors.ConnectionError: Weights must be negative for current-based, inhibitory synapses"

will be created (visibie in the .out file created by the job. In the notebook interface the error message can be, that the file needed for plotting is missing).

BrainScaleS-2: "Job error" in the Collaboratory (June 2021)

On 21 June 2021 we changed the platform selection in the nmpi command client.submit_job(...,platform=nmpi.BRAINSCALES,...). From then on, please specify nmpi.BRAINSCALES2 as the platform to run networks on the BrainScaleS-2 architecture (i.e. on "wafer">60).

In the JobManager, a job with the now wrong platform=nmpi.BRAINSCALES shown in the "log" part of the detailed job information:

72 is not a valid wafer module for BrainScaleS-1. Since 21 June 2021, please use "nmpi.BRAINSCALES2" as platform specification ...

Also since 21 June 2021 a separate quota setting is used for BrainScaleS-2 (visible on the Quota tab in the JobManager)

BrainScaleS-1 specific

The BrainScaleS external user chat has service announcements (e.g. when a system is down due to maintenance) and is also a good place to ask general questions.

PyMarocco.None needs to be changed to PyMarocco.Without (Nov 2021)

November 2021: marocco.backend = PyMarocco.None had to be changed to marocco.backend = PyMarocco.Without due to the move to Python3, which has None as a reserved keyword. See also this FAQ entry in the guidebook.

Symptom of the problem: In the .out file of the job execution, this error appears:

  File "run.py", line ...
    marocco.backend = PyMarocco.None
                                ^
SyntaxError: invalid syntax

There are also some additional Python3 related changes in the brainscales_system_chain_test.py example. Please find a working example script in our copy-template Drive (for copying into users collabs).