Changes for page Using JupyterHub in HDC

Last modified by Dennis Segebarth on 2024/10/02 18:14
From version 7.1
edited by Dennis Segebarth
on 2024/08/16 08:53
Change comment: There is no comment for this version
To version 1.7
edited by Susan Evans
on 2023/07/11 14:05
Change comment: (Autosaved)

Summary

Details

Page properties
Author
... ... @@ -1,1 +1,1 @@
1 -XWiki.dsegebarth
1 +XWiki.sgevans
Content
... ... @@ -1,13 +6,5 @@
1 -{{box cssClass="floatinginfobox" title="Table of Contents"}}
2 -{{toc depth="2"/}}
3 -{{/box}}
4 -
5 -
6 6  JupyterHub is an open-source, multi-user version of Jupyter Notebook for performing analysis of Project files in the Core. More information can be found in the application documentation [[https:~~/~~/jupyter.org/>>https://jupyter.org/]].
7 7  
8 -[[image:1723798240534-407.png||height="189" width="291"]]
9 -
10 -
11 11  = How it Works =
12 12  
13 13  JupyterHub allows Project members to create or import Jupyter Notebooks into the Project Workspace environment, retrieve Project files from the Core, perform computational workflows on the data, and write the outputs back to the Core where they can be accessed by other Project members. JupyterHub spins up a new JupyterLab instance for each Project member.
... ... @@ -27,7 +27,7 @@
27 27  
28 28  = Launching JupyterHub =
29 29  
30 -[[image:1723798257792-201.png||height="121" width="349"]]
22 +[[image:HDC Project Workspace tool navigation Jupyterhub v1.0.0 2023-05-25.png||height="10%" width="30%"]]
31 31  
32 32  1. Launch your Project and click the **JupyterHub icon** in the left menu bar.
33 33  1. Click **Sign in with Keycloak** to initiate your session. JupyterHub automatically authenticates with your existing username and password and launches your session - no additional sign-in is required.
... ... @@ -42,7 +42,7 @@
42 42  1. In the Launcher, click the **Python 3 Notebook **icon, or click **File > New > Notebook**.
43 43  1. Create your Notebook.
44 44  
45 -[[image:1723798278604-114.png||height="376" width="865"]]
37 +[[image:Project Workspace Jupyter Create Python Notebook v2.1.6 2023-02-07.png||height="22%" width="50%"]]
46 46  
47 47  = Launching the Terminal =
48 48  
... ... @@ -51,7 +51,7 @@
51 51  1. In the Launcher, click the **Terminal **icon, or click **File > New > Terminal**.
52 52  1. The terminal window opens.
53 53  
54 -[[image:1723798293872-992.png||height="162" width="863"]]
46 +[[image:Project Workspace Jupyter Launch Terminal v2.1.6 2023-02-07.png||height="9%" width="50%"]]
55 55  
56 56  Ubuntu is used to host Jupyter Notebook. Use the command cat /etc/os-release to determine to current version of Ubuntu:
57 57  
... ... @@ -188,12 +188,12 @@
188 188  
189 189  Afterwards, the environment will be listed when you open the Launcher to open a new Jupyter Notebook:
190 190  
191 -[[image:1723798325144-485.png||height="436" width="867"]]
183 +[[image:Project Workspace Jupyter view new Kernel 2023-07-11.png||height="25%" width="50%"]]
192 192  
193 193  
194 194  and also from each opened Notebook, e.g., via **Kernel > Change Kernel…** :
195 195  
196 -[[image:1723798338447-469.png||height="317" width="247"]]
188 +[[image:Project Workspace Jupyter Kernel change Kernel dropdown 2023-07-11.png||height="64%" width="50%"]]
197 197  
198 198  = Installing New Python Packages =
199 199  
... ... @@ -283,9 +283,9 @@
283 283  * Open the login window and enter your HDC username and password (i.e. your EBRAINS account credentials).
284 284  * Grant access by clicking **Yes**.
285 285  
286 -[[image:1723798355215-434.png||height="352" width="379"]]
278 +[[image:Pilotcli Jupyter user login Grant Access window v2.4.0 2023-05-25.png||height="46%" width="50%"]]
287 287  
288 -[[image:1723798365454-527.png||height="123" width="376"]]
280 +[[image:Pilotcli Jupyter user login Device Login Successful v2.4.0 2023-05-25.png||height="16%" width="50%"]]
289 289  
290 290  * After successful confirmation, return to the terminal in your JupyterHub browser tab.
291 291  
... ... @@ -368,7 +368,7 @@
368 368  
369 369  The file “Chemical Tracking Data.csv” can be viewed in the JupyterHub graphical user interface:
370 370  
371 -[[image:1723798383409-873.png||height="267" width="874"]]
363 +[[image:Jupyter downloaded file in Home folder v2.4.11 2023-05-25 1850.png||height="15%" width="50%"]]
372 372  
373 373  
374 374  == Uploading Project Data from JupyterHub using the Pilot Command Line Interface ==
... ... @@ -381,11 +381,11 @@
381 381  * //Source~:// user's Home directory in JupyterHub {{code}}.{{/code}}
382 382  * //Destination//: Project “Indoc Test Project”, folder “collaborator4”, “Core” storage zone,
383 383  {{code}}indoctestproject/collaborator4{{/code}} {{code}}-z core{{/code}}
384 -* //Command group/option~:// {{code}}file upload{{/code}}
376 +* //Command group/option~:// {{code}}file upload{{code}}
385 385  * //User message// (for upload back to the Core): “my workbench output, no additional sensitive data"
386 -* //Command~:// {{code}}pilotcli file upload ./'Chemical Tracking Data rev.csv' -p{{/code}} {{code}}indoctestproject/collaborator4 -z core -m "my workbench output, no additional sensitive data"{{/code}}
378 +* //Command~:// pilotcli file upload ./'Chemical Tracking Data rev.csv' -p indoctestproject/collaborator4 -z core -m "my workbench output, no additional sensitive data"
387 387  
388 -When uploading data to the Core, you are reminded that you are bypassing the usual Green Room upload workflow. To confirm, type {{code}}y{{/code}} at the prompt, or {{code}}N{{/code}} to cancel.
380 +When uploading data to the Core, you are reminded that you are bypassing the usual Green Room upload workflow. To confirm, type y at the prompt, or N to cancel.
389 389  
390 390  {{code language="none"}}
391 391  collaborator4@jupyter-collaborator4:~$ pilotcli file upload ./'Chemical Tracking Data rev.csv' -p indoctestproject/collaborator4 -z core -m "my workbench output, no additional sensitive data"
... ... @@ -402,18 +402,4 @@
402 402  All uploading jobs have finished.
403 403  {{/code}}
404 404  
405 -After completing the upload, you can confirm the new file “Chemical Tracking Data rev.csv" exists in the correct directory using the pilotcli file list command and/or in the Portal File Explorer.
406 406  
407 -{{code language="none"}}
408 -collaborator4@jupyter-collaborator4:~$ pilotcli file list indoctestproject/collaborator4 -z core
409 -Chemical Tracking Data rev.csv Chemical Tracking Data.csv
410 -{{/code}}
411 -
412 -[[image:1723798397694-530.png||height="217" width="863"]]
413 -
414 -----
415 -
416 -Copyright © 2023-2024 [[Indoc Systems>>url:https://www.indocsystems.com]].
417 -
418 -HealthDataCloud is powered by Pilot technology, a product of [[Indoc Systems>>url:https://www.indocsystems.com]].
419 -
1723798240534-407.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.dsegebarth
Size
... ... @@ -1,1 +1,0 @@
1 -18.0 KB
Content
1723798257792-201.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.dsegebarth
Size
... ... @@ -1,1 +1,0 @@
1 -42.2 KB
Content
1723798278604-114.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.dsegebarth
Size
... ... @@ -1,1 +1,0 @@
1 -216.4 KB
Content
1723798293872-992.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.dsegebarth
Size
... ... @@ -1,1 +1,0 @@
1 -113.5 KB
Content
1723798325144-485.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.dsegebarth
Size
... ... @@ -1,1 +1,0 @@
1 -423.2 KB
Content
1723798338447-469.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.dsegebarth
Size
... ... @@ -1,1 +1,0 @@
1 -27.1 KB
Content
1723798355215-434.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.dsegebarth
Size
... ... @@ -1,1 +1,0 @@
1 -14.1 KB
Content
1723798365454-527.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.dsegebarth
Size
... ... @@ -1,1 +1,0 @@
1 -10.0 KB
Content
1723798383409-873.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.dsegebarth
Size
... ... @@ -1,1 +1,0 @@
1 -30.1 KB
Content
1723798397694-530.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.dsegebarth
Size
... ... @@ -1,1 +1,0 @@
1 -166.8 KB
Content
Jupyterhub file upload back to core v2.4.11 2023-05-25 1926.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.sgevans
Size
... ... @@ -1,1 +1,0 @@
1 -507.5 KB
Content
Jupyterhub-Logo-300x100px cropped.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.sgevans
Size
... ... @@ -1,1 +1,0 @@
1 -27.7 KB
Content