IT wiki

VU MIF STSC

User Tools

Site Tools


en:hpc

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
en:hpc [2024/02/21 12:45] – [Singularity] rolnasen:hpc [2024/02/21 12:50] (current) – [Singularity] rolnas
Line 31: Line 31:
 $ rm -rf /tmp/python $ rm -rf /tmp/python
 </code> </code>
 +
 +
 +To use this container, it is advised to use different directory instead of home directory (for python packages don't mixup with installed to home directory).
 +<code shell>
 +$ mkdir ~/workdir
 +$ singularity exec -H ~/workdir:$HOME python.sif python3 ...
 +</code>
 +
 Similarly, you can use R, Julia or other containers that do not require root privileges to install packages. Similarly, you can use R, Julia or other containers that do not require root privileges to install packages.
  
Line 45: Line 53:
 </code> </code>
  
-==== Hadoop ====+===== Hadoop =====
  
 There are ready-made scripts to run your **hadoop** tasks using the [[https://github.com/LLNL/magpie|Magpie]] set in the directory ''/apps/local/bigdata''. There are ready-made scripts to run your **hadoop** tasks using the [[https://github.com/LLNL/magpie|Magpie]] set in the directory ''/apps/local/bigdata''.
  
-==== JupyterHub ====+===== JupyterHub =====
  
 With [[https://hpc.mif.vu.lt/hub/|JupyterHub]] you can run calculations with the python command line in a web browser and use the [[https://jupyter.org|JupyterLab]] environment. If you install your own JupyterLab environment in your home directory, you need to install the additional ''batchspawner'' package - this will start your environment, for example: With [[https://hpc.mif.vu.lt/hub/|JupyterHub]] you can run calculations with the python command line in a web browser and use the [[https://jupyter.org|JupyterLab]] environment. If you install your own JupyterLab environment in your home directory, you need to install the additional ''batchspawner'' package - this will start your environment, for example:
en/hpc.1708519547.txt.gz · Last modified: 2024/02/21 12:45 by rolnas

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki