IT wiki

VU MIF STSC

User Tools

Site Tools


en:hpc

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
Next revisionBoth sides next revision
en:hpc [2022/04/14 13:43] – [Software] grikieteen:hpc [2022/04/15 06:59] – [Registration] grikiete
Line 1: Line 1:
 ====== Description of the Equipment ====== ====== Description of the Equipment ======
  
-Distributed Computing Network (DCN) is a specially designed network of computers capable of running applications that can exchange data efficiently.+High Performance Computing (HPC) is a specially designed network of computers capable of running applications that can exchange data efficiently.
  
-VU MIF PST consists of a supercomputer from the clusters (the first number is the actual and available amount):+VU MIF HPC consists of a supercomputer from the clusters (the first number is the actual and available amount):
  
 ^Title ^Nodes ^CPU ^GPU ^RAM        ^HDD    ^Network ^Notes| ^Title ^Nodes ^CPU ^GPU ^RAM        ^HDD    ^Network ^Notes|
Line 16: Line 16:
 ====== Software ====== ====== Software ======
  
-**main** and **gpu** are installed [[https://docs.qlustar.com/Qlustar/11.0/HPCstack/hpc-user-manual.html|Qlustar 11]] operating system (OS) with Linux core. It is created Ubuntu 18.04 LTS based. **power** is installed Ubuntu 18.04 LTS.+In **main** and **gpu** partitions there are installed [[https://docs.qlustar.com/Qlustar/11.0/HPCstack/hpc-user-manual.html|Qlustar 11]] OS. It is based on Ubuntu 18.04 LTS. In **power** partition there is installed Ubuntu 18.04 LTS.
  
-You can check the list of OS package with the command ''dpkg -l'' (in log in node **hpc** or in **power** nodes).+You can check the list of OS package with the command ''dpkg -l'' (in login node **hpc** or in **power** nodes).
  
-With the command [[https://sylabs.io/guides/3.2/user-guide/index.html|singularity]] it is possible to make use of ready-made copies of container files in directories ''/apps/local/hpc'', ''/apps/local/nvidia'', ''/apps/local/intel'', ''/apps/local/lang'' or to download from singularity and docker online directories. You can also create your own singularity containers using the MIF cloud service.+With the command [[https://sylabs.io/guides/3.2/user-guide/index.html|singularity]] it is possible to make use of ready-made copies of container files in directories ''/apps/local/hpc'', ''/apps/local/nvidia'', ''/apps/local/intel'', ''/apps/local/lang'' or to download from singularity and docker online repositories. You can also create your own singularity containers using the MIF cloud service.
  
-With singularity you can prepare your container, for example:+You can prepare your container with singularity, for example:
 <code shell> <code shell>
 $ singularity build --sandbox /tmp/python docker://python:3.8 $ singularity build --sandbox /tmp/python docker://python:3.8
Line 31: Line 31:
 Similarly, you can use R, Julia or other containers that do not require root privileges to install packages. Similarly, you can use R, Julia or other containers that do not require root privileges to install packages.
  
-Jeigu norima papildyti singularity kontainerį OS paketaistam reikia root/superuser teisiųSu fakeroot jas simuliuojameo jam reikalingą biblioteką ''libfakeroot-sysv.so'' kopijuojame į konteinerįpvz:+If you want to add OS packages to the singularity containeryou need root/superuser privilegesWith fakeroot, we simulate them, and copy the required library ''libfakeroot-sysv.so'' into the containerfor example:
 <code shell> <code shell>
 $ singularity build --sandbox /tmp/python docker://ubuntu:18.04 $ singularity build --sandbox /tmp/python docker://ubuntu:18.04
Line 38: Line 38:
 $ fakeroot -l /libfakeroot-sysv.so singularity exec -w /tmp/python apt-get install python3.8 ... $ fakeroot -l /libfakeroot-sysv.so singularity exec -w /tmp/python apt-get install python3.8 ...
 $ fakeroot -l /libfakeroot-sysv.so singularity exec -w /tmp/python apt-get clean $ fakeroot -l /libfakeroot-sysv.so singularity exec -w /tmp/python apt-get clean
-$ rm -rf /tmp/python/libfakeroot-sysv.so /tmp/python/var/lib/apt/lists (galima ir daugiau išvalyti, ko nereikia)+$ rm -rf /tmp/python/libfakeroot-sysv.so /tmp/python/var/lib/apt/lists (you can clean up more of what you don't need)
 $ singularity build python.sif /tmp/python $ singularity build python.sif /tmp/python
 $ rm -rf /tmp/python $ rm -rf /tmp/python
 </code> </code>
  
-Kataloge ''/apps/local/bigdata'' yra paruošti scenarijai pasileisti savo **hadoop** užduotis pasinaudojant [[https://github.com/LLNL/magpie|Magpie]] rinkiniu.+There are ready-made scripts to run your **hadoop** tasks using the [[https://github.com/LLNL/magpie|Magpie]] set in the directory ''/apps/local/bigdata''.
  
-Su [[https://hpc.mif.vu.lt/hub/|JupyterHub]] galite interneto naršyklės pagalba vykdyti skaičiavimus su python komandų eilute ir pasinaudoti [[https://jupyter.org|JupyterLab]] aplinkaJeigu savo namų kataloge instaliuosite savo JupyterLab aplinkątai reikia instaliuoti papildomai ''batchspawner'' paketą tada jums startuos jūsų aplinkąpvz:+With [[https://hpc.mif.vu.lt/hub/|JupyterHub]] you can run calculations with the python command line in a web browser and use the [[https://jupyter.org|JupyterLab]] environmentIf you install your own JupyterLab environment in your home directoryyou need to install the additional ''batchspawner'' package this will start your environmentfor example:
  
 <code shell> <code shell>
Line 52: Line 52:
 </code> </code>
  
-Taip pat jūs galite pasinaudoti savo pasidarytu konteineriu per JupyterHub. Tame konteineryje reikia instaliuoti ''batchswapner'' ir ''jupyterlab'' paketus bei sukurti script'ą ''~/.local/bin/batchspawner-singleuser'' su vykdymo teisėmis (''chmod +x ~/.local/bin/batchspawner-singleuser'')+Alternatively, you can use a container that you made via JupyterHub. In that container, you need to install the ''batchswapner'' and ''jupyterlab'' packages, and to create a script ''~/.local/bin/batchspawner-singleuser'' with execution permissions (''chmod +x ~/.local/bin/batchspawner-singleuser'').
 <code shell> <code shell>
 #!/bin/sh #!/bin/sh
 exec singularity exec --nv myjupyterlab.sif batchspawner-singleuser "$@" exec singularity exec --nv myjupyterlab.sif batchspawner-singleuser "$@"
 </code> </code>
 +
 +====== Registration ======
 +
 +The HPC can only be used by registered users of the VU MIF computer network. Existing **VU MIF network users** can use HPC without **additional registration**.
 +
 +Fill in the [[https://mif.vu.lt/lt3/en/about/structure/it-research-center#ordering|registration form]] to order IT Research center services. Once the request has been approved, a VU MIF computer network user ID will be assigned. Jei esate VU darbuotojas ar studentas ir registracijos metu nurodėte savo VU el. pašto adresą. Tada įvesti savo pradinį slaptažodį, galite per [[https://mif.vu.lt/passwd2|pamiršto slaptažodžio]] pakeitimo procedūrą, naudodami [[https://id.vu.lt|VU E.tapatybės]] duomenis. Kitu atveju teks atvykti į VU MIF Didlaukio g. 47, 302/304 kab. darbo metu, dėl tikslaus laiko galite pasitikslinti tel. 8 5219 5005 arba 8 5219 5006.
 +
 +Su suteiktu (pasirinktu) naudotojo vardu ir savo įvestu slaptažodžiu įgyjama teisė jungtis prie serverio **uosis.mif.vu.lt**, VU MIF mokymo klasių ir dalies VU MIF darbo vietų kompiuterių.
 +
 +Adresu [[https://hpc.mif.vu.lt|Waldur]] yra savitarnos portalas, kur su savo universiteto (per **eduGAIN** arba **LITNET**) prisijungimu galima pačiam susikurti **HPC** prisijungimą. Daugiau info apie tai [[waldur|čia]].
 +
en/hpc.txt · Last modified: 2024/02/21 12:50 by rolnas

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki