| Next revision | Previous revision |
| hardware [2025/04/07 22:30] – created nshegunov | hardware [2025/04/07 22:34] (current) – nshegunov |
|---|
| Certainly! Here's the updated DocuWiki page with the names swapped with the links: | |
| |
| ``` | |
| ====== Popular Libraries for Scientific Computing, Machine Learning, and Data Science ====== | ====== Popular Libraries for Scientific Computing, Machine Learning, and Data Science ====== |
| |
| This document provides an overview of widely used libraries across various domains such as scientific computing, machine learning, data science, and high-performance computing. | This document provides an overview of widely used libraries across various domains such as scientific computing, machine learning, data science, and high-performance computing, available on the unite cluster. |
| |
| ---- | ---- |
| |
| ===== Compiler Libraries ===== | ===== Compiler Libraries ===== |
| |
| * **[[https://gcc.gnu.org | GCC (GNU Compiler Collection)]]** | * **[[https://gcc.gnu.org | GCC (GNU Compiler Collection)]]** |
| - Domain: Compiler | - Domain: Compiler |
| - Description: GCC is a collection of compilers for various programming languages, including C, C++, and Fortran. It's essential for compiling code in high-performance computing and software development. | - Description: GCC is a collection of compilers for various programming languages, including C, C++, and Fortran. It's essential for compiling code in high-performance computing and software development. |
| |
| ===== GPU Computing ===== | * **[[https://llvm.org | LLVM]]** |
| | - Domain: Compiler Infrastructure |
| | - Description: LLVM is a collection of modular and reusable compiler and toolchain technologies. It’s used for developing compilers, optimizers, and other code analysis tools. |
| |
| | ===== GPU Computing & Deep Learning ===== |
| * **[[https://developer.nvidia.com/cuda-zone | CUDA]]** | * **[[https://developer.nvidia.com/cuda-zone | CUDA]]** |
| - Domain: GPU Computing | - Domain: GPU Computing |
| - Description: cuDNN is a GPU-accelerated library for deep neural networks. It's optimized for high performance on NVIDIA hardware and is widely used in machine learning and AI applications. | - Description: cuDNN is a GPU-accelerated library for deep neural networks. It's optimized for high performance on NVIDIA hardware and is widely used in machine learning and AI applications. |
| |
| ===== Signal Processing ===== | * **[[https://pytorch.org | PyTorch]]** |
| | - Domain: Machine Learning |
| | - Description: PyTorch is an open-source machine learning library based on the Torch library. It is widely used in deep learning and research due to its flexibility and ease of use. |
| |
| * **[[http://www.fftw.org | FFTW]]** | * **[[https://www.tensorflow.org | TensorFlow]]** |
| - Domain: Signal Processing | - Domain: Machine Learning |
| - Description: FFTW is a C library for computing discrete Fourier transforms (DFT). It is highly efficient and widely used for signal processing and numerical simulations. | - Description: TensorFlow is an open-source platform for machine learning. It provides a comprehensive ecosystem of tools, libraries, and community resources to facilitate the development of ML models. |
| | |
| ===== Molecular Dynamics ===== | |
| | |
| * **[[http://www.gromacs.org | GROMACS]]** | |
| - Domain: Molecular Dynamics | |
| - Description: GROMACS is a molecular dynamics simulation software primarily used for simulating proteins, lipids, and nucleic acids. It's a key tool in computational biology and chemistry. | |
| | |
| ===== Mathematics & Numerical Computation ===== | |
| |
| | ===== Scientific Computing & Numerical Libraries ===== |
| * **[[https://www.gnu.org/software/gsl | GSL (GNU Scientific Library)]]** | * **[[https://www.gnu.org/software/gsl | GSL (GNU Scientific Library)]]** |
| - Domain: Mathematics & Numerical Computation | - Domain: Mathematics & Numerical Computation |
| - Description: GSL is a collection of numerical routines for scientific computing, including statistics, linear algebra, and numerical integration. | - Description: GSL is a collection of numerical routines for scientific computing, including statistics, linear algebra, and numerical integration. |
| |
| ===== Data Storage ===== | * **[[http://www.fftw.org | FFTW]]** |
| | - Domain: Signal Processing |
| | - Description: FFTW is a C library for computing discrete Fourier transforms (DFT). It is highly efficient and widely used for signal processing and numerical simulations. |
| |
| * **[[https://www.hdfgroup.org/solutions/hdf5 | HDF5]]** | * **[[https://www.hdfgroup.org/solutions/hdf5 | HDF5]]** |
| - Description: HDF5 is a file format and set of tools for storing and managing large amounts of data. It's commonly used in scientific computing for high-volume data storage. | - Description: HDF5 is a file format and set of tools for storing and managing large amounts of data. It's commonly used in scientific computing for high-volume data storage. |
| |
| ===== Programming Languages ===== | * **[[https://numpy.org | NumPy]]** |
| | - Domain: Scientific Computing & Data Science |
| | - Description: NumPy is the fundamental package for numerical computing in Python. It provides support for large multi-dimensional arrays and matrices, along with a collection of mathematical functions to operate on these arrays. |
| |
| * **[[https://www.java.com | Java]]** | * **[[https://scipy.org | SciPy]]** |
| - Domain: Programming Language | - Domain: Scientific Computing |
| - Description: Java is a widely used programming language that is object-oriented and designed to have as few implementation dependencies as possible. It is used across various industries, including enterprise applications and big data. | - Description: SciPy is a Python library used for scientific and technical computing. It builds on NumPy and provides a collection of algorithms for optimization, integration, interpolation, eigenvalue problems, and more. |
| | |
| * **[[https://julialang.org | Julia]]** | |
| - Domain: High-Performance Computing & Data Science | |
| - Description: Julia is a high-performance programming language for technical computing. It’s used for scientific computing, data science, and machine learning, thanks to its speed and ease of use. | |
| | |
| ===== Linear Algebra ===== | |
| |
| * **[[http://www.netlib.org/lapack | LAPACK]]** | * **[[http://www.netlib.org/lapack | LAPACK]]** |
| - Description: LAPACK is a library for solving linear algebra problems such as systems of linear equations, least squares problems, eigenvalue problems, and singular value decomposition. | - Description: LAPACK is a library for solving linear algebra problems such as systems of linear equations, least squares problems, eigenvalue problems, and singular value decomposition. |
| |
| ===== Image Processing ===== | * **[[https://www.openblas.net | OpenBLAS]]** |
| | - Domain: Linear Algebra |
| * **[[https://libjpeg-turbo.org | libjpeg-turbo]]** | - Description: OpenBLAS is an optimized BLAS (Basic Linear Algebra Subprograms) library that provides highly optimized matrix operations and is used for high-performance numerical computing. |
| - Domain: Image Processing | |
| - Description: libjpeg-turbo is a high-speed JPEG image compression library that provides faster encoding and decoding of JPEG images compared to other implementations. | |
| | |
| * **[[http://www.libpng.org | libpng]]** | |
| - Domain: Image Processing | |
| - Description: libpng is a reference library for the PNG (Portable Network Graphics) image format. It’s used extensively for handling PNG images in web development, image processing, and graphics applications. | |
| | |
| ===== Compiler Infrastructure ===== | |
| | |
| * **[[https://llvm.org | LLVM]]** | |
| - Domain: Compiler Infrastructure | |
| - Description: LLVM is a collection of modular and reusable compiler and toolchain technologies. It’s used for developing compilers, optimizers, and other code analysis tools. | |
| | |
| ===== Data Compression ===== | |
| | |
| * **[[https://lz4.github.io/lz4 | LZ4]]** | |
| - Domain: Data Compression | |
| - Description: LZ4 is a fast compression algorithm and library that allows extremely high compression and decompression speeds. It is used in high-performance data storage and transmission applications. | |
| | |
| ===== Linear Algebra & HPC ===== | |
| |
| | ===== High-Performance Computing (HPC) ===== |
| * **[[http://icl.cs.utk.edu/magma | MAGMA]]** | * **[[http://icl.cs.utk.edu/magma | MAGMA]]** |
| - Domain: Linear Algebra & HPC | - Domain: Linear Algebra & HPC |
| - Description: MAGMA is a library for high-performance linear algebra routines on multi-core and multi-GPU systems. It's a key tool in high-performance computing (HPC) applications. | - Description: MAGMA is a library for high-performance linear algebra routines on multi-core and multi-GPU systems. It's a key tool in high-performance computing (HPC) applications. |
| |
| ===== Parallel Computing ===== | |
| |
| * **[[https://www.mpich.org | MPICH]]** | * **[[https://www.mpich.org | MPICH]]** |
| - Domain: Parallel Computing | - Domain: Parallel Computing |
| - Description: MPICH is an implementation of the Message Passing Interface (MPI) standard for parallel computing. It is widely used in high-performance parallel applications. | - Description: MPICH is an implementation of the Message Passing Interface (MPI) standard for parallel computing. It is widely used in high-performance parallel applications. |
| |
| ===== Scientific Computing & Data Science ===== | |
| |
| * **[[https://numpy.org | NumPy]]** | |
| - Domain: Scientific Computing & Data Science | |
| - Description: NumPy is the fundamental package for numerical computing in Python. It provides support for large multi-dimensional arrays and matrices, along with a collection of mathematical functions to operate on these arrays. | |
| |
| ===== Linear Algebra ===== | |
| |
| * **[[https://www.openblas.net | OpenBLAS]]** | |
| - Domain: Linear Algebra | |
| - Description: OpenBLAS is an optimized BLAS (Basic Linear Algebra Subprograms) library that provides highly optimized matrix operations and is used for high-performance numerical computing. | |
| |
| ===== Parallel Computing ===== | |
| |
| * **[[https://www.open-mpi.org | OpenMPI]]** | * **[[https://www.open-mpi.org | OpenMPI]]** |
| - Description: OpenMPI is an open-source implementation of the Message Passing Interface (MPI) for parallel and distributed computing. It is used in high-performance computing environments for multi-node computations. | - Description: OpenMPI is an open-source implementation of the Message Passing Interface (MPI) for parallel and distributed computing. It is used in high-performance computing environments for multi-node computations. |
| |
| ===== Data Science ===== | ===== Data Science & Data Manipulation ===== |
| * **[[https://pandas.pydata.org | Pandas]]** | * **[[https://pandas.pydata.org | Pandas]]** |
| - Domain: Data Science | - Domain: Data Science |
| - Description: Pandas is a fast, powerful, flexible, and easy-to-use data analysis and manipulation library for Python. It’s used extensively in data science and data analysis. | - Description: Pandas is a fast, powerful, flexible, and easy-to-use data analysis and manipulation library for Python. It’s used extensively in data science and data analysis. |
| |
| ===== Programming Languages ===== | |
| |
| * **[[https://www.python.org | Python]]** | * **[[https://www.python.org | Python]]** |
| - Description: Python is a versatile, high-level programming language that is widely used in web development, data science, automation, machine learning, and more. | - Description: Python is a versatile, high-level programming language that is widely used in web development, data science, automation, machine learning, and more. |
| |
| ===== Machine Learning ===== | |
| |
| * **[[https://pytorch.org | PyTorch]]** | |
| - Domain: Machine Learning | |
| - Description: PyTorch is an open-source machine learning library based on the Torch library. It is widely used in deep learning and research due to its flexibility and ease of use. | |
| |
| ===== Scientific Computing ===== | |
| |
| * **[[https://scipy.org | SciPy]]** | |
| - Domain: Scientific Computing | |
| - Description: SciPy is a Python library used for scientific and technical computing. It builds on NumPy and provides a collection of algorithms for optimization, integration, interpolation, eigenvalue problems, and more. | |
| |
| ===== Python Package Management ===== | |
| |
| * **[[https://setuptools.pypa.io | Setuptools]]** | |
| - Domain: Python Package Management | |
| - Description: Setuptools is a package development and distribution library for Python. It simplifies packaging Python projects and managing their dependencies. | |
| |
| ===== Machine Learning ===== | |
| |
| * **[[https://www.tensorflow.org | TensorFlow]]** | |
| - Domain: Machine Learning | |
| - Description: TensorFlow is an open-source platform for machine learning. It provides a comprehensive ecosystem of tools, libraries, and community resources to facilitate the development of ML models. | |
| |
| ===== Data Compression ===== | |
| |
| * **[[https://zlib.net | Zlib]]** | |
| - Domain: Data Compression | |
| - Description: Zlib is a software library used for data compression. It is used in many applications for compressing data to reduce storage or transmission size. | |
| ``` | |
| |
| Now, the library names are linked in the format you requested, with the link before the library name. | |
