Both sides previous revisionPrevious revisionNext revision | Previous revision |
hardware [2025/04/07 22:31] – nshegunov | hardware [2025/04/07 22:34] (current) – nshegunov |
---|
====== Popular Libraries for Scientific Computing, Machine Learning, and Data Science ====== | ====== Popular Libraries for Scientific Computing, Machine Learning, and Data Science ====== |
| |
This document provides an overview of widely used libraries across various domains such as scientific computing, machine learning, data science, and high-performance computing. | This document provides an overview of widely used libraries across various domains such as scientific computing, machine learning, data science, and high-performance computing, available on the unite cluster. |
| |
---- | ---- |
- Domain: Linear Algebra | - Domain: Linear Algebra |
- Description: OpenBLAS is an optimized BLAS (Basic Linear Algebra Subprograms) library that provides highly optimized matrix operations and is used for high-performance numerical computing. | - Description: OpenBLAS is an optimized BLAS (Basic Linear Algebra Subprograms) library that provides highly optimized matrix operations and is used for high-performance numerical computing. |
| |
===== Image Processing ===== | |
* **[[https://libjpeg-turbo.org | libjpeg-turbo]]** | |
- Domain: Image Processing | |
- Description: libjpeg-turbo is a high-speed JPEG image compression library that provides faster encoding and decoding of JPEG images compared to other implementations. | |
| |
* **[[http://www.libpng.org | libpng]]** | |
- Domain: Image Processing | |
- Description: libpng is a reference library for the PNG (Portable Network Graphics) image format. It’s used extensively for handling PNG images in web development, image processing, and graphics applications. | |
| |
===== High-Performance Computing (HPC) ===== | ===== High-Performance Computing (HPC) ===== |
- Domain: Programming Language | - Domain: Programming Language |
- Description: Python is a versatile, high-level programming language that is widely used in web development, data science, automation, machine learning, and more. | - Description: Python is a versatile, high-level programming language that is widely used in web development, data science, automation, machine learning, and more. |
| |
* **[[https://setuptools.pypa.io | Setuptools]]** | |
- Domain: Python Package Management | |
- Description: Setuptools is a package development and distribution library for Python. It simplifies packaging Python projects and managing their dependencies. | |
| |
===== Data Compression ===== | |
* **[[https://lz4.github.io/lz4 | LZ4]]** | |
- Domain: Data Compression | |
- Description: LZ4 is a fast compression algorithm and library that allows extremely high compression and decompression speeds. It is used in high-performance data storage and transmission applications. | |
| |
* **[[https://zlib.net | Zlib]]** | |
- Domain: Data Compression | |
- Description: Zlib is a software library used for data compression. It is used in many applications for compressing data to reduce storage or transmission size. | |
| |
===== Additional Libraries ===== | |
* **[[https://gcc.gnu.org | GCC (GNU Compiler Collection)]]** | |
- Domain: Compiler | |
- Description: GCC is a collection of compilers for various programming languages, including C, C++, and Fortran. It's essential for compiling code in high-performance computing and software development. | |
| |
* **[[https://www.java.com | Java]]** | |
- Domain: Programming Language | |
- Description: Java is a widely used programming language that is object-oriented and designed to have as few implementation dependencies as possible. It is used across various industries, including enterprise applications and big data. | |
| |
* **[[https://julialang.org | Julia]]** | |
- Domain: High-Performance Computing & Data Science | |
- Description: Julia is a high-performance programming language for technical computing. It’s used for scientific computing, data science, and machine learning, thanks to its speed and ease of use. | |
| |
* **[[https://llvm.org | LLVM]]** | |
- Domain: Compiler Infrastructure | |
- Description: LLVM is a collection of modular and reusable compiler and toolchain technologies. It’s used for developing compilers, optimizers, and other code analysis tools. | |
| |
* **[[https://www.tensorflow.org | TensorFlow]]** | |
- Domain: Machine Learning | |
- Description: TensorFlow is an open-source platform for machine learning. It provides a comprehensive ecosystem of tools, libraries, and community resources to facilitate the development of ML models. | |
| |
* **[[https://www.hdfgroup.org/solutions/hdf5 | HDF5]]** | |
- Domain: Data Storage | |
- Description: HDF5 is a file format and set of tools for storing and managing large amounts of data. It's commonly used in scientific computing for high-volume data storage. | |
| |
| |