Awesome-Rust-MachineLearning
Awesome Rust Machine Learning crate list that writing this with the idea of migrating from Python.
It's a list with the major items at the top.
ToC
- Undercarriage
- Comprehensive (like sklearn)
- Gradient Boosting
- Deep Neaural Network
- Natural Language Processing (model)
- Recommendation
- Information Retrieval
- Reinforcement Learning
- Supervised Learning
- Unsupervised Learning & Clustering Model
- Evolutionary Algorithm
- Thanks
- Reference & Nearby Projects
Undercarriage
Jupter Notebook
- google/evcxr - An evaluation context for Rust.
- emakryo/rustdef - Jupyter extension for rust.
Plot
- 38/plotters - A rust drawing library for high quality data plotting for both WASM and native, statically and realtimely 🦀 📈🚀
- igiagkiozis/plotly - Plotly for Rust
- SiegeLord/RustGnuplot - A Rust library for drawing plots, powered by Gnuplot.
Vector
Most things use ndarray or std::vec. Also look at nalgebra.
ndarray vs nalgebra - reddit https://www.reddit.com/r/rust/comments/btn1cz/ndarray_vs_nalgebra/
- dimforge/nalgebra - Linear algebra library for Rust.
- rust-ndarray/ndarray - ndarray: an N-dimensional array with array views, multidimensional slicing, and efficient operations
Dataframe
Mainstream is polars using arrow.
- ritchie46/polars - Rust DataFrame library
- apache/arrow - In-memory columnar format, in Rust.
- milesgranger/black-jack - DataFrame / Series data processing in Rust
- nevi-me/rust-dataframe - A Rust DataFrame implementation, built on Apache Arrow
- kernelmachine/utah - Dataframe structure and operations in Rust
Image Processing
- image-rs/image - Encoding and decoding images in Rust
- image-rs/imageproc - Image processing operations
- rust-cv/ndarray-image - Allows conversion between ndarray's types and image's types
- twistedfall/opencv-rust - Rust bindings for OpenCV 3 & 4
- rustgd/cgmath - A linear algebra and mathematics library for computer graphics.
Natural Language Processing (preprocessing)
There is also the familiar huggingface/tokenizers in Python.
In rs-natural, addition to Tokenize, Distance, NGrams, Naive-Bayes and TF-IDF can also be used.
- huggingface/tokenizers - The core of tokenizers, written in Rust. Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.
- guillaume-be/rust-tokenizers - Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (SentencePiece) models
- christophertrml/rs-natural - Natural Language Processing for Rust
- greyblake/whatlang-rs - Natural language detection library for Rust.
- finalfusion/finalfrontier - Context-sensitive word embeddings with subwords. In Rust.
- stickeritis/sticker - A LSTM/Transformer/dilated convolution sequence labeler
- pemistahl/lingua-rs - 👄 The most accurate natural language detection library in the Rust ecosystem, suitable for long and short text alike
- usamec/cntk-rs - Wrapper around Microsoft CNTK library
- bminixhofer/nlprule - A fast, low-resource Natural Language Processing and Error Correction library written in Rust.
- rth/vtext - Simple NLP in Rust with Python bindings
- tamuhey/tokenizations - Robust and Fast tokenizations alignment library for Rust and Python
- reinfer/blingfire-rs - Rust wrapper for the BlingFire tokenization library
- CurrySoftware/rust-stemmers - Common stop words in a variety of languages
- cmccomb/rust-stop-words - Common stop words in a variety of languages
- Freyskeyd/nlp - Rust-nlp is a library to use Natural Language Processing algorithm with RUST
- for japanese
- lindera-morphology/lindera - A morphological analysis library.
- sorami/sudachi.rs - An unofficial Sudachi clone in Rust (incomplete) 🦀
- agatan/yoin - A Japanese Morphological Analyzer written in pure Rust
- nakagami/awabi - A morphological analyzer using mecab dictionary
ref
- https://users.rust-lang.org/t/interest-for-nlp-in-rust/15331
- https://www.reddit.com/r/rust/comments/5jj8vr/natural_language_processing_in_rust/
Comprehensive (like sklearn)
Many libraries support the following.
- Linear Regression
- Logistic Regression
- K-Means Clustering
- Neural Networks
- Gaussian Process Regression
- Support Vector Machines
- kGaussian Mixture Models
- Naive Bayes Classifiers
- DBSCAN
- k-Nearest Neighbor Classifiers
- Principal Component Analysis
- Decision Tree
- Support Vector Machines
- Naive Bayes
- Elastic Net
It write down the features.
- smartcorelib/smartcore - SmartCore is a comprehensive library for machine learning and numerical computing. The library provides a set of tools for linear algebra, numerical computing, optimization, and enables a generic, powerful yet still efficient approach to machine learning.
- LASSO, Ridge, Random Forest, LU, QR, SVD, EVD, and more metrics
- https://smartcorelib.org/user_guide/quick_start.html
- rust-ml/linfa - A Rust machine learning framework.
- Gaussian Mixture Model Clustering, Agglomerative Hierarchical Clustering, ICA
- https://github.com/rust-ml/linfa#current-state
- maciejkula/rustlearn - Machine learning crate for Rust
- factorization machines, k-fold cross-validation, ndcg
- https://github.com/maciejkula/rustlearn#features
- AtheMathmo/rusty-machine - Machine Learning library for Rust
- Confusion Matrix, Cross Varidation, Accuracy, F1 Score, MSE
- https://github.com/AtheMathmo/rusty-machine#machine-learning
Gradient Boosting
catboost is for predict only.
- mesalock-linux/gbdt-rs - MesaTEE GBDT-RS : a fast and secure GBDT library, supporting TEEs such as Intel SGX and ARM TrustZone
- davechallis/rust-xgboost - Rust bindings for XGBoost.
- vaaaaanquish/lightgbm-rs - LightGBM Rust binding
- catboost/catboost - A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks
- Entscheider/stamm - Generic decision trees for rust
Deep Neaural Network
Tensorflow or Pythorch are the most common.
tch-rs also includes torch vision.
- tensorflow/rust - Rust language bindings for TensorFlow
- LaurentMazare/tch-rs - Rust bindings for the C++ api of PyTorch.
- raskr/rust-autograd - Tensors and differentiable operations (like TensorFlow) in Rust
- charles-r-earp/autograph - Machine Learning Library for Rust
- oliverfunk/darknet-rs - Rust bindings for darknet
- jakelee8/mxnet-rs - mxnet for Rust
- primitiv/primitiv-rust - Rust binding of primitiv
- chantera/dynet-rs - The Rust Language Bindings for DyNet
Natural Language Processing (model)
- guillaume-be/rust-bert - Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)
- ferristseng/rust-tfidf - Library to calculate TF-IDF
- messense/fasttext-rs - fastText Rust binding
- mklf/word2vec-rs - pure rust implemention of word2vec
- DimaKudosh/word2vec - Rust interface to word2vec.
- lloydmeta/sloword2vec-rs - A naive (read: slow) implementation of Word2Vec. Uses BLAS behind the scenes for speed.
Recommendation
For Matrix Factorization, you can use rustlearn.
- jackgerrits/vowpalwabbit-rs - 🦀🐇 Rusty VowpalWabbit
- hja22/rucommender - Rust implementation of user-based collaborative filtering
- maciejkula/sbr-rs - Deep recommender systems for Rust
- chrisvittal/quackin - A recommender systems framework for Rust
- snd/onmf - fast rust implementation of online nonnegative matrix factorization as laid out in the paper "detect and track latent factors with online nonnegative matrix factorization"
- rhysnewell/nymph - Non-Negative Matrix Factorization in Rust
Information Retrieval
Full Text Search
- bayard-search/bayard - A full-text search and indexing server written in Rust.
- neuml/txtai.rs - AI-powered search engine for Rust
- meilisearch/MeiliSearch - Lightning Fast, Ultra Relevant, and Typo-Tolerant Search Engine
- toshi-search/Toshi - A full-text search engine in rust
- BurntSushi/fst - Represent large sets and maps compactly with finite state transducers.
- tantivy-search/tantivy - Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust
- tinysearch/tinysearch - 🔍 Tiny, full-text search engine for static websites built with Rust and Wasm
- https://github.com/andylokandy/simsearch-rs - A simple and lightweight fuzzy search engine that works in memory, searching for similar strings
- jameslittle230/stork - 🔎 Impossibly fast web search, made for static sites.
- elastic/elasticsearch-rs - Official Elasticsearch Rust Client
Nearest Neighbor Search
ANN search (approximate nearest neighbor)
- Enet4/faiss-rs - Rust language bindings for Faiss
- rust-cv/hnsw - HNSW ANN from the paper "Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs"
- granne/granne - Graph-based Approximate Nearest Neighbor Search
- rust-cv/hwt - Hamming Weight Tree from the paper "Online Nearest Neighbor Search in Hamming Space"
- kornelski/vpsearch - C library for finding nearest (most similar) element in a set
- mrhooray/kdtree-rs - K-dimensional tree in Rust for fast geospatial indexing and lookup
Reinforcement Learning
- tspooner/rsrl - A fast, safe and easy to use reinforcement learning framework in Rust.
- milanboers/rurel - Flexible, reusable reinforcement learning (Q learning) implementation in Rust
- MrRobb/gym-rs - OpenAI Gym bindings for Rust
Supervised Learning Model
- shadeMe/liblinear-rs - Rust language bindings for the LIBLINEAR C/C++ library.
- messense/crfsuite-rs - Rust binding to crfsuite
- ralfbiedert/ffsvm-rust - FFSVM stands for "Really Fast Support Vector Machine"
Unsupervised Learning & Clustering Model
- frjnn/bhtsne - Barnes-Hut t-SNE implementation written in Rust.
- avinashshenoy97/RusticSOM - Rust library for Self Organising Maps (SOM).
- kno10/rust-kmedoids - k-Medoids clustering in Rust with the FasterPAM algorithm
Evolutionary Algorithm
- martinus/differential-evolution-rs - Generic Differential Evolution for Rust
- innoave/genevo - Execute genetic algorithm (GA) simulations in a customizable and extensible way.
- Jeffail/spiril - Rust library for genetic algorithms
- sotrh/rust-genetic-algorithm - Example of a genetic algorithm in Rust and Python
Thanks
Thanks for all the projects.
This document is based on a blog in Japanese Rustで扱える機械学習関連のクレート2021.
Please PR. Thanks.