2021-07-24 23:07:38 +09:00
2021-02-24 02:05:23 +09:00
2021-07-24 23:05:55 +09:00
2021-02-23 23:39:43 +09:00
2021-07-22 01:24:01 +09:00
2021-07-22 00:49:39 +09:00

Awesome-Rust-MachineLearning

Awesome Rust Machine Learning crate list that writing this with the idea of migrating from Python.

And reference of Machine Learning using Rust (blog, book, movie, discussion, ...and more).

It's a list with the major items at the top.

For Japanese: README.ja.md

ToC

Undercarriage

Jupyter Notebook

Plot

Vector

Most things use ndarray or std::vec. Also look at nalgebra.

ndarray vs nalgebra - reddit https://www.reddit.com/r/rust/comments/btn1cz/ndarray_vs_nalgebra/

Dataframe

Mainstream is polars using arrow. datafusion looks good too.

Image Processing

Natural Language Processing (preprocessing)

There is also the familiar huggingface/tokenizers in Python. In rs-natural, addition to Tokenize, Distance, NGrams, Naive-Bayes and TF-IDF can also be used. Machine learning models may be used to process NLP.

  • huggingface/tokenizers - The core of tokenizers, written in Rust. Provides an implementation of today's most used tokenizers, with a focus on performance and versatility.
  • google-research/deduplicate-text-datasets - This repository contains code to deduplicate language model datasets as descrbed in the paper "Deduplicating Training Data Makes Language Models Better" by Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch and Nicholas Carlini. This repository contains both the ExactSubstr deduplication implementation (written in Rust) along with the scripts we used in the paper to perform deduplication and inspect the results (written in Python). In an upcoming update, we will add files to reproduce the NearDup-deduplicated versions of the C4, RealNews, LM1B, and Wiki-40B-en datasets.
  • guillaume-be/rust-tokenizers - Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (SentencePiece) models
  • christophertrml/rs-natural - Natural Language Processing for Rust
  • bminixhofer/nnsplit - Semantic text segmentation. For sentence boundary detection, compound splitting and more.
  • greyblake/whatlang-rs - Natural language detection library for Rust.
  • finalfusion/finalfrontier - Context-sensitive word embeddings with subwords. In Rust.
  • stickeritis/sticker - A LSTM/Transformer/dilated convolution sequence labeler
  • pemistahl/lingua-rs - ๐Ÿ‘„ The most accurate natural language detection library in the Rust ecosystem, suitable for long and short text alike
  • usamec/cntk-rs - Wrapper around Microsoft CNTK library
  • bminixhofer/nlprule - A fast, low-resource Natural Language Processing and Error Correction library written in Rust.
  • rth/vtext - Simple NLP in Rust with Python bindings
  • tamuhey/tokenizations - Robust and Fast tokenizations alignment library for Rust and Python
  • vgel/treebender - A HDPSG-inspired symbolic natural language parser written in Rust
  • reinfer/blingfire-rs - Rust wrapper for the BlingFire tokenization library
  • CurrySoftware/rust-stemmers - Common stop words in a variety of languages
  • cmccomb/rust-stop-words - Common stop words in a variety of languages
  • Freyskeyd/nlp - Rust-nlp is a library to use Natural Language Processing algorithm with RUST

Graph

Interface & Pipeline & AutoML

Workflow

Comprehensive (like sklearn)

Many libraries support the following.

  • Linear Regression
  • Logistic Regression
  • K-Means Clustering
  • Neural Networks
  • Gaussian Process Regression
  • Support Vector Machines
  • kGaussian Mixture Models
  • Naive Bayes Classifiers
  • DBSCAN
  • k-Nearest Neighbor Classifiers
  • Principal Component Analysis
  • Decision Tree
  • Support Vector Machines
  • Naive Bayes
  • Elastic Net

It writes down the features.

Comprehensive (Statistics)

Optimize, Automatic Differentiation, Numerical Analysis, Statistics, ... and more

  • Axect/Peroxide - Rust numeric library with R, MATLAB & Python syntax
    • Linear Algebra, Functional Programming, Automatic Differentiation, Numerical Analysis, Statistics, Special functions, Plotting, Dataframe

Gradient Boosting

catboost is for predict only.

Deep Neural Network

Tensorflow or Pythorch are the most common. tch-rs also includes torch vision.

Graph Model

  • Synerise/cleora - Cleora AI is a general-purpose model for efficient, scalable learning of stable and inductive entity embeddings for heterogeneous relational data.

Natural Language Processing (model)

Recommendation

For Matrix Factorization, you can use rustlearn.

Information Retrieval

ANN search (approximate nearest neighbor), hashing, dimensional tree, etc...

  • Enet4/faiss-rs - Rust language bindings for Faiss
  • rust-cv/hnsw - HNSW ANN from the paper "Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs"
  • InstantDomain/instant-distance - Fast approximate nearest neighbor searching in Rust, based on HNSW index
  • lerouxrgd/ngt-rs - Rust wrappers for NGT approximate nearest neighbor search
  • granne/granne - Graph-based Approximate Nearest Neighbor Search
  • qdrant/qdrant - Qdrant - vector similarity search engine with extended filtering support
  • rust-cv/hwt - Hamming Weight Tree from the paper "Online Nearest Neighbor Search in Hamming Space"
  • kornelski/vpsearch - C library for finding nearest (most similar) element in a set
  • mrhooray/kdtree-rs - K-dimensional tree in Rust for fast geospatial indexing and lookup
  • petabi/petal-neighbors - Nearest neighbor search algorithms including a ball tree and a vantage point tree.
  • ritchie46/lsh-rs - Locality Sensitive Hashing in Rust with Python bindings
  • kampersanda/mih-rs - Rust implementation of multi-index hashing for neighbor searches on 64-bit codes in the Hamming space

Reinforcement Learning

Looks good border.

  • taku-y/border - Border is a reinforcement learning library in Rust.
  • NivenT/REnforce - Reinforcement learning library written in Rust
  • tspooner/rsrl - A fast, safe and easy to use reinforcement learning framework in Rust.
  • milanboers/rurel - Flexible, reusable reinforcement learning (Q learning) implementation in Rust
  • MrRobb/gym-rs - OpenAI Gym bindings for Rust

Supervised Learning Model

Unsupervised Learning & Clustering Model

Statistical Model

  • Redpoll/changepoint - Includes the following change point detection algorithms: Bocpd -- Online Bayesian Change Point Detection Reference. BocpdTruncated -- Same as Bocpd but truncated the run-length distribution when those lengths are unlikely.
  • krfricke/arima - ARIMA modelling for Rust
  • Daingun/automatica - Automatic Control Systems Library
  • rbagd/rust-linearkalman - Kalman filtering and smoothing in Rust
  • sanity/pair_adjacent_violators - An implementation of the Pair Adjacent Violators algorithm for isotonic regression in Rust

Evolutionary Algorithm

Reference

Nearby Projects

Blogs

Introduction

Tutorial

Apply

Case study

Discussion

Books

Movie

Paper

  • End-to-end NLP Pipelines in Rust, Proceedings of Second Workshop for NLP Open Source Software (NLP-OSS), pages 20โ€“25 Virtual Conference, 2020/11/19, Guillaume Becquin

Thanks

Thanks for all the projects.

Please PR. Thanks.

Description
This repository is a list of machine learning libraries written in Rust. It's a compilation of GitHub repositories, blogs, books, movies, discussions, papers, etc. ๐Ÿฆ€
Readme MIT 32 MiB
Languages
JavaScript 50.5%
HTML 49.5%