Skip to content

Latest commit

 

History

History
464 lines (386 loc) · 49.3 KB

README.md

File metadata and controls

464 lines (386 loc) · 49.3 KB
Raw

Awesome-Mamba-Collection

Awesome PRs Welcome Stars

Welcome to Awesome Mamba Resources! This repository is a curated collection of papers, tutorials, videos, and other valuable resources related to Mamba. Whether you're a beginner or an experienced user, this collection aims to provide a comprehensive reference for all things Mamba. Explore the latest research papers, dive into helpful tutorials, and discover insightful videos to enhance your understanding and proficiency in Mamba. Join us in this open collaboration to foster knowledge sharing and empower the Mamba community. Let's embark on an exciting journey with Mamba!

Feel free to modify and customize this introduction according to your preferences. Good luck with your repository! If you have any other questions, feel free to ask. -by ChatGPT

If you want to see the star count of each paper's code, switch to this.

Enjoy it below!

Papers

Architecture

  • Mamba: Linear-Time Sequence Modeling with Selective State Spaces [paper] [code] (2023.12.01)
  • MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts [paper] [code] (2024.01.08)
  • BlackMamba: Mixture of Experts for State-Space Models [paper] [code] (2024.02.01)
  • Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling [paper] [homepage] (2024.02.15)
  • DenseMamba: State Space Models with Dense Hidden Connection for Efficient Large Language Models [paper] [code] (2024.02.26)
  • Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models [paper] [code] (2024.02.29)
  • Jamba: A Hybrid Transformer-Mamba Language Model [paper] [code] (2024.03.28)
  • (ICML 2024) Transformers are SSMs: Generalized Models and Efficient Algorithms with Structured State Space Duality [paper] [poster] [code] (2024.05.31)

Theoretical Analysis

  • StableSSM: Alleviating the Curse of Memory in State-space Models through Stable Reparameterization [paper] (2023.11.24)
  • The Hidden Attention of Mamba Models [paper] [code] (2024.03.03)
  • Understanding Robustness of Visual State Space Models for Image Classification [paper] (2024.03.16)
  • From Generalization Analysis to Optimization Designs for State Space Models [paper] (2024.05.04)
  • Demystify Mamba in Vision: A Linear Attention Perspective [paper] [code] (2024.05.26)
  • A Unified Implicit Attention Formulation for Gated-Linear Recurrent Sequence Models [paper] (2024.05.26)
  • The Expressive Capacity of State Space Models: A Formal Language Perspective [paper] (2024.05.27)
  • Unlocking the Secrets of Linear Complexity Sequence Model from A Unified Perspective [paper] (2024.05.27)
  • (ICML 2024) Transformers are SSMs: Generalized Models and Efficient Algorithms with Structured State Space Duality [paper] [poster] [code] (2024.05.31)
  • MambaLRP: Explaining Selective State Space Sequence Models [paper] (2024.06.11)

Vision

  • (ICML 2024) Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model [paper] [code] (2024.01.17)
  • VMamba: Visual State Space Model [paper] [code] (2024.01.18)
  • U-shaped Vision Mamba for Single Image Dehazing [paper] (2024.02.06)
  • Scalable Diffusion Models with State Space Backbone [paper] [code] (2024.02.08)
  • Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data [paper] (2024.02.08)
  • Pan-Mamba: Effective pan-sharpening with State Space Model [paper] (2024.02.19)
  • MambaIR: A Simple Baseline for Image Restoration with State-Space Model [paper] [code] (2024.02.23)
  • Res-VMamba: Fine-Grained Food Category Visual Classification Using Selective State Space Models with Deep Residual Learning [paper] [code] (2024.02.24)
  • MiM-ISTD: Mamba-in-Mamba for Efficient Infrared Small Target Detection [paper] [code] (2024.03.04)
  • Motion Mamba: Efficient and Long Sequence Motion Generation with Hierarchical and Bidirectional Selective SSM [paper] [code] (2024.03.12)
  • Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding [paper] [code] (2024.03.12)
  • LocalMamba: Visual State Space Model with Windowed Selective Scan [paper] [code] (2024.03.14)
  • EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba [paper] (2024.03.15)
  • VmambaIR: Visual State Space Model for Image Restoration [paper] [code] (2024.03.18)
  • ZigMa: Zigzag Mamba Diffusion Model [paper] [code] (2024.03.20)
  • SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series [paper] (2024.03.22)
  • VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting [paper] [code] (2024.03.25) (CVPR24 Precognition Workshop)
  • PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition [paper] [code] (2024.03.26)
  • ReMamber: Referring Image Segmentation with Mamba Twister [paper] (2024.03.26)
  • Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction [paper] (2024.03.27)
  • RSMamba: Remote Sensing Image Classification with State Space Model [paper] [code] (2024.03.28)
  • MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection [paper] (2024.03.29)
  • HSIMamba: Hyperpsectral Imaging Efficient Feature Learning with Bidirectional State Space for Classification [paper] (2024.03.30)
  • Samba: Semantic Segmentation of Remotely Sensed Images with State Space Model [paper] [code] (2024.04.02)
  • RS-Mamba for Large Remote Sensing Image Dense Prediction [paper] [code] (2024.04.03)
  • RS3Mamba: Visual State Space Model for Remote Sensing Images Semantic Segmentation [paper] (2024.04.03)
  • InsectMamba: Insect Pest Classification with State Space Model [paper] (2024.04.04)
  • ChangeMamba: Remote Sensing Change Detection with Spatio-Temporal State Space Model [paper] [code] (2024.04.04)
  • RhythmMamba: Fast Remote Physiological Measurement with Arbitrary Length Videos [paper] [code] (2024.04.09)
  • Simba: Mamba augmented U-ShiftGCN for Skeletal Action Recognition in Videos [paper] (2024.04.11)
  • FusionMamba: Efficient Image Fusion with State Space Model [paper] (2024.04.11)
  • DGMamba: Domain Generalization via Generalized State Space Model [paper] [code] (2024.04.11)
  • SpectralMamba: Efficient Mamba for Hyperspectral Image Classification [paper] (2024.04.12)
  • FreqMamba: Viewing Mamba from a Frequency Perspective for Image Deraining [paper] (2024.04.15)
  • HSIDMamba: Exploring Bidirectional State-Space Models for Hyperspectral Denoising [paper] (2024.04.15)
  • A Novel State Space Model with Local Enhancement and State Sharing for Image Fusion [paper] (2024.04.15)
  • FusionMamba: Dynamic Feature Enhancement for Multimodal Image Fusion with Mamba [paper] [code] (2024.04.15)
  • MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection [paper] [project] [code] (2024.04.15)
  • Text-controlled Motion Mamba: Text-Instructed Temporal Grounding of Human Motion [paper] (2024.04.17)
  • CU-Mamba: Selective State Space Models with Channel Learning for Image Restoration [paper] (2024.04.17)
  • MambaPupil: Bidirectional Selective Recurrent model for Event-based Eye tracking [paper] (2024.04.18)
  • MambaMOS: LiDAR-based 3D Moving Object Segmentation with Motion-aware State Space Model [paper] [code] (2024.04.19)
  • ST-SSMs: Spatial-Temporal Selective State of Space Model for Traffic Forecasting [paper] (2024.04.20)
  • MambaUIE&SR: Unraveling the Ocean's Secrets with Only 2.8 FLOPs [paper] [code] (2024.04.22)
  • ST-MambaSync: The Confluence of Mamba Structure and Spatio-Temporal Transformers for Precipitous Traffic Prediction [paper] (2024.04.24)
  • Spectral-Spatial Mamba for Hyperspectral Image Classification [paper] (2024.04.29)
  • CLIP-Mamba: CLIP Pretrained Mamba Models with OOD and Hessian Evaluation [paper] [code] (2024.04.30)
  • SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising [paper] [code] (2024.05.02)
  • FER-YOLO-Mamba: Facial Expression Detection and Classification Based on Selective State Space [paper] [code] (2024.05.03)
  • DVMSR: Distillated Vision Mamba for Efficient Super-Resolution [paper] [code] (2024.05.05)
  • Matten: Video Generation with Mamba-Attention [paper] (2024.05.05)
  • MemoryMamba: Memory-Augmented State Space Model for Defect Recognition [paper] (2024.05.06)
  • MambaJSCC: Deep Joint Source-Channel Coding with Visual State Space Model [paper] (2024.05.06)
  • Retinexmamba: Retinex-based Mamba for Low-light Image Enhancement [paper] [code] (2024.05.06)
  • SMCD: High Realism Motion Style Transfer via Mamba-based Diffusion [paper] (2024.05.06)
  • VMambaCC: A Visual State Space Model for Crowd Counting [paper] (2024.05.07)
  • Frequency-Assisted Mamba for Remote Sensing Image Super-Resolution [paper] (2024.05.08)
  • StyleMamba : State Space Model for Efficient Text-driven Image Style Transfer [paper] (2024.05.08)
  • MambaOut: Do We Really Need Mamba for Vision? [paper] [code] (2024.05.13)
  • OverlapMamba: Novel Shift State Space Model for LiDAR-based Place Recognition [paper] [code] (2024.05.13)
  • GMSR:Gradient-Guided Mamba for Spectral Reconstruction from RGB Images [paper] [code] (2024.05.13)
  • WaterMamba: Visual State Space Model for Underwater Image Enhancement [paper] (2024.05.14)
  • Rethinking Scanning Strategies with Vision Mamba in Semantic Segmentation of Remote Sensing Imagery: An Experimental Study [paper] (2024.05.14)
  • Multiscale Global Attention for Abnormal Geological Hazard Segmentation [paper] (2024.05.15)
  • IRSRMamba: Infrared Image Super-Resolution via Mamba-based Wavelet Transform Feature Modulation Model [paper] (2024.05.16)
  • RSDehamba: Lightweight Vision Mamba for Remote Sensing Satellite Image Dehazing [paper] (2024.05.16)
  • CM-UNet: Hybrid CNN-Mamba UNet for Remote Sensing Image Semantic Segmentation [paper] [code] (2024.05.17)
  • NetMamba: Efficient Network Traffic Classification via Pre-training Unidirectional Mamba [paper] (2024.05.19)
  • Mamba-in-Mamba: Centralized Mamba-Cross-Scan in Tokenized Mamba Model for Hyperspectral Image Classification [paper] (2024.05.20)
  • 3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification [paper] (2024.05.21)
  • Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Model [paper] [code] (2024.05.23)
  • Efficient Visual State Space Model for Image Deblurring [paper] (2024.05.23)
  • Scalable Visual State Space Model with Fractal Scanning [paper] (2024.05.23)
  • DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesis [paper] (2024.05.23)
  • Mamba-R: Vision Mamba ALSO Needs Registers [paper] [code] [project] (2024.05.23)
  • MambaVC: Learned Visual Compression with Selective State Spaces [paper] [code] (2024.05.24)
  • Scaling Diffusion Mamba with Bidirectional SSMs for Efficient Image and Video Generation [paper] (2024.05.24)
  • MambaLLIE: Implicit Retinex-Aware Low Light Enhancement with Global-then-Local State Space [paper] (2024.05.25)
  • Image Deraining with Frequency-Enhanced State Space Model [paper] (2024.05.26)
  • Demystify Mamba in Vision: A Linear Attention Perspective [paper] [code] (2024.05.26)
  • Vim-F: Visual State Space Model Benefiting from Learning in the Frequency Domain [paper] [code] (2024.05.29)
  • FourierMamba: Fourier Learning Integration with State Space Models for Image Deraining [paper] (2024.05.29)
  • DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmark [paper] [code] (2024.05.30)
  • Dual Hyperspectral Mamba for Efficient Spectral Compressive Imaging [paper] (2024.06.01)
  • LLEMamba: Low-Light Enhancement via Relighting-Guided Mamba with Deep Unfolding Network [paper] (2024.06.03)
  • GrootVL: Tree Topology is All You Need in State Space Model [paper] [code] (2024.06.04)
  • Feasibility of State Space Models for Network Traffic Generation [paper] (2024.06.04)
  • Rethinking Spiking Neural Networks as State Space Models [paper] (2024.06.05)
  • Learning 1D Causal Visual Representation with De-focus Attention Networks [paper] (2024.06.06)
  • MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimation [paper] (2024.06.06)
  • Efficient 3D Shape Generation via Diffusion Mamba with Bidirectional SSMs [paper] (2024.06.07)
  • Mamba YOLO: SSMs-Based YOLO For Object Detection [paper] [code] (2024.06.09)
  • HDMba: Hyperspectral Remote Sensing Imagery Dehazing with State Space Model [paper] [code] (2024.06.09)
  • MVGamba: Unify 3D Content Generation as State Space Sequence Modeling [paper] (2024.06.10)
  • MHS-VM: Multi-Head Scanning in Parallel Subspaces for Vision Mamba [paper] (2024.06.10)
  • DualMamba: A Lightweight Spectral-Spatial Mamba-Convolution Network for Hyperspectral Image Classification [paper] (2024.06.11)
  • Autoregressive Pretraining with Mamba in Vision [paper] [code] (2024.06.11)
  • PixMamba: Leveraging State Space Models in a Dual-Level Architecture for Underwater Image Enhancement [paper] [code] (2024.06.12)
  • PyramidMamba: Rethinking Pyramid Feature Fusion with Selective Space State Model for Semantic Segmentation of Remote Sensing Imagery [paper] (2024.06.16)
  • LFMamba: Light Field Image Super-Resolution with State Space Model [paper] (2024.06.18)
  • Slot State Space Models [paper] (2024.06.18)
  • SEDMamba: Enhancing Selective State Space Modelling with Bottleneck Mechanism and Fine-to-Coarse Temporal Fusion for Efficient Error Detection in Robot-Assisted Surgery [paper] (2024.06.22)
  • Soft Masked Mamba Diffusion Model for CT to MRI Conversion [paper] [code] (2024.06.22)
  • SUM: Saliency Unification through Mamba for Visual Attention Modeling [paper] [code] (2024.06.25)
  • VideoMambaPro: A Leap Forward for Mamba in Video Understanding [paper] (2024.06.27)

Language

  • MambaByte: Token-free Selective State Space Model [paper] [code] (2024.01.24)
  • Is Mamba Capable of In-Context Learning? [paper] (2024.02.05)
  • (ICML 2024) Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks [paper] (2024.02.06)
  • SpaceByte: Towards Deleting Tokenization from Large Language Modeling [paper] (2024.04.22)
  • State-Free Inference of State-Space Models: The Transfer Function Approach [paper] (2024.05.10)
  • Mamba4KT:An Efficient and Effective Mamba-based Knowledge Tracing Model [paper] (2024.05.26)
  • Zamba: A Compact 7B SSM Hybrid Model [paper] (2024.05.26)
  • State Space Models are Comparable to Transformers in Estimating Functions with Dynamic Smoothness [paper] (2024.05.29)
  • Mamba State-Space Models Can Be Strong Downstream Learners [paper] (2024.05.30)
  • Learning to Estimate System Specifications in Linear Temporal Logic using Transformers and Mamba [paper] (2024.05.31)
  • Pretrained Hybrids with MAD Skills [paper] (2024.06.02)
  • LongSSM: On the Length Extension of State-space Models in Language Modelling [paper] (2024.06.04)
  • Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling [paper] [code] (2024.06.04)
  • State Soup: In-Context Skill Learning, Retrieval and Mixing [paper] (2024.06.12)
  • An Empirical Study of Mamba-based Language Models [paper] (2024.06.12)
  • DeciMamba: Exploring the Length Extrapolation Potential of Mamba [paper] [code] (2024.06.20)

Multi-Modal

  • VL-Mamba: Exploring State Space Models for Multimodal Learning [paper] [code] (2024.03.20)
  • Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference [paper] [code] (2024.03.21)
  • SpikeMba: Multi-Modal Spiking Saliency Mamba for Temporal Video Grounding [paper] (2024.04.01)
  • Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation [paper] [code] (2024.04.04)
  • SurvMamba: State Space Model with Multi-grained Multi-modal Interaction for Survival Prediction [paper] (2024.04.11)
  • MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion [paper] (2024.04.12)
  • Fusion-Mamba for Cross-modality Object Detection [paper] (2024.04.14)
  • CFMW: Cross-modality Fusion Mamba for Multispectral Object Detection under Adverse Weather Conditions [paper] [code] (2024.04.25)
  • Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models [paper] [code] (2024.05.24)
  • Coupled Mamba: Enhanced Multi-modal Fusion with Coupled State Space Model [paper] (2024.05.28)
  • S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusion [paper] (2024.05.31)
  • SHMamba: Structured Hyperbolic State Space Model for Audio-Visual Question Answering [paper] (2024.06.14)

Diffusion

  • Scalable Diffusion Models with State Space Backbone [paper] [code] (2024.02.08)
  • P-Mamba: Marrying Perona Malik Diffusion with Mamba for Efficient Pediatric Echocardiographic Left Ventricular Segmentation [paper] (2024.02.13)
  • MD-Dose: A Diffusion Model based on the Mamba for Radiotherapy Dose Prediction [paper] [code] (2024.03.13)
  • ZigMa: Zigzag Mamba Diffusion Model [paper] [code] (2024.03.20)
  • SMCD: High Realism Motion Style Transfer via Mamba-based Diffusion [paper] (2024.05.06)
  • VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesis [paper] (2024.05.09)
  • DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesis [paper] (2024.05.23)
  • UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation [paper] [code] (2024.06.03)
  • Dimba: Transformer-Mamba Diffusion Models [paper] (2024.06.03)

Medical

  • U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation [paper] [code] [dataset] [homepage] (2024.01.09)

  • SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentation [paper] [code] (2024.01.24)

  • MambaMorph: a Mamba-based Backbone with Contrastive Feature Learning for Deformable MR-CT Registration [paper] [code] (2024.01.24)

  • Vivim: a Video Vision Mamba for Medical Video Object Segmentation [paper] [code] (2024.01.25)

  • VM-UNet: Vision Mamba UNet for Medical Image Segmentation [paper] [code] (2024.02.04)

  • Swin-UMamba: Mamba-based UNet with ImageNet-based pretraining [paper] [code] (2024.02.05)

  • nnMamba: 3D Biomedical Image Segmentation, Classification and Landmark Detection with State Space Model [paper] [code] (2024.02.05)

  • Mamba-UNet: UNet-Like Pure Visual Mamba for Medical Image Segmentation [paper] [code] (2024.02.07)

  • FD-Vision Mamba for Endoscopic Exposure Correction [paper] (2024.02.09)

  • Semi-Mamba-UNet: Pixel-Level Contrastive Cross-Supervised Visual Mamba-based UNet for Semi-Supervised Medical Image Segmentation [paper] [code] (2024.02.11)

  • P-Mamba: Marrying Perona Malik Diffusion with Mamba for Efficient Pediatric Echocardiographic Left Ventricular Segmentation [paper] (2024.02.13)

  • Weak-Mamba-UNet: Visual Mamba Makes CNN and ViT Work Better for Scribble-based Medical Image Segmentation [paper] [code] (2024.02.16)

  • MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation [paper] (2024.02.28)

  • A PTM-Aware Protein Language Model with Bidirectional Gated Mamba Blocks

    [Paper] [Huggingface] [code] (2024.02.28)

  • MedMamba: Vision Mamba for Medical Image Classification [paper] [code] (2024.03.06)

  • Motion-Guided Dual-Camera Tracker for Low-Cost Skill Evaluation of Gastric Endoscopy [paper] (2024.03.08)

  • MamMIL: Multiple Instance Learning for Whole Slide Images with State Space Models [paper] (2024.03.08)

  • LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation [paper] [code] (2024.03.08)

  • ClinicalMamba: A Generative Clinical Language Model on Longitudinal Clinical Notes [paper] (2024.03.09)

  • Large Window-based Mamba UNet for Medical Image Segmentation: Beyond Convolution and Self-attention [paper] [code] (2024.03.12)

  • MD-Dose: A Diffusion Model based on the Mamba for Radiotherapy Dose Prediction [paper] [code] (2024.03.13)

  • VM-UNET-V2 Rethinking Vision Mamba UNet for Medical Image Segmentation [paper] [code] (2024.03.14)

  • H-vmunet: High-order Vision Mamba UNet for Medical Image Segmentation [paper] [code] (2024.03.20)

  • ProMamba: Prompt-Mamba for polyp segmentation [paper] (2024.03.20)

  • UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentation [paper] [code] (2024.03.29)

  • VMambaMorph: a Visual Mamba-based Framework with Cross-Scan Module for Deformable 3D Image Registration [paper] (2024.04.07)

  • Vim4Path: Self-Supervised Vision Mamba for Histopathology Images [paper] [code] (2024.04.20)

  • Sparse Reconstruction of Optical Doppler Tomography Based on State Space Model [paper] (2024.04.26)

  • AC-MAMBASEG: An adaptive convolution and Mamba-based architecture for enhanced skin lesion segmentation [paper] [code] (2024.05.05)

  • HC-Mamba: Vision MAMBA with Hybrid Convolutional Techniques for Medical Image Segmentation [paper] (2024.05.08)

  • VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesis [paper] (2024.05.09)

  • I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling [paper] [code] (2024.05.22)

  • EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Records [paper] (2024.05.23)

  • MUCM-Net: A Mamba Powered UCM-Net for Skin Lesion Segmentation [paper] [code] (2024.05.24)

  • UU-Mamba: Uncertainty-aware U-Mamba for Cardiac Image Segmentation [paper] (2024.05.25)

  • Enhancing Global Sensitivity and Uncertainty Quantification in Medical Image Reconstruction with Monte Carlo Arbitrary-Masked Mamba [paper] (2024.05.27)

  • Cardiovascular Disease Detection from Multi-View Chest X-rays with BI-Mamba [paper] (2024.05.28)

  • fMRI predictors based on language models of increasing complexity recover brain left lateralization [paper] [code] (2024.05.28)

  • SAM-VMNet: Deep Neural Networks For Coronary Angiography Vessel Segmentation [paper] (2024.06.01)

  • Combining Graph Neural Network and Mamba to Capture Local and Global Tissue Spatial Relationships in Whole Slide Images [paper] [code] (2024.06.05)

  • Convolution and Attention-Free Mamba-based Cardiac Image Segmentation [paper] (2024.06.09)

  • MMR-Mamba: Multi-Contrast MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion [paper] (2024.06.27)

Tabular Data

  • MambaTab: A Simple Yet Effective Approach for Handling Tabular Data [paper] (2024.01.16)

Graph

  • Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spaces [paper] [code] (2024.02.01)
  • Graph Mamba: Towards Learning on Graphs with State Space Models [paper] [code] (2024.02.13)
  • STG-Mamba: Spatial-Temporal Graph Learning via Selective State Space Model [paper] (2024.03.19)
  • HeteGraph-Mamba: Heterogeneous Graph Learning via Selective State Space Model [paper] (2024.05.22)
  • State Space Models on Temporal Graphs: A First-Principles Study [paper] (2024.06.03)
  • Learning Long Range Dependencies on Graphs via Random Walks [paper] [code] (2024.06.05)
  • What Can We Learn from State Space Models for Machine Learning on Graphs? [paper] [code] (2024.06.09)
  • SpoT-Mamba: Learning Long-Range Dependency on Spatio-Temporal Graphs with Selective State Spaces [paper] [code] (2024.06.17)

Point Cloud

  • PointMamba: A Simple State Space Model for Point Cloud Analysis [paper] (2024.02.16)
  • Point Could Mamba: Point Cloud Learning via State Space Model [paper] [code] (2024.03.01)
  • 3DMambaIPF: A State Space Model for Iterative Point Cloud Filtering via Differentiable Rendering [paper] (2024.04.08)
  • 3DMambaComplete: Exploring Structured State Space Model for Point Cloud Completion [paper] (2024.04.10)
  • Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model [paper] [code] (2024.04.23)
  • MAMBA4D: Efficient Long-Sequence Point Cloud Video Understanding with Disentangled Spatial-Temporal State Space Models [paper] (2024.05.23)
  • PoinTramba: A Hybrid Transformer-Mamba Framework for Point Cloud Analysis [paper] [code] (2024.05.24)
  • LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling [paper] (2024.05.27)
  • PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysis [paper] (2024.06.10)
  • Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detection [paper] (2024.06.15)
  • Mamba24/8D: Enhancing Global Interaction in Point Clouds via State Space Model [paper] (2024.06.25)

Time Series

  • Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling [paper] [code] [homepage] (2024.02.15)
  • MambaStock: Selective state space model for stock prediction [paper] [code] (2024.02.29)
  • MambaLithium: Selective state space model for remaining-useful-life, state-of-health, and state-of-charge estimation of lithium-ion batteries [paper] [code] (2024.03.08)
  • TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting [paper] [code] (2024.03.14)
  • Is Mamba Effective for Time Series Forecasting? [paper] [code] (2024.03.17)
  • SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series [paper] (2024.03.22)
  • MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection [paper] [project] (2024.03.29)
  • HARMamba: Efficient Wearable Sensor Human Activity Recognition Based on Bidirectional Selective SSM [paper] (2024.03.29)
  • Integrating Mamba and Transformer for Long-Short Range Time Series Forecasting [paper] [code] (2024.04.23)
  • Bi-Mamba4TS: Bidirectional Mamba for Time Series Forecasting [paper] [code] (2024.04.24)
  • MAMCA -- Optimal on Accuracy and Efficiency for Automatic Modulation Classification with Extended Signal Length [paper] [code] (2024.05.18)
  • Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecasting [paper] (2024.05.25)
  • MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting [paper] [code] (2024.05.26)
  • Efficient Time Series Processing for Transformers and State-Space Models through Token Merging [paper] (2024.05.28)
  • Joint Selective State Space Model and Detrending for Robust Time Series Anomaly Detection [paper] (2024.05.30)
  • MSSC-BiMamba: Multimodal Sleep Stage Classification and Early Diagnosis of Sleep Disorders with Bidirectional Mamba [paper] (2024.05.30)
  • Chimera: Effectively Modeling Multivariate Time Series with 2-Dimensional State Space Models [paper] (2024.06.06)
  • TSCMamba: Mamba Meets Multi-View Learning for Time Series Classification [paper] (2024.06.06)
  • C-Mamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecasting [paper] (2024.06.08)
  • ECGMamba: Towards Efficient ECG Classification with BiSSM [paper] (2024.06.14)

Speech

  • Multichannel Long-Term Streaming Neural Speech Enhancement for Static and Moving Speakers [paper] [code] (2024.03.12)
  • Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separation [paper] (2024.03.27)
  • Multichannel Long-Term Streaming Neural Speech Enhancement for Static and Moving Speakers [paper] [code] (2024.03.27)
  • SPMamba: State-space model is all you need in speech separation [paper] [code] (2024.04.02)
  • TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platforms [paper] (2024.05.02)
  • An Investigation of Incorporating Mamba for Speech Enhancement [paper] (2024.05.10)
  • SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model [paper] (2024.05.20)
  • Mamba in Speech: Towards an Alternative to Self-Attention [paper] (2024.05.21)
  • Audio Mamba: Pretrained Audio State Space Model For Audio Tagging [paper] (2024.05.22)
  • Audio Mamba: Selective State Spaces for Self-Supervised Audio Representations [paper] [code] (2024.06.04)
  • Audio Mamba: Bidirectional State Space Model for Audio Representation Learning [paper] [code] (2024.06.05)
  • RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection [paper] (2024.06.10)
  • Exploring the Capability of Mamba in Speech Applications [paper] (2024.06.24)

Recommendation

  • Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Models [paper] [code] (2024.03.06)
  • Uncovering Selective State Space Model's Capabilities in Lifelong Sequential Recommendation [paper] [code] (2024.03.25)
  • EchoMamba4Rec: Harmonizing Bidirectional State Space Models with Spectral Filtering for Advanced Sequential Recommendation [paper] (2024.06.04)
  • (WSDM 2024) Behavior-Dependent Linear Recurrent Units for Efficient Sequential Recommendation [paper] [code] (2024.06.18)

Reinforcement Learning

  • Decision Mamba: Reinforcement Learning via Sequence Modeling with Selective State Spaces [paper] [code] (2024.03.29)
  • Hierarchical Decision Mamba [paper] [code] (2024.05.13)
  • Is Mamba Compatible with Trajectory Optimization in Offline Reinforcement Learning? [paper] (2024.05.20)
  • Deciphering Movement: Unified Trajectory Generation Model for Multi-Agent [paper] [code] (2024.05.27)
  • Decision Mamba: Reinforcement Learning via Hybrid Selective Sequence Modeling [paper] (2024.05.31)
  • Mamba as Decision Maker: Exploring Multi-scale Sequence Modeling in Offline Reinforcement Learning [paper] [code] (2024.06.04)
  • RoboMamba: Multimodal State Space Model for Efficient Robot Reasoning and Manipulation [paper] [code] (2024.06.06)
  • Decision Mamba: A Multi-Grained State Space Model with Self-Evolution Regularization for Offline RL [paper] (2024.06.08)
  • MaIL: Improving Imitation Learning with Mamba [paper] (2024.06.12)
  • KalMamba: Towards Efficient Probabilistic State Space Models for RL under Uncertainty [paper] (2024.06.21)

Survey

  • State Space Model for New-Generation Network Alternative to Transformers: A Survey [paper] [project] (2024.04.15)
  • Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges [paper] [project] (2024.04.24)
  • A Survey on Visual Mamba [paper] (2024.04.24)
  • A Survey on Vision Mamba: Models, Applications and Challenges [paper] [project] (2024.04.29)
  • Vision Mamba: A Comprehensive Survey and Taxonomy [paper] [project] (2024.05.07)
  • Surveying Image Segmentation Approaches in Astronomy [paper] (2024.05.23)

Tutorials

Blogs

  • The Annotated S4 [URL]
  • The Annotated Mamba [URL]
  • A Visual Guide to Mamba and State Space Models [URL]
  • Mamba No. 5 (A Little Bit Of...) [URL]
  • State Space Duality (Mamba-2) [PART1] [PART2] [PART3] [PART4]

Videos

  • S4: Efficiently Modeling Long Sequences with Structured State Spaces | Albert Gu [URL]
  • Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math [URL]
  • MAMBA from Scratch: Neural Nets Better and Faster than Transformers [URL]

Books

  • Linear State‐Space Control Systems [URL]
  • Modeling sequences with structured state spaces [URL]

Codes

  • The official Mamba Repository is currently only available for Linux. [URL]
  • If you are searching for a runnable implementation not focused on speed,
    • mamba-minimal: Simple, minimal implementation of the Mamba SSM in one file of PyTorch. [URL]
    • mamba.py: An efficient Mamba implementation in PyTorch and MLX. [URL]

Other Awesome Mamba List

  • awesome-ssm-ml [URL]
  • Awesome-Mamba: Collect papers about Mamba [URL]
  • Awesome-Mamba-Papers [URL]
  • Awesome-Mamba [URL]

Contributions

🎉 Thank you for considering contributing to our Awesome Mamba Collection repository! 🚀

Contribute in 3 Steps

  1. Fork the Repo: Fork this repo to your GitHub account.
  2. Edit Content: Contribute by adding new resources or improving existing content in the README.md file.
  3. Create a Pull Request: Open a pull request (PR) from your branch to the main repository.

Guidelines

  • Follow the existing structure and formatting.
  • Ensure added resources are relevant to State Space Models in Machine Learning.
  • Verify that links work correctly.

Acknowledgement

Thanks the template from Awesome-Visual-Transformer and Awesome State-Space Resources for ML