Skip to content

Latest commit

 

History

History
493 lines (446 loc) · 54 KB

File metadata and controls

493 lines (446 loc) · 54 KB

Neural-Architecture-Search-PaperAndCode-Sunmary

This repository collects recent NAS based methods and provide a summary (Paper and Code) by year and task. We hope this repo can help you better understand the trend of NAS era.


Change

🔥 Add 1 NIPS paper 2022


Content


2022

Object Classfication/Detection

Name Pub. Title Links
BMNAS AAAI Bilevel Multimodal Neural Architecture Search Paper/Code
DPNAS AAAI Neural Architecture Search for Deep Learning with Differential Privacy Paper/Code
LFMNAS AAAI Learning from Mistakes - A Framework for Neural Architecture Search Paper/Code
ArchGraph CVPR Acyclic Architecture Relation Predictor for Task-Transferable Neural Architecture Search Paper/Code
PAMKD CVPR Performance-Aware Mutual Knowledge Distillation for Improving Neural Architecture Search Paper/Code
BaLeNAS CVPR Differentiable Architecture Search via the Bayesian Learning Rule Paper/Code
LGA CVPR Demystifying the Neural Tangent Kernel from a Practical Perspective: Can it be trusted for Neural Architecture Search without training? Paper/Code
TFTAS CVPR Training-free Transformer Architecture Search Paper/Code
β-DARTS CVPR Beta-Decay Regularization for Differentiable Architecture Search Paper/Code
MetaNTK-NAS CVPR Global Convergence of MAML and Theory-Inspired Neural Architecture Search for Few-Shot Learning Paper/Code
GreedyNASv2 CVPR Greedier Search with a Greedy Path Filter Paper/Code
RMI-NAS CVPR Neural Architecture Search with Representation Mutual Information Paper/Code
Shapley-NAS CVPR Discovering Operation Contribution for Neural Architecture Search Paper/Code
GPUNet CVPR Searching the Deployable Convolution Neural Networks for GPUs Paper/Code
ViT-Slim CVPR Multi-Dimension Searching in Continuous Optimization Space Paper/Code
SUMNAS ICLR SUMNAS: Supernet with Unbiased Meta-Features for Neural Architecture Search Paper/Code
NASViT ICLR Neural Architecture Search for Efficient Vision Transformers with Gradient Conflict aware Supernet Training Paper/Code
ASViT ICLR Auto-scaling Vision Transformers without Training Paper/Code
GMNAS ICLR Generalizing Few-Shot NAS with Gradient Matching Paper/Code
ScaleNet ECCV Searching for the Model to Scale Paper/Code
SNNNAS ECCV Neural Architecture Search for Spiking Neural Networks Paper/Code
EAutoDet ECCV Efficient Architecture Search for Object Detection Paper/Code
U-BoostNAS ECCV Utilization-Boosted Differentiable Neural Architecture Search Paper/Code
SuperTickets ECCV Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning Paper/Code
DistPro ECCV Searching A Fast Knowledge Distillation Process via Meta Optimization Paper/Code
EKG ECCV Ensemble Knowledge Guided Sub-network Search and Fine-tuning for Filter Pruning Paper/Code
EAGAN ECCV Efficient Two-stage Evolutionary Architecture Search for GANs Paper/Code
ViTAS ECCV Vision Transformer Architecture Search Paper/Code
DFNAS ECCV Data-Free Neural Architecture Search via Recursive Label Calibration Paper/Code
BaLeNAS ECCV Differentiable Architecture Search via the Bayesian Learning Rule Paper/Code

Stereo Matching

Name Pub. Title Links
EASNet ECCV Searching Elastic and Accurate Network Architecture for Stereo Matching Paper/Code

Image Super Resolution

Name Pub. Title Links
CANAS ECCV Compiler-Aware Neural Architecture Search for On-Mobile Real-time Super-Resolution Paper/Code

3D Point Clouds

Name Pub. Title Links
LidarNAS ECCV Unifying and Searching Neural Architectures for 3D Point Clouds Paper/Code

Medical

Name Pub. Title Links
HyperSegNAS CVPR Bridging One-Shot Neural Architecture Search with 3D Medical Image Segmentation using HyperNet Paper/Code

Deep Image Prior

Name Pub. Title Links
ISNAS CVPR Image-Specific Neural Architecture Search for Deep Image Prior Paper/Code

Image Restoration

Name Pub. Title Links
- ECCV Spectrum-aware and Transferable Architecture Search for Hyperspectral Image Restoration Paper/Code

Multi Task

Name Pub. Title Links
🔥AutoMTL NeurIPS A Programming Framework for Automating Efficient Multi-Task Learning Paper/Code

Loss Function

Name Pub. Title Links
AutoLossZero CVPR Searching Loss Functions from Scratch for Generic Tasks Paper/Code
AutoLossGMS CVPR Searching Generalized Margin-based Softmax Loss Function for Person Re-identification Paper/Code

2021

Object Classfication/Detection

Name Pub. Title Links
NASTransfer AAAI NASTransfer: Analyzing Architecture Transferability in Large Scale Neural Architecture Search Paper/Code
BCNet CVPR Searching for Network Width with Bilaterally Coupled Network Paper/Code
FPNAS CVPR Fast Probabilistic Neural Architecture Search Paper/Code
TransNAS CVPR Improving Transferability and Generalizability of Cross-Task Neural Architecture Search Paper/Code
JointDetNAS CVPR Upgrade Your Detector with NAS, Pruning and Dynamic Distillation Paper/Code
LR CVPR Landmark Regularization: Ranking Guided Super-Net Training in Neural Architecture Search Paper/Code
NetAdaptV2 CVPR Efficient Neural Architecture Search with Fast Super-Network Training and Architecture Optimization Paper/Code
NEAS CVPR One-Shot Neural Ensemble Architecture Search by Diversity-Guided Search Space Shrinking Paper/Code
DSNet CVPR Dynamic Slimmable Network Paper/Code
PASNAS CVPR Prioritized Architecture Sampling with Monto-Carlo Tree Search Paper/Code
CTNAS CVPR Contrastive Neural Architecture Search with Neural Architecture Comparators Paper/Code
OPANAS CVPR One-Shot Path Aggregation Network Architecture Search for Object Detection Paper/Code
AttentiveNAS CVPR Improving Neural Architecture Search via Attentive Sampling Paper/Code
ReNAS CVPR Relativistic Evaluation of Neural Architecture Search Paper/Code
HourNAS CVPR Extremely Fast Neural Architecture Paper/Code
ICConv CVPR Inception Convolution with Efficient Dilation Search Paper/Code
TE-NAS ICLR Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective Paper/Code
DrNAS ICLR Dirichlet Neural Architecture Search Paper/Code
PiNAS ICCV Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift Paper/Code
FairNAS ICCV Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search Paper/Code
GLiT ICCV Neural Architecture Search for Global and Local Image Transformer Paper/Code
BNNAS ICCV Neural Architecture Search with Batch Normalization Paper/Code
DONNA ICCV Distilling Optimal Neural Networks: Rapid Search in Diverse Spaces Paper/Code
HOP ICCV Not All Operations Contribute Equally: Hierarchical Operation-adaptive Predictor for Neural Architecture Search Paper/Code
VIMNAS ICCV Learning Latent Architectural Distribution in Differentiable Neural Architecture Search via Variational Information Maximization Paper/Code
DDAS ICCV Direct Differentiable Augmentation Search Paper/Code
BossNAS ICCV Exploring Hybrid CNN-transformers with Block-wisely Self-supervised Neural Architecture Search Paper/Code
NAS-OoD ICCV Neural Architecture Search for Out-of-Distribution Generalization Paper/Code
IDARTS ICCV Interactive Differentiable Architecture Search Paper/Code
AutoSpace ICCV Neural Architecture Search with Less Human Interference Paper/Code
NSENAS ICCV Evolving Search Space for Neural Architecture Search Paper/Code
MNNAS ICCV Meta Navigator:Search for a Good Adaptation Policy for Few-shot Learning Paper/Code
OQATNets ICCV Once Quantization-Aware Training: High Performance Extremely Low-bit Architecture Search Paper/Code
AutoFormer: ICCV Searching Transformers for Visual Recognition Paper/Code
NASLib: NeurIPS How Powerful are Performance Predictors in Neural Architecture Search? Paper/Code
TANS: NeurIPS Task-Adaptive Neural Network Search with Meta-Contrastive Learning Paper/Code
AutoGL NeurIPS Graph Differentiable Architecture Search with Structure Learning Paper/Code
AutoFormerV2 NeurIPS Searching the Search Space of Vision Transformer Paper/Code
TSE NeurIPS Speedy Performance Estimation for Neural Architecture Search Paper/Code
FNA++ TPAMI Fast Network Adaptation via Parameter Remapping and Architecture Search Paper/Code

Image Segmentation

Name Pub. Title Links
DCNAS CVPR Densely Connected Neural Architecture Search for Semantic Image Segmentation Paper/Code
AutoRTNet IJCV Real-Time Semantic Segmentation via Auto Depth, Downsampling Joint Decision and Feature Aggregation Paper/Code

Video Action Segmentation

Name Pub. Title Links
Global2Local CVPR Efficient Structure Search for Video Action Segmentation Paper/Code

Video Recognition

Name Pub. Title Links
AutoTSNet ICCV Searching for Two-Stream Models in Multivariate Space for Video Recognition Paper/Code

Model Pruning

Name Pub. Title Links
RTSRNAS ICCV Achieving on-Mobile Real-Time Super-Resolution with Neural Architecture and Pruning Search Paper/Code

Point Cloud

Name Pub. Title Links
PointSeaNet ICCV Differentiable Convolution Search for Point Cloud Processing Paper/Code

Medical

Name Pub. Title Links
DiNTS CVPR Differentiable Neural Network Topology Search for 3D Medical Image Segmentation Paper/Code

Re-Identification/Detection

Name Pub. Title Links
CDS CVPR Combined Depth Space based Architecture Search For Person Re-identification Paper/Code
NFS CVPR Neural Feature Search for RGB-Infrared Person Re-Identification Paper/Code
CMNAS ICCV Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification Paper/Code

Adversarial Attack

Name Pub. Title Links
AdvRush ICCV Searching for Adversarially Robust Neural Architectures Paper/Code

Image Restoration

Name Pub. Title Links
TASNet ICCV Searching for Controllable Image Restoration Networks Paper/Code

Image Deblurring

Name Pub. Title Links
PyNAS ICCV Pyramid Architecture Search for Real-Time Image Deblurring Paper/Code

Pose Estimation

Name Pub. Title Links
NPPNet ICCV Neural Architecture Search for Joint Human Parsing and Pose Estimation Paper/Code

Video Pose Estimation

Name Pub. Title Links
ViPNAS CVPR Efficient Video Pose Estimation via Neural Architecture Search Paper/Code

Loss Function

Name Pub. Title Links
AutoLoss ICLR Loss Function Discovery for Object Detection via Convergence-Simulation Driven Search Paper/Code
AutoSeg-Loss: ICLR Searching Metric Surrogates for Semantic Segmentation Paper/Code
AutoBalance NeurIP Optimized Loss Functions for Imbalanced Data Paper/Code
APNAS NeurIP Searching Parameterized AP Loss for Object Detection Paper/Code

2020

Object Classfication/Detection

Name Pub. Title Links
SMNAS AAAI SM-NAS: Structural-to-Modular Neural Architecture Search for Object Detection Paper/Code
KDNAS AAAI Towards Oracle Knowledge Distillation with Neural Architecture Search Paper/Code
NASP AAAI Efficient Neural Architecture Search via Proximal Iterations Paper/Code
AlphaX AAAI Neural Architecture Search using Deep Neural Networks and Monte Carlo Tree Search Paper/Code
BNAS AAAI Binarized Neural Architecture Search Paper/Code
InstaNAS AAAI Instance-aware Neural Architecture Search Paper/Code
PGNAS AAAI Posterior-Guided Neural Architecture Search Paper/Code
CR-NAS ICLR Computation Reallocation for Object Detectionh Paper/Code
OFANAS ICLR Once for All: Train One Network and Specialize it for Efficient Deployment Paper/Code
PC-DARTS ICLR PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search Paper/Code
AtomNAS ICLR Fine-Grained End-to-End Neural Architecture Search Paper/Code
HitDetector CVPR Hierarchical Trinity Architecture Search for Object Detection Paper/Code
CARS CVPR Continuous Evolution for Efficient Neural Architecture Search Paper/Code
TuNAS CVPR Can weight sharing outperform random architecture search? An investigation with TuNAS Paper/Code
AOWS CVPR Adaptive and optimal network width search with latency constraints Paper/Code
RDS CVPR Rethinking Differentiable Search for Mixed-Precision Neural Networks Paper/Code
Adnet CVPR Network Adjustment: Channel Search Guided by FLOPs Utilization Ratio Paper/Code
AdverNAS CVPR Network Adjustment: Channel Search Guided by FLOPs Utilization Ratio Paper/Code
MTLNAS CVPR Task-Agnostic Neural Architecture Search towards General-Purpose Multi-Task Learning Paper/Code
MiLeNAS CVPR Efficient Neural Architecture Search via Mixed-Level Reformulation Paper/Code
DSNAS CVPR Direct Neural Architecture Search without Parameter Retraining Paper/Code
SPNAS CVPR Serial-to-Parallel Backbone Search for Object Detection Paper/Code
DNA CVPR Block-wisely Supervised Neural Architecture Search with Knowledge Distillation Paper/Code
GPNAS CVPR Gaussian Process based Neural Architecture Search Paper/Code
AutoNL CVPR Neural Architecture Search for Lightweight Non-Local Networks Paper/Code
SGAS CVPR Sequential Greedy Architecture Search Paper/Code
MemNAS CVPR Memory-Efficient Neural Architecture Search with Grow-Trim Learning Paper/Code
AKD CVPR Search to Distill: Pearls are Everywhere but not the Eyes Paper/Code
UNAS CVPR Differentiable Architecture Search Meets Reinforcement Learning Paper/Code
FBNetV2 CVPR Differentiable Neural Architecture Search for Spatial and Channel Dimensions Paper/Code
EcoNAS CVPR Finding Proxies for Economical Neural Architecture Search Paper/Code
DenseNAS CVPR Densely Connected Search Space for More Flexible Neural Architecture Search Paper/Code
NSGANetV2 ECCV Evolutionary Multi-Objective Surrogate-Assisted Neural Architecture Search Paper/Code
S2DNAS ECCV Transforming Static CNN Model for Dynamic Inference via Neural Architecture Search Paper/Code
UnNAS ECCV Are Labels Necessary for Neural Architecture Search? Paper/Code
E2GAN ECCV Off-Policy Reinforcement Learning for Efficient and Effective GAN Architecture Search Paper/Code
BigNAS ECCV Scaling Up Neural Architecture Search with Big Single-Stage Models Paper/Code
BPNAS ECCV Search What You Want: Barrier Panelty NAS for Mixed Precision Quantization Paper/Code
TFNAS ECCV Rethinking Three Search Freedoms of Latency-Constrained Differentiable Neural Architecture Search Paper/Code
FairDarts ECCV Eliminating Unfair Advantages in Differentiable Architecture Search Paper/Code
SingleNAS ECCV Single Path One-Shot Neural Architecture Search with Uniform Sampling Paper/Code
DFA ECCV Differentiable Feature Aggregation Search for Knowledge Distillation Paper/Code
ABS ECCV Angle-based Search Space Shrinking for Neural Architecture Search Paper/Code
FAD ECCV Representation Sharing for Fast Object Detector Search and Beyond Paper/Code
BATS ECCV Binary ArchitecTure Search Paper/Code
DANAS ECCV Data Adapted Pruning for Efficient Neural Architecture Search Paper/Code
NPNAS ECCV Neural Predictor for Neural Architecture Search Paper/Code
CreamNAS NeurIPS Cream of the Crop: Distilling Prioritized Paths For One-Shot Neural Architecture Search Paper/Code
ISTA-NAS NeurIPS Efficient and Consistent Neural Architecture Search by Sparse Coding Paper/Code
E2NAS NeurIPS Differentiable Neural Architecture Search in Equivalent Space with Exploration Enhancement Paper/Code
SemiNAS NeurIPS Semi-Supervised Neural Architecture Search Paper/Code
Arch2vec NeurIPS Does Unsupervised Architecture Representation Learning Help Neural Architecture Search? Paper/Code
BONAS NeurIPS Bridging the Gap between Sample-based and One-shot Neural Architecture Search with BONAS Paper/Code

Image Segmentation

Name Pub. Title Links
GAS CVPR Graph-guided Architecture Search for Real-time Semantic Segmentation Paper/Code
FasterSeg ICLR Searching for Faster Real-time Semantic Segmentation Paper/Code
Auto-Panoptic NeurIPS Cooperative Multi-Component Architecture Search for Panoptic Segmentation Paper/Code

Video Classification

Name Pub. Title Links
AttentionNAS ECCV Spatiotemporal Attention Cell Search for Video Classification Paper/Code
AssembleNet ICLR Searching for Multi-Stream Neural Connectivity in Video Architectures Paper/Code

Lane Detection

Name Pub. Title Links
CurveLaneNAS ECCV Unifying Lane-Sensitive Architecture Search and Adaptive Point Blending Paper/Code

Image Super-Resolution

Name Pub. Title Links
ESRNAS AAAI Efficient Residual Dense Block Search for Image Super-Resolution Paper/Code

Image Restoration

Name Pub. Title Links
CLEARER NeurIPS Multi-Scale Neural Architecture Search for Image Restoration Paper/Code

Medical

Name Pub. Title Links
C2FNAS CVPR Coarse-to-Fine Neural Architecture Search for 3D Medical Image Segmentation Paper/Code

3D Pose Estimation

Name Pub. Title Links
PANAS ECCV Towards Part-aware Monocular 3D Human Pose Estimation: An Architecture Search Approach Paper/Code

Face Detection

Name Pub. Title Links
BFBox CVPR BFBox Searching Face-Appropriate Backbone and Feature Pyramid Network for Face Paper/Code

Face Anti-Spoofing

Name Pub. Title Links
CDCNAS CVPR Searching Central Difference Convolutional Networks for Face Anti-Spoofing Paper/Code

Scene Text Recognition

Name Pub. Title Links
AutoSTR ECCV Efficient Backbone Search for Scene Text Recognition Paper/Code

Adversarial Attack

Name Pub. Title Links
RobNets CVPR When NAS Meets Robustness: In Search of Robust Architectures against Adversarial Attacks Paper/Code

Model Defense

Name Pub. Title Links
ABanditNAS ECCV Anti-Bandit Neural Architecture Search for Model Defense Paper/Code

Bad Weather Removal

Name Pub. Title Links
AIOnet CVPR All in One Bad Weather Removal using Architectural Search Paper/Code

Image Denoising

Name Pub. Title Links
HiNAS CVPR Memory-Efficient Hierarchical Neural Architecture Search for Image Denoising Paper/Code

Deep Image Prior

Name Pub. Title Links
NASDIP ECCV Learning Deep Image Prior with Neural Architecture Search Paper/Code

Stereo Matching

Name Pub. Title Links
HNAS NeurIPS Hierarchical Neural Architecture Search for Deep Stereo Matching Paper/Code

Crowd Counting

Name Pub. Title Links
NASCount ECCV Counting-by-Density with Neural Architecture Search Paper/Code

Model Pruning

Name Pub. Title Links
NASFCOS CVPR Fast Neural Architecture Search for Object Detection Paper/Code
BPE CVPR Rethinking Performance Estimation in Neural Architecture Search Paper/Code
BlockSwap ICLR Fisher-guided Block Substitution for Network Compression on a Budget Paper/Code

Text Representation

Name Pub. Title Links
TextNAS AAAI A Neural Architecture Search Space tailored for Text Representation Paper/Code

2019

Object Classfication/Detection

Name Pub. Title Links
AENAS AAAI Aging Evolution for Image Classifier Architecture Search Paper/Code
SNAS ICLR Stochastic Neural Architecture Search Paper/Code
ProxylessNAS ICLR ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware Paper/Code
DARTS ICLR Differentiable Architecture Search Paper/Code
GDAS CVPR Searching for A Robust Neural Architecture in Four GPU Hours Paper/Code
FBNet CVPR Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search Paper/Code
MnasNet CVPR Platform-Aware Neural Architecture Search for Mobile Paper/Code
RENAS CVPR Reinforced Evolutionary Neural Architecture Search Paper/Code
IRLAS CVPR Inverse Reinforcement Learning for Architecture Search Paper/Code
EIGEN CVPR Ecologically-Inspired GENetic Approach for Neural Network Structure Searching from Scratch Paper/Code
HMNAS ICCVW Efficient Neural Architecture Search via Hierarchical Masking Paper/Code
PDarts ICCV Progressive Differentiable Architecture Search: Bridging the Depth Gap between Search and Evaluation Paper/Code
MDENAS ICCV Multinomial Distribution Learning for Effective Neural Architecture Search Paper/Code
MobileNetV3 ICCV Searching for MobileNetV3 Paper/Code
RCNet ICCV Resource Constrained Neural Network Architecture Search: Will a Submodularity Assumption Help? Paper/Code
AutoGAN ICCV Neural Architecture Search for Generative Adversarial Networks Paper/Code
SETN ICCV One-Shot Neural Architecture Search via Self-Evaluated Template Network Paper/Code
FPNAS ICCV Fast and Practical Neural Architecture Search Paper/Code
Auto-FPN ICCV Automatic Network Architecture Adaptation for Object Detection Beyond Classification Paper/Code
SNAS MICCAI Scalable Neural Architecture Search for 3D Medical Image Segmentation Paper/Code
XNAS NeurIPS Neural Architecture Search with Expert Advice Paper/Code
DetNAS NeurIPS Backbone Search for Object Detection Paper/Code
NATS NeurIPS Efficient Neural Architecture Transformation Search in Channel-Level for Object Detection Paper/Code
EFAS NeurIPS Efficient Forward Architecture Search Paper/Code

Image Segmentation

Name Pub. Title Links
FastNAS CVPR Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cells Paper/Code
DFNet CVPR Partial Order Pruning: for Best Speed/Accuracy Trade-off in Neural Architecture Search Paper/Code
AutoDeepLab CVPR Hierarchical Neural Architecture Search for Semantic Image Segmentation Paper/Code
CASNet CVPR Customizable Architecture Search for Semantic Segmentation Paper/Code

Re-Identification/Detection

Name Pub. Title Links
Auto-ReID ICCV Searching for a Part-Aware ConvNet for Person Re-Identification Paper/Code

Stereo Matching

Name Pub. Title Links
AutoDispNet ICCV AutoDispNet: Improving Disparity Estimation With AutoML Paper/Code

Multimodal Fusion

Name Pub. Title Links
MFAS CVPR Multimodal Fusion Architecture Search Paper/Code

Model Pruning

Name Pub. Title Links
NPTAS NeurIPS Network Pruning via Transformable Architecture Search Paper/Code

2018

Object Classfication/Detection

Name Pub. Title Links
NASNet CVPR Learning Transferable Architectures for Scalable Image Recognition Paper/Code
BlockQNN CVPR Practical Block-wise Neural Network Architecture Generation Paper/Code
PNAS ECCV Progressive Neural Architecture Search Paper/Code
DPP-Net ECCV Device-aware Progressive Search for Pareto-optimal Neural Architectures Paper/Code
HEAS ICLR Hierarchical Representations for Efficient Architecture Search Paper/Code

Survey

Pub. Title Links
ICLR20 NAS evaluation is frustratingly hard Paper/Code
ICLR20 Understanding and Robustifying Differentiable Architecture Search Paper/Code
ICLR20 Understanding Architectures Learnt by Cell-based Neural Architecture Search Paper/Code
ICLR22 On Redundancy and Diversity in Cell-based Neural Architecture Search Paper/Code
NeurIPS20 A Study on Encodings for Neural Architecture Search Paper/Code