Skip to content

Sunny5250/CIF

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CIF

Offical implementation of Commonality in Few: Few-Shot Multimodal Anomaly Detection via Hypergraph-Enhanced Memory (AAAI 2026).

Welcome to follow our papers "Commonality in Few: Few-Shot Multimodal Anomaly Detection via Hypergraph-Enhanced Memory".

News

  • [2025.11.08] 🔥🔥 Accepted by AAAI 2026!

Abstract

Few-shot multimodal industrial anomaly detection is a critical yet underexplored task, offering the ability to quickly adapt to complex industrial scenarios. In few-shot settings, insufficient training samples often fail to cover the diverse patterns present in test samples. This challenge can be mitigated by extracting structural commonality from a small number of training samples. In this paper, we propose a novel few-shot unsupervised multimodal industrial anomaly detection method based on structural commonality, CIF (Commonality In Few). To extract intra-class structural information, we employ hypergraphs, which are capable of modeling higher-order correlations, to capture the structural commonality within training samples, and use a memory bank to store this intra-class structural prior. Firstly, we design a semantic-aware hypergraph construction module tailored for single-semantic industrial images, from which we extract common structures to guide the construction of the memory bank. Secondly, we use a training-free hypergraph message passing module to update the visual features of test samples, reducing the distribution gap between test features and features in the memory bank. We further propose a hyperedge-guided memory search module, which utilizes structural information to assist the memory search process and reduce the false positive rate. Experimental results on the MVTec 3D-AD dataset and the Eyecandies dataset show that our method outperforms the state-of-the-art (SOTA) methods in few-shot settings.

Datasets

We use MVTec 3D-AD and Eyecandies for experiments.

Installation

We implement this repo with the following environment:

  • Python 3.8.11
  • Pytorch 1.13.1
  • CUDA 11.7

To run experiments, first clone the repository and install the dependency packages:

# create virtual environment
conda create -n cif python==3.8.11
conda activate cif

# install pytorch (1.13.1+cu117)
pip install torch==1.13.1+cu117 torchvision==0.14.1+cu117 torchaudio==0.13.1 --extra-index-url https://download.pytorch.org/whl/cu117

# install other packages
pip install -r requirements.txt
# install knn_cuda
pip install --upgrade https://github.com/unlimblue/KNN_CUDA/releases/download/0.2/KNN_CUDA-0.2-py3-none-any.whl
# install pointnet2_ops_lib
pip install "git+git://github.com/erikwijmans/Pointnet2_PyTorch.git#egg=pointnet2_ops&subdirectory=pointnet2_ops_lib"

# if you can't install pointnet2_ops_lib using the command above, try this:
git clone https://github.com/erikwijmans/Pointnet2_PyTorch.git
cd Pointnet2_PyTorch/
pip install pointnet2_ops_lib/

Training and Testing

1. Checkpoints

Download pre-trained models DINO and Point-MAE, then put them in checkpoints folder.

2. Data preprocessing

Only if you use Eyecandies, you need to preprocess the data with the following command:

python data/preprocess_eyecandies.py --dataset_path [dataset_path] --target_dir [target_dir]

3. Training

Run the following command to train our model on all categories of MVTec 3D-AD and Eyecandies dataset:

./scripts/train.sh

4. Testing

Run the following command to evaluate the models on all categories of MVTec 3D-AD and Eyecandies dataset:

./scripts/eval.sh

BibTex Citation

If you find this paper and repository useful, please cite our paper:

@article{lin2025commonality,
  title={Commonality in Few: Few-Shot Multimodal Anomaly Detection via Hypergraph-Enhanced Memory},
  author={Lin, Yuxuan and Yan, Hanjing and Tong, Xuan and Chang, Yang and Wang, Huanzhen and Zhou, Ziheng and Gao, Shuyong and Wang, Yan and Zhang, Wenqiang},
  journal={arXiv preprint arXiv:2511.05966},
  year={2025}
}

About

[AAAI 2026] Offical implementation of "Commonality in Few: Few-Shot Multimodal Anomaly Detection via Hypergraph-Enhanced Memory".

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors