News
[Sep 2024] One paper was accepted by NeurIPS 2024.
[Apr 2024] One paper was accepted by CVPR 2024 Workshop.
[Apr 2023] One paper was accepted by ICML 2023.
|
Research
My previous research primarily focused on the probabilistic meta-learning in few-shot learning. I
have also explored prompt learning for vision-language models. Currently, I am enthusiastic about
foundation models.
|
|
IPO: Interpretable Prompt Optimization for Vision-Language Models
Wenfang Sun*,
Yingjun Du*,
Cees Snoek
NeurIPS , 2024
paper /
code
We propose IPO, an interpretable prompt optimizer that uses LLMs to dynamically generate and refine prompts, while incorporating an LMM to enhance textual-visual interaction.
|
|
Training-Free Semantic Segmentation via LLM-Supervision
Wenfang Sun*,
Yingjun Du*,
Gaowen Liu,
Ramana Rao Kompella,
Cees Snoek
CVPR Workshop, 2024
paper
We propose a novel text-supervised semantic segmentation framework that leverages large language model supervision for enhanced class descriptors, refined subclass generation, and effective ensembling for improved segmentation accuracy.
|
|
MetaModulation: Learning Variational Feature Hierarchies for Few-Shot Learning with Fewer Tasks
Wenfang Sun*,
Yingjun Du*,
Xiantong Zhen,
Fan Wang,
Ling Wang,
Cees Snoek
ICML, 2023
paper /
code
We propose a method for few-shot learning with fewer tasks, which we call MetaModulation.
|
|