About
The main research interests relate to the investigation and implementation of new techniques in the fields of computer vision and multimedia. Specifically, in computer vision, I address a large spectrum of themes including human-behavior analysis, action recognition, 2D/3D object detection, large-scale event detection and video analysis, etc. In multimedia, my research focuses on three aspects: multimedia information retrieval, social signals processing and affective computing.
The specific research topics include cross media retrieval, multi-modal learning, social media analysis, emotion recognition, multimodal brain-computer interfaces, etc.
Papers (128)
2026
Continual Vision-Language Action Learning in Robotic Manipulation
Jiahua Dong, Xudong Wang, Zebin Han, Wenqi Liang, Duzhen Zhang, Meng Cao, Nicu Sebe, Ivan Laptev, Zhi Han, Fahad Shahbaz Khan, Salman Khan
PoInit-of-View: Poisoning Initialization of Views Transfers Across Multiple 3D Reconstruction Systems
TerraScope: Pixel-Grounded Visual Reasoning for Earth Observation
The Devil Is in Gradient Entanglement: Energy-Aware Gradient Coordinator for Robust Generalized Category Discovery
Token Reduction via Local and Global Contexts Optimization for Efficient Video Large Language Models
Finetune Like You Pretrain: Boosting Zero-shot Adversarial Robustness in Vision-language Models
NullFace: Training-Free Localized Face Anonymization
Fast and Stable Riemannian Metrics on SPD Manifolds via Cholesky Product Geometry
Inverse Virtual Try-On: Generating Multi-Category Product-Style Images from Clothed Individuals
Riemannian High-Order Pooling for Brain Foundation Models
Chen Hu, Ziheng Chen, Rui Wang, Yefeng Zheng, Nicu Sebe
Safe Vision-Language Models via Unsafe Weights Manipulation
Open-World Deepfake Attribution via Confidence-Aware Asymmetric Learning
Wasserstein-Aligned Hyperbolic Multi-View Clustering
Rui Wang, Yuting Jiang, Xiaoqing Luo, Xiaojun Wu, Nicu Sebe, Ziheng Chen
Consistency-Aware Anchor Pyramid Network for Crowd Localization
Xinyan Liu, Guorong Li, Yuankai Qi, Zhenjun Han, Anton van den Hengel, Nicu Sebe, Ming-Hsuan Yang, Qingming Huang
Deep Learning-Based Object Pose Estimation: A Comprehensive Survey
Jian Liu, Wei Sun, Hui Yang, Zhiwen Zeng, Chongpei Liu, Jin Zheng, Xingyu Liu, Hossein Rahmani, Nicu Sebe, Ajmal Mian
Hallucination Early Detection in Diffusion Models
Federico Betti, Lorenzo Baraldi, Lorenzo Baraldi, Rita Cucchiara, Nicu Sebe
2025
Towards a General Attention Framework on Gyrovector Spaces for Matrix Manifolds
Rui Wang, Chen Hu, Xiaoning Song, Xiaojun Wu, Nicu Sebe, Ziheng Chen
AlignCAT: Visual-Linguistic Alignment of Category and Attributefor Weakly Supervised Visual Grounding
Yidan Wang, Chenyi Zhuang, Wutao Liu, Pan Gao, Nicu Sebe
FreeInsert: Disentangled Text-Guided Object Insertion in 3D Gaussian Scene without Spatial Priors
Chenxi Li, Weijie Wang, Qiang Li, Nicu Sebe, Bruno Lepri, Weizhi Nie
Generate, Refine, and Encode: Leveraging Synthesized Novel Samples for On-the-Fly Fine-Grained Category Discovery
Hierarchical Visual Prompt Learning for Continual Video Instance Segmentation
Jiahua Dong, Hui Yin, Wenqi Liang, Hanbin Zhao, Henghui Ding, Nicu Sebe, Salman Khan, Fahad Shahbaz Khan
Superpowering Open-Vocabulary Object Detectors for X-ray Vision
Pablo García Fernández, Lorenzo Vaquero, Mingxuan Liu, Feng Xue, Daniel Cores, Nicu Sebe, Manuel Mucientes, Elisa Ricci
What Changed? Detecting and Evaluating Instruction-Guided Image Edits with Multimodal Large Language Models
Lorenzo Baraldi, Davide Bucciarelli, Federico Betti, Marcella Cornia, Lorenzo Baraldi, Nicu Sebe, Rita Cucchiara
Diversified in-domain synthesis with efficient fine-tuning for few-shot classification
Multi-focal Conditioned Latent Diffusion for Person Image Synthesis
3D Part Segmentation via Geometric Aggregation of 2D Visual Features
Anti-Forgetting Adaptation for Unsupervised Person Re-Identification
Hao Chen, Francois Bremond, Nicu Sebe, Shiliang Zhang
Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimation
Jian Liu, Wei Sun, Hui Yang, Pengchao Deng, Chongpei Liu, Nicu Sebe, Hossein Rahmani, Ajmal Mian
GradBias: Unveiling Word Influence on Bias in Text-to-Image Generative Models
Moreno D’Incà, Elia Peruzzo, Massimiliano Mancini, Xingqian Xu, Humphrey Shi, Nicu Sebe
Reliable Few-Shot Learning Under Dual Noises
Ji Zhang, Jingkuan Song, Lianli Gao, Nicu Sebe, Heng Tao Shen
Spatial-Temporal Graph Mamba for Music-Guided Dance Video Synthesis
T2TD: Text-3D Generation Model Based on Prior Knowledge Guidance
Weizhi Nie, Ruidong Chen, Weijie Wang, Bruno Lepri, Nicu Sebe
Learning Rate Curriculum
Florinel-Alin Croitoru, Nicolae-Cătălin Ristea, Radu Tudor Ionescu, Nicu Sebe
Masked Image Modeling: A Survey
Vlad Hondru, Florinel Alin Croitoru, Shervin Minaee, Radu Tudor Ionescu, Nicu Sebe
Budget-aware pruning: Handling multiple domains with less parameters
Samuel Felipe dos Santos, Rodrigo Berriel, Thiago Oliveira-Santos, Nicu Sebe, Jurandy Almeida
Cross-modality average precision optimization for visible thermal person re-identification
Yongguo Ling, Zhiming Luo, Dazhen Lin, Shaozi Li, Min Jiang, Nicu Sebe, Zhun Zhong
Understanding Matrix Function Normalizations in Covariance Pooling from the Lens of Riemannian Geometry
2024
Highlight
OpenBias: Open-set Bias Detection in Text-to-Image Generative Models
Moreno D'Incà, Elia Peruzzo, Massimiliano Mancini, Dejia Xu, Vidit Goel, Xingqian Xu, Zhangyang Wang, Humphrey Shi, Nicu Sebe
Riemannian Multinomial Logistics Regression for SPD Neural Networks
A Lie Group Approach to Riemannian Batch Normalization
Democratizing Fine-grained Visual Recognition with Large Language Models
Adaptive Log-Euclidean Metrics for SPD Matrix Learning
Improving Fairness using Vision-Language Driven Image Augmentation
Moreno D'Incà, Christos Tzelepis, Ioannis Patras, Nicu Sebe
SpectralCLIP: Preventing Artifacts in Text-Guided Style Transfer from a Spectral Perspective
2023
StylerDALLE: Language-Guided Style Transfer Using a Vector-Quantized Tokenizer of a Large-Scale Generative Model
Unleashing the Transferability Power of Unsupervised Pre-Training for Emotion Recognition in Masked and Unmasked Facial Images
Compositional Semantic Mix for Domain Adaptation in Point Cloud Segmentation
Towards Robust Person Re-Identification by Defending Against Universal Attackers
Fengxiang Yang, Juanjuan Weng, Zhun Zhong, Hong Liu, Zheng Wang, Zhiming Luo, Donglin Cao, Shaozi Li, Shin'ichi Satoh, Nicu Sebe
Overlap-guided Gaussian Mixture Model for Point Cloud Registration
2022
Data Augmentation-free Unsupervised Learning for 3D Point Cloud Understanding
Low-budget label query through domain alignment enforcement
Class-incremental Novel Class Discovery
CoSMix: Compositional Semantic Mix for Domain Adaptation in 3D LiDAR Segmentation
GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentation
Cristiano Saltori, Evgeny Krivosheev, Stéphane Lathuilière, Nicu Sebe, Fabio Galasso, Giuseppe Fiameni, Elisa Ricci, Fabio Poiesi
Temporal Alignment for History Representation in Reinforcement Learning
Aleksandr Ermolov, Enver Sangineto, Nicu Sebe
Unsupervised Domain Adaptation for Video Transformers in Action Recognition
Victor G. Turrisi da Costa, Giacomo Zara, Paolo Rota, Thiago Oliveira-Santos, Nicu Sebe, Vittorio Murino, Elisa Ricci
Dual-Head Contrastive Domain Adaptation for Video Action Recognition
Victor G. Turrisi da Costa, Giacomo Zara, Paolo Rota, Thiago Oliveira-Santos, Nicu Sebe, Vittorio Murino, Elisa Ricci
2021
Learning to Attack Real-World Models for Person Re-identification via Virtual-Guided Meta-Learning
Fengxiang Yang, Zhun Zhong, Hong Liu, Zheng Wang, Zhiming Luo, Shaozi Li, Nicu Sebe, Shin'ichi Satoh
Curriculum self-paced learning for cross-domain object detection
Coarse-to-Fine Gaze Redirection with Numerical and Pictorial Guidance
Jingjing Chen, Jichao Zhang, Enver Sangineto, Jiayuan Fan, Tao Chen, Nicu Sebe
2020
SF-UDA<sup>3D</sup>: Source-Free Unsupervised Domain Adaptation for LiDAR-Based 3D Object Detection
Class-Aware Modality Mix and Center-Guided Metric Learning for Visible-Thermal Person Re-Identification
Yongguo Ling, Zhun Zhong, Zhiming Luo, Paolo Rota, Shaozi Li, Nicu Sebe
Learning How to Smile: Expression Video Generation with Conditional Adversarial Recurrent Nets
Whitening for Self-Supervised Representation Learning
Aleksandr Ermolov, Aliaksandr Siarohin, Enver Sangineto, Nicu Sebe
Low-Budget Unsupervised Label Query through Domain Alignment Enforcement
2019
Unsupervised domain adaptation using feature-whitening and consensus loss
Regularized Evolutionary Algorithm for Dynamic Neural Topology Search
Self-Paced Deep Learning for Weakly Supervised Object Detection
Enver Sangineto, Moin Nabi, Dubravko Culibrk, Nicu Sebe
2018
