Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · Multimodal models — nothing is hidden. Brief papers first.
All1,924In brief3More (on-topic)553Not relevant1,333Not assessed19Older33Could not confirm19Blogs with no paper11All blogs13
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Retrieval-Augmented Multimodal Language Model with Heterogeneous Evidence Integration for Clinical Prognosis Proposes PRISM, a multimodal clinical prognostic model combining patient records with retrieved population-level embedding memory banks. Ranked #421Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Combines structured numerical clinical data, longitudinal ECG waveforms, and text representations in a multimodal framework. | |
| MotionCoach: Constructing Multimodal Guidance for Video Professional Motion Editing Proposes a multimodal agent providing grounded prompts and video clips to guide video editing models in professional sports motions. Ranked #422Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Develops multimodal guidance combining text, video clips, and motion for video editing models. | |
| Evolving Creatives with Clicks: CTR-Driven Advertising image Editing via Attribute Disentanglement and Preference Alignment Proposes an advertising image editing method that identifies and selectively refines visual attributes driving click-through rates. Ranked #423Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Combines text prompt tuning with visual attribute editing and multimodal preference optimization. | |
| GeoGR: Spatial-Semantic Token Compression and Group Routing for Efficient 3D VLMs Proposes spatial-semantic token compression and layer routing to accelerate 3D vision-language model inference across multi-view inputs. Ranked #424Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Directly designs methods for processing multimodal 3D visual tokens in vision-language models. | |
| Distilling Routed 3D Privilege for Spatial Reasoning in Vision-Language Models Distills geometric privilege into vision-language models during training to improve spatial reasoning without inference overhead. Ranked #425Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Improves 3D spatial reasoning capabilities in multimodal vision-language models. | |
| DVD: Dynamic Vector Decoding for Efficient MLLM-based Perception Introduces Dynamic Vector Decoding to efficiently map 2D and 3D perception coordinates into compact discrete tokens for multimodal LLMs. Ranked #426Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Develops dynamic vector decoding for multimodal large language models processing 2D and 3D vision. | |
| Syn-Omni: Structured Specialization and Progressive Collaboration for Omnimodal Embeddings Proposes Syn-Omni, a framework combining modality-expert LoRA paths and progressive routing to balance shared and modality-specific omnimodal embeddings. Ranked #427Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Designs specialized and collaborative embeddings across image, video, audio, and audiovisual modalities. | |
| VibeEdit: Image Editing with Canvas Instructions Presents VibeEdit, an image editor conditioned on spatial canvas annotations to perform targeted object additions, modifications, or removals. Ranked #428Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Aligns multimodal image editing with spatial canvas annotations and text instructions. | |
| AuraLuxMuse: Adaptive Fusion Modeling for Aesthetic Stage Lighting Design with Music and Expert Guidance Presents a system combining representation learning and music alignment to generate editable aesthetic stage lighting cues for live performances. Ranked #429Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Aligns musical audio with visual stage lighting cues across multiple modalities. | |
| Exploring Attention Sinks in Text-to-Image Transformers from Diffusion and Autoregressive Models Analyzes the emergence and behavior of attention sinks in text-to-image diffusion and autoregressive Transformers. Ranked #430Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Analyzes cross-modal attention mechanisms and representations in text-to-image models. | |
| CliQ-RRG: Clinical-Knowledge Guided Disease-aware Visual-Textual Alignment for QA-Style Radiology Report Generation Presents a two-stage visual-textual alignment and retrieval-augmented framework for generating structured radiology reports from medical scans. Ranked #431Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Aligns chest X-ray images with text for vision-language document generation. | |
| Splat2Act: From Captured Scenes to Personalized VLA Manipulation Builds an automated real-to-sim-to-real framework using 3D Gaussian Splatting to adapt robot manipulation policies to specific rooms. Ranked #432Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Adapts pretrained vision-language-action models to scene manipulation tasks using visual inputs. | |
| MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement The report presents an omni-modal model family trained by scaling reinforcement learning throughput, environments, and agentic reward compute. Ranked #433Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Trains an omni-modal foundation model across multimodal corpora and visual environments. | |
| From Sparse Representations to Behavioral Insights for Multimodal Depression Assessment The paper proposes a sparse factor framework to map multimodal behavioral data to interpretable concepts for depression assessment. Ranked #434Preprint0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Analyzes multimodal behavioral video and text patterns for clinical assessment. | |
| VoTSpeech: Decoupling Voice Design from Speech Generation in Instruction-Following TTS This paper presents an instruction-following text-to-speech model that separates voice design from speech generation using an intermediate voice latent. Ranked #435Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Develops instruction-following models spanning text and speech modalities. | |
| LayerCanvas: Infographic Generation in AI Learning Assistants via Hybrid Layer-Set Diffusion This paper presents a hybrid layer-set diffusion framework for generating editable and visually rich educational infographics. Ranked #436Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Combines SVG structural typography with diffusion for multimodal infographic generation. | |
| VAttnPO: Visual Attention-Guided Policy Optimization The paper proposes VAttnPO, using teacher visual attention to refine token-level policy optimization for multimodal reinforcement learning. Ranked #437Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Refines token-level visual attention credit in vision-language models via reinforcement learning. | |
| RSIgen: Reciprocal Self-Improvement for Agentic Visual Generation The paper introduces a reciprocal self-improvement framework to balance agent understanding and image generation roles within multimodal models. Ranked #438Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Investigates reciprocal self-improvement for unified multimodal generation and understanding. | |
| Hallucination-aware Faithful Reasoning in Remote Sensing Presents FaithRS, a self-reflection framework with a fine-grained dataset to detect and correct reasoning hallucinations in remote sensing models. Ranked #439Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Addresses visual hallucination reduction and faithful reasoning in multimodal large language models. | |
| Omni-RS: Unifying Multi-Task Understanding and Generation in Remote Sensing Presents Omni-RS, a unified framework and dataset supporting multiple remote sensing image understanding and generation tasks. Ranked #440Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Proposes a unified multimodal model integrating remote sensing visual understanding and image generation. | |
| Dog-Breed Text-to-image Flow Matching from Pretraining to Fine-Tuning on 4 Consumer GPUs This paper presents a framework to pretrain and fine-tune text-to-image diffusion transformers using four consumer GPUs. Ranked #441Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Explores efficient text-to-image multimodal diffusion transformers. | |
| DuplexBridge: Coordinating Understanding and Generation for Unified Image Editing This paper proposes an image editing framework that coordinates prompt understanding and image generation within a single unified model. Ranked #442Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Proposes a unified multimodal architecture coordinating text-guided visual understanding and image editing. | |
| Hierarchical Curriculum Learning for Surgical Video Generation: Focusing on Bilateral Axillo-Breast Approach Robotic Thyroidectomy Datasets Adapts text-to-video diffusion models for surgical procedure simulation using hierarchical procedural decomposition and progressive curriculum learning. Ranked #443Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Applies text-to-video diffusion models and curriculum learning to generate multimodal procedural surgical videos. | |
| Deficit-Driven Stratified Acquisition for Building STRATA-S12: An Open SAR-Optical Corpus for Self-Supervised Learning Introduces a deficit-driven stratified acquisition algorithm to create a balanced, co-registered satellite imagery corpus for self-supervised Earth observation. Ranked #444Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Addresses data acquisition strategies for building paired SAR and optical multimodal datasets for self-supervised learning. | |
| Edit4D: Editable 4D Scene Generation with Textual Control Introduces a text-to-4D generation method that separates static backgrounds and dynamic characters to allow modular editing and camera control. Ranked #445Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:18 | On-topic Develops text-guided dynamic 4D scene generation combining text, 3D representations, and video priors. | |
| FrameLite: Decision-Oriented Aesthetic Cropping with a Compact Vision-Language Model Proposes a lightweight aesthetic cropping model built on a small vision-language model using multi-stage candidate optimization. Ranked #446Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Uses a compact vision-language model for image composition and cropping. | |
| Multimodal Fusion of RGB and Complementary Modalities for Semantic Segmentation This paper proposes a bidirectional polarity-aware cross-modality fusion module to improve multimodal semantic segmentation across diverse complementary sensor streams. Ranked #447Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Develops a cross-modality fusion framework for combining RGB with complementary modalities like LiDAR, depth, and thermal. | |
| WIRE: Weight Space Implicit Representation Encoding of Frozen Video LLMs WIRE reduces video LLM inference costs by moving video computations from input tokens into temporary low-rank weight updates. Ranked #448Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Optimizes video language models by encoding visual representation into model weights. | |
| Learning Multimodal Sensor Fusion with JEPA Representations for Breathing Activity and Pose Recognition The paper explores transferring frozen video representations across heterogeneous sensor subsets to classify breathing activity and pose. Ranked #449Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Studies multimodal fusion across video, depth, and radar sensor inputs. | |
| DDVR-Net: Degradation-Aware Decoupling and Visibility-Guided Restoration for Historical Document Recognition DDVR-Net decouples glyph structures from physical damage and uses visibility-guided restoration for historical document OCR. Ranked #450Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Presents a framework combining visual degradation restoration with language modeling for document understanding. | |
| Geometry-Guided Semantic Reconstruction for 3D Instance Segmentation Introduces masked semantic reconstruction and geometry modulation to better align lifted 2D semantic priors with 3D instance representations. Ranked #451Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Transfers and aligns 2D semantic priors into 3D geometric representations for scene understanding. | |
| PIGEONS: Incremental Long-Video Captioning with Persistent Identity Gallery and Evolving Overarching Narrative Summary Develops an incremental long-video captioning method using a persistent identity gallery and evolving narrative summary. Ranked #452Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Develops a multimodal video captioning framework using identity galleries and narrative summaries. | |
| EviStress: Evidence Stress Learning for Generalizable Face Forgery Detection with Textual Explanations The paper introduces a framework combining targeted patch perturbation with textual explanations to improve face forgery detection generalization. Ranked #453Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Proposes a framework for face forgery detection with multimodal textual explanations. | |
| ViewStruct: View-Grounded Articulation and Connectivity Inference The paper proposes a vision-language framework to predict rigid-body connectivity and articulation parameters of objects from single views. Ranked #454Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Adapts vision-language models to perform multimodal reasoning over visual scenes and object connectivity. | |
| PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysis The paper proposes an adaptive whole-slide image navigation agent that models cross-magnification localization for pathology diagnosis. Ranked #455Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Presents an adaptive question-conditioned multimodal navigation agent for complex medical image analysis. | |
| Revisiting Natural Language Prompts from Large Language Models for Open-Vocabulary Video Recognition The paper presents a framework exploring category, video, and frame prompts to enhance vision-language models for open-vocabulary video recognition. Ranked #456Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Improves vision-text alignment in multimodal vision-language models for video recognition. | |
| Code-Interactive Visual Reasoning for Financial Candlestick Understanding The paper introduces a model and dataset for financial candlestick reasoning by generating and executing code to gather visual evidence. Ranked #457Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Develops vision-language reasoning combining document understanding of financial charts with code execution. | |
| MiMaAlign: Hierarchical Micro-Macro Alignment for Physically Plausible Video Generation The paper proposes a hierarchical alignment method that transfers continuous dynamics and high-level event knowledge into video diffusion models. Ranked #458Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Aligns text-to-video diffusion models using vision-language model event semantics. | |
| GHOST: Geometry-Constrained Hybrid Diffusion for Open-Vocabulary 3D Scene Graph Generation The paper proposes a hybrid diffusion method that enforces geometric constraints to generate open-vocabulary 3D scene graphs from point clouds. Ranked #459Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Connects open-vocabulary language embeddings with 3D spatial geometry in scene graph generation. | |
| From Sound to Sense: An Anatomy of Semantic Supervision for Speech-Driven Visual Grounding in Remote Sensing Imagery The paper analyzes semantic supervision mechanisms in direct speech-to-box grounding models for remote sensing imagery. Ranked #460Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Investigates audio-visual multimodal grounding aligning speech features with satellite imagery. | |
| Learning Temporal Evidence Selection for Video Anomaly Understanding The paper proposes a learned temporal evidence selection approach to generate grounded text explanations for video anomaly understanding. Ranked #461Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Uses vision-language and Q-Former models to select visual evidence for language generation. | |
| UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservation The paper proposes a training-free 3D editing framework that estimates edit regions without masks to preserve unedited source geometry and appearance. Ranked #462Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Presents a multimodal 3D asset editing framework conditioned on text, boxes, and images. | |
| Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generation The paper introduces structured stateful relational scripts and a paired dataset to coordinate persistent identities and audio events in multi-shot video generation. Ranked #463Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Introduces representation and dataset for coordinated multimodal audio-visual video generation. | |
| OmniRSI: Taming Latent Diffusion for Unified Multimodal Remote Sensing Image Generation The paper proposes a unified latent diffusion architecture with a custom variational autoencoder for multimodal remote sensing image generation. Ranked #464Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Presents a unified multimodal generative model conditioning on text and heterogeneous visual inputs. | |
| Reference-Efficient Multimodal Bitstream-Corrupted Video Recovery via Depth-Conditioned Adaptation This paper presents a depth-conditioned video recovery framework that selects a single reliable RGB reference to restore damaged video bitstreams efficiently. Ranked #465Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Combines RGB appearance and depth geometry to reconstruct corrupted video sequences. | |
| SlotAVS: Object-Centric Audio-Visual Segmentation via Bi-Modal Slot Attention This paper introduces a competitive bi-modal slot attention method to cleanly segment distinct sounding objects in multi-source audio-visual scenes. Ranked #466Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Proposes an object-centric model binding audio and visual signals for segmentation. | |
| Sparse All-Layer Connector for Domain Generalised Semantic Segmentation This paper introduces a sparse connector allowing cross-layer feature sharing across different foundation models for domain-generalized semantic segmentation. Ranked #467Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Fuses representations from vision-language and vision foundation models across layers. | |
| CatPortrait: Taming Video Generative Models for Portrait Animation via In-context Conditioning The paper presents a framework that uses structured 3D facial guidance as in-context input conditioning for controllable portrait video animation. Ranked #468Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Animates portraits using video and audio conditioning modalities. | |
| Text-Guided Medical Image Segmentation via Residual Aggregation and Dense Alignment Representations The paper presents a parameter-efficient architecture connecting text embeddings with mask decoding for language-guided medical image segmentation. Ranked #469Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Grounds natural language text prompts into medical image segmentation. | |
| [Re] Boosting the Visual Interpretability of CLIP via Adversarial Fine-Tuning The paper presents a reproducibility study and an explicit saliency supervision extension for adversarial fine-tuning of CLIP vision models. Ranked #470Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Focuses on visual interpretability and concept alignment in vision-language CLIP models. | |
| Design Choices for Multimodal Transformer Learning with Missing and Longitudinal Healthcare Data This paper studies transformer architectural choices for handling missing modalities and longitudinal observations in multimodal healthcare datasets. Ranked #471Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Studies multimodal transformer architectures and fusion strategies across heterogeneous clinical data types. | |
| Axiom-0: Hierarchical Self-Refinement for Vision-Language-Action Policies This paper introduces a vision-language-action policy using hierarchical self-refinement across internal representations and action interfaces. Ranked #472Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Develops a vision-language-action policy using hierarchical refinement across multimodal representations. | |
| CAST-ASD: Causal Attention over Speakers and Time for Online Active Speaker Detection Proposes a causal joint attention model across faces and time for low-latency active speaker detection in multi-person video. Ranked #473Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Multimodal audio-visual speaker detection combining visual face tracking with temporal attention. | |
| SPARE: Shared Perception and Adaptive Retrieval of Evidence for Streaming Video Understanding Presents an adaptive retrieval framework that selectively retrieves historical video context to assist streaming question answering. Ranked #474Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Multimodal video understanding and question answering combining visual encoding and language models. | |
| From Sampled Evidence to Radiology Reports: Objectives, Constraints, and Realization The paper evaluates how objective functions and candidate constraints affect decision conversion when generating radiology reports from sampled evidence. Ranked #475Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Studies generating radiology reports from multimodal evidence using vision-language models like Qwen-VL. | |
| DualAffect: Dual-Path Paralinguistic Integration for Generative Audiovisual Emotion Understanding Develops a dual-path architecture combining visual and acoustic signals to improve multimodal emotion recognition. Ranked #476Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Presents a multimodal architecture integrating audiovisual features with language decoding for emotion understanding. | |
| SIMPLE: Semantic Structure-Aligned Prompt Learning for Open-Vocabulary Audio-Visual Event Localization Aligns prompt semantic structures across audio and visual data to identify unseen multimodal events. Ranked #477Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Focuses on prompt learning across asynchronous audio and visual streams for multimodal event localization. | |
| PAG-Agent: Zero-Shot Personalized Music Album Generation via Aesthetic Profile Distillation Distills user aesthetic profiles to guide multimodal music models in generating personalized albums. Ranked #478Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Uses multimodal LLMs and user aesthetic profile distillation for personalized audio generation. | |
| SYNPRED: A Synergistic Approach to Multimodal Learning for Clinical Prediction This paper proposes a multimodal variational autoencoder framework that separates task-relevant information to improve clinical predictions even with missing modalities. Ranked #479Peer-reviewed0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Develops a multimodal variational autoencoder framework combining imaging and RNA data. | |
| PolUR: Polarization Aware Multimodal Degradation Perception for Underwater Image Restoration This paper introduces a multimodal language-driven framework combining polarization and RGB cues to identify degradations and restore underwater images. Ranked #480Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Integrates multimodal language-driven instructions with polarization and RGB image restoration. |
421–480 of 1,924← PreviousNext →