Every paper checked — nothing hidden
All papers
Every paper checked in the week of 12–18 Oct 2026 · Multimodal models — nothing is hidden. Brief papers first.
All1,924In brief3More (on-topic)553Not relevant1,333Not assessed19Older33Could not confirm19Blogs with no paper11All blogs13
| Paper | Topic | Relevance | Feedback |
|---|---|---|---|
| Learning Subject Tags from Incomplete Labels: A Recall-Oriented VLM Pipeline for Historical Photographs The paper presents a fine-tuning pipeline for vision-language models to tag historical photographs using incomplete supervision labels. Ranked #481Peer-reviewed0/10 suggested | Multimodal models via acm · 18 Oct, 06:18 | On-topic Fine-tunes vision-language models for subject tagging and image understanding on historical photographs. | |
| Shared Sentiment Evidence from Frozen Multimodal Models for Continuous Sentiment Prediction The paper proposes an output-space probability interface for frozen multimodal models to improve continuous sentiment prediction using gradient-boosted trees. Ranked #482Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:07 | On-topic Studies multimodal sentiment prediction by extracting evidence across vision, text, and acoustic modalities. | |
| GeoCloak: An Agentic Framework for Semantics-Preserving Geolocation Privacy via Peripheral Clue Manipulation The paper introduces an agentic framework that removes peripheral visual clues to protect geolocation privacy in images without adding visible artifacts. Ranked #483Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Manipulates multimodal image-text representations to evade visual geolocation. | |
| LiFi: LiDAR Generation from Multi-View Images via Geometric and Semantic Collaborative Guidance This paper presents a dual-branch latent diffusion method to generate LiDAR point clouds from multi-view camera images. Ranked #484Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Deals with multimodal cross-generation between camera images and LiDAR point clouds. | |
| From Pixels to Structure: Lightweight Vision-Language Models for Document OCR and Structured JSON Extraction Evaluates eight lightweight open-source vision-language models on optical character recognition and schema-compliant JSON extraction across heritage document collections. Ranked #485Peer-reviewed0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Directly evaluates vision-language models for document image understanding and structured extraction. | |
| PAGE: Parts-Aware Guidance for Co-Speech Gesture Portrait Video Generation Presents parts-specific reweighting and classifier guidance to improve facial details and audio alignment in speech-driven gesture videos. Ranked #486Peer-reviewed0/10 suggested | Multimodal models via arxiv · 12 Oct, 16:28 | On-topic Addresses cross-modal alignment between audio speech signals and visual video generation. | |
| QK-Edit: Revisiting Attention-based Injection in MM-DiT for Image and Video Editing Introduces QK-Edit, a training-free query-key attention manipulation method for text-guided image and video editing in multimodal diffusion transformers. Ranked #487Peer-reviewed0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Manipulates attention dynamics in multimodal diffusion transformers for text-guided image and video editing. | |
| KARAMEL: Knowledge-Aware Ranking for Multimodal Entity Linking in the Arts via Heterogeneous Graphs The paper introduces a multimodal entity linking method that combines vision-language models with heterogeneous graph networks for cultural heritage data. Ranked #488Peer-reviewed0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Fuses vision-language encoders with knowledge graphs for multimodal entity linking. | |
| Rethinking Supervision in Document Unwarping: A Self-consistent Flow-free Approach The paper introduces a flow-free deep network for smartphone document image unwarping using geometric consistency and undistorted document supervision. Ranked #489Peer-reviewed0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Improves document understanding pipelines through rectification of smartphone document images. | |
| Bidirectional Adaptive Transformers for Multimodal Anomaly Detection Proposes a bidirectional adaptive transformer framework to align RGB and 3D point cloud features for multimodal anomaly detection. Ranked #490Peer-reviewed0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Addresses multimodal alignment and fusion between 2D RGB images and 3D point clouds. | |
| GeoState: Learning View-Decoupled Geometry States for 3D World Modeling The authors introduce GeoState, a view-decoupled 3D world modeling approach separating scene dynamics from camera motion. Ranked #491Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Develops a 3D geometry representation model operating on multi-view visual inputs. | |
| TimeCap: A Scalable Open-Source Pipeline for Captioning Wearable Health Time-Series Data The paper introduces TimeCap, an open deterministic pipeline for generating signal-grounded captions from wearable health time-series data. Ranked #492Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Focuses on cross-modal pairing of sensor time-series data with natural language. | |
| Bias Mitigation in Audio-Enabled LLMs through Adversarial Training and Distillation Methods Applies adversarial training and distillation to remove unwanted gender bias in audio-enabled language models. Ranked #493Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Directly focuses on audio-enabled multimodal large language models. | |
| Enhancing Multimodal RLVR with Pairwise Token Contrast and Adaptive Trajectory Confidence Improves reinforcement learning credit assignment in multimodal reasoning using pairwise token contrast and adaptive trajectory confidence. Ranked #494Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Improves multimodal reasoning by isolating image dependence during reinforcement learning. | |
| Task-Centric Multimodal Learning for Cognitive Impairment Detection Evaluates a multimodal screening method using voice, video, and text from voice-assistant interactions to detect cognitive impairment. Ranked #495Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Evaluates multimodal fusion across video, audio, and text for cognitive assessment. | |
| ACEdit: Stable Multi-Turn Image Editing via Asymmetric Conditioning The authors propose ACEdit, a training and distillation scheme that stabilizes image editing models against accumulating errors across multiple editing turns. Ranked #496Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Investigates multi-turn vision-language image editing and instruction-following models. | |
| Twice Upon a Time: Complementary Representations for Time-Series Reasoning The authors propose combining line plots and normalized delay embeddings to provide complementary visual representations for time-series reasoning in language models. Ranked #497Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Applies vision-language foundation models to visual time-series reasoning via dual visual representations. | |
| GeoReader: Learning Latent Geometry for Spatial Reasoning in Vision-Language Models This paper introduces a framework that trains lightweight readers to convert latent 3D geometric representations into tokens readable by vision-language models. Ranked #498Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Improves 3D spatial reasoning in vision-language models by integrating latent geometric representations. | |
| Just Respect the Semantics: Image-Token Compression via Pre-LLM Semantic Variable-Resolution Tokenization and In-LLM Relevance Pruning The authors present an image-token compression technique using variable-resolution merging for semantic regions and learned relevance pruning inside the model. Ranked #499Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Introduces token pruning and variable-resolution tokenization methods for multimodal vision-language models. | |
| LinMorph: Learning to Morph Weights for Efficient Video DiT Linearization Proposes LinMorph, a learnable weight transformation method to initialize linear attention models from pretrained video diffusion transformers efficiently. Ranked #500Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Investigates architectural linearization and efficiency for multimodal video diffusion transformers. | |
| DriveWLA: Unifying Future Dynamics and Scene Semantics through World-Language-Action Modeling for Autonomous Driving Introduces DriveWLA, a mixture-of-transformers architecture unifying scene semantics, future dynamic prediction, and vehicle trajectory planning. Ranked #501Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Combines vision-language models with world modeling and action prediction for visual navigation. | |
| Scaling Vision Transformers Without Training: Prune-and-Merge Token Compression The paper introduces a training-free token pruning and merging framework with new robustness metrics for vision transformers. Ranked #502Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Develops token reduction techniques for Vision Transformers to improve processing efficiency. | |
| Bottlenecked semantic compression by representation reconstruction The authors propose a visual token compression framework that reduces computational costs by retaining only visual tokens with high reconstruction residuals. Ranked #503Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Compresses visual token sequences to improve efficiency in multimodal understanding models. | |
| MedEvo: Medical Reasoning Evolution through Knowledge Navigation Proposes MedEvo, an iterative training framework that repairs multimodal medical reasoning trajectories using minimal hints and taxonomy-guided feedback. Ranked #504Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Improves medical multimodal reasoning across visual and textual clinical data. | |
| WorldRoPE: Probabilistic World-Centric Rotary Embedding for Multi-View Attention Proposes a world-centric rotary positional embedding using 3D Gaussian primitives to improve cross-view attention in multi-view vision tasks. Ranked #505Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Develops a novel multi-view attention mechanism for 3D visual representations. | |
| Unravel: Recovering an Interactive 3D Scene from a Single Image This paper introduces Unravel, a training-free framework that converts a single image into an editable, multi-object 3D scene. Ranked #506Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Decomposes single images into 3D scenes using vision-language models. | |
| Gen Through the Lens: Camera-Controllable Video Generation via Cross-Coordinate Conditioning Fusion The paper proposes an image-to-video framework combining three coordinate spaces to enable camera-controllable video generation. Ranked #507Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Proposes a camera-controllable multimodal video generation framework from reference images. | |
| Adaptive Look, Flexible Thought: Learning How and How Long to Think in Multimodal Reasoning The paper proposes a reasoning framework that discretizes visual states into tokens to jointly optimize visual computation and chain-of-thought steps. Ranked #508Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Proposes a unified reasoning framework coordinating visual perception tokens with multimodal language models. | |
| Rethinking Human Intent-to-CAD: Parametric CAD Model Generation via Cooperative Multi-Task Alignment and Spatial-Aware Reinforcement Learning The paper presents a dataset and framework mapping sketches and text to executable parametric computer-aided design code. Ranked #509Peer-reviewed0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Bridges multimodal inputs including sketches and text to generate CAD code. | |
| A Decade of PhotoMappers: A Longitudinal Study of Crowdsourced Disaster Photos Geolocalization with Vision-Language Models and Geospatial Reasoning This study analyzes a decade of crowdsourced disaster photos to evaluate vision-language models against human geographic reasoning for location estimation. Ranked #510Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Evaluates vision-language models on geolocalization across cross-view and satellite imagery. | |
| Getting Space Right: Agentic Rewards for Image Generation This paper proposes a curriculum-guided reinforcement learning framework and an agentic reward model for spatial text-to-image generation. Ranked #511Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Improves spatial reasoning and visual understanding for text-to-image synthesis. | |
| A Hybrid Kinematic GCN and Elastic Transformer for Efficient Indian Sign Language Recognition The paper introduces a hybrid kinematic graph neural network and elastic transformer framework for efficient Indian sign language recognition from video. Ranked #512Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Models multimodal video and skeletal kinematics for vision-based sign language recognition. | |
| Prospective Forcing: Learning to Look Ahead for Autoregressive Long Video Diffusion The paper introduces a multi-head prediction method that injects future long-range supervision to improve autoregressive video generation consistency. Ranked #513Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Improves long-horizon autoregressive video generation through multi-head predictive diffusion. | |
| CUSE: Fine-Grained Multimodal Unlearning with Counterfactual Guidance and On-Policy Self-Distillation This paper introduces a multimodal unlearning method using counterfactual inputs and on-policy self-distillation to remove sensitive data without damaging general knowledge. Ranked #514Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:17 | On-topic Presents fine-grained unlearning across text and visual content in multimodal LLMs. | |
| Attribute-Centric Vision-Language Alignment for Fine-Grained Gait Understanding Presents a dataset and vision-language alignment framework for fine-grained human gait attribute recognition from walking sequences. Ranked #515Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 06:18 | On-topic Proposes vision-language alignment matching multi-frame video evidence with textual class prototypes. | |
| Reliability-Aware Multimodal Sentiment Prediction Under Local Modality Missingness This paper introduces RM-Net, a reliability-aware network designed to maintain multimodal sentiment prediction accuracy when spans of modalities are missing. Ranked #516Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Multimodal sentiment prediction robustly fusing text, audio, and video inputs. | |
| AdaFrame: Hierarchical Multimodal Deduplication with Adaptive Information Budgeting for Cost-Efficient Video Advertisement Analysis The paper proposes a content-adaptive frame deduplication pipeline to lower inference costs for multimodal video advertisement analysis. Ranked #517Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:07 | On-topic Proposes adaptive multimodal deduplication to optimize vision-language model inference on video. | |
| DreamHMR: From Video Generation to Human Motion Modeling via Structural Focusing The paper presents a framework adapting video generation priors to improve 3D human body and hand motion reconstruction from video. Ranked #518Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Uses video generation foundation models for 3D body and hand motion modeling. | |
| Designing Textual Interfaces To Enhance Llm Reasoning On Audio-Visual Question Answering The paper compares three textual interface designs for optimizing prompts in multimodal audio-visual question answering systems. Ranked #519Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Designs textual interfaces for audio-visual multimodal LLM reasoning. | |
| PhySGA: A Physics-Space Grounded Agentic Framework for Generalizable and Interactive 3D Composition Proposes an interactive agent framework that utilizes physics simulation and spatial exploration for complex 3D object assembly and composition. Ranked #520Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Deals with 3D physical grounding and multimodal vision-language models. | |
| ActiveEvidence: Decision-Focused Evidence Graphs with Verifiable Acquisition Gaps Presents a graph-based framework with decision certificates to determine when multimodal agents should acquire visual evidence under cost constraints. Ranked #521Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Focuses on active visual evidence acquisition in multimodal contexts. | |
| Multimodal Medical Image Parsing with Task-Specific Low-Rank Adapters The paper describes a vision-language model using task-specific low-rank adapters for multimodal medical image parsing. Ranked #522Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Applies multimodal vision-language architectures to parse and analyze diverse medical image modalities. | |
| MemeTrace: A Multimodal LLM-Based Agent for Safety-Aware Meme Provenance Analysis The paper presents a multimodal agent designed to trace the origin, spread, and potential safety risks of online memes. Ranked #523Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Combines visual perturbations, image symbolism, and text for multimodal meme understanding. | |
| Towards a Data-Centric Understanding of Spatial Reasoning in Multimodal Large Language Models Surveys dataset design, construction methods, and evaluation protocols for improving spatial reasoning in multimodal language models. Ranked #524Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Provides a comprehensive survey on datasets and training methods for spatial reasoning in multimodal models. | |
| FACES: Fine-grained Gated Semantic Alignment for Multimodal Emotional Support Conversation The paper introduces a gated semantic alignment framework with multi-source rewards to improve multimodal emotional support conversations. Ranked #525Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Addresses multimodal emotional support conversation combining dialogue and multimodal inputs. | |
| Instruction Mining From Images: Constructing a Synthetic Dataset for Multimodal Learning ILSP DCVLR Competition Submission Generates a filtered synthetic dataset of image-based instruction-response pairs for training multimodal reasoning models. Ranked #526Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Presents a pipeline for synthesizing image-based instruction-response pairs to train and evaluate multimodal models. | |
| Can Learning to Answer Spatial Questions Improve Novel-View Generation? This paper introduces Ask4NV, combining multimodal 3D language understanding with camera geometry to guide novel-view image generation. Ranked #527Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Combines 3D spatial language understanding with view generation using a multimodal transformer. | |
| Representation Conditioning for Generation This paper proposes representation conditioning to feed vision encoder features into later layers of diffusion transformers for improved generation semantics. Ranked #528Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Explores aligning vision encoder semantic representations within diffusion model training. | |
| Learning Visual Speech Representations via Cross-Modal Distillation and Joint Face-Lip Modeling The paper introduces FLARE, a visual speech framework combining cross-modal distillation from audio features with dual-stream face and lip modeling. Ranked #529Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Develops a cross-modal distillation framework connecting acoustic representations with visual facial dynamics. | |
| HyrCap: Hybrid Rank-Calibration of Action Proposals for Temporal Event Understanding The paper introduces a rank-calibration framework to improve proposal localization quality for temporal action detection in long untrimmed videos. Ranked #530Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Improves video event understanding and proposal calibration for downstream LLM-driven event analysis. | |
| Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation The paper presents open speech-to-video models that generate long-form avatar video with expressive motion driven by an audio waveform. Ranked #531Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Introduces multimodal models that generate synchronized video avatars from speech and text. | |
| SPECTRA-VLA: Base-Fine Hyperspectral Token Transfer at Frozen Vision-Language-Action Interfaces Transfers hyperspectral tokens into frozen vision-language-action models via learned continuous residuals without retraining. Ranked #532Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Enriches vision-language-action interfaces with hyperspectral input tokens for multimodal tasks. | |
| Why Do VLMs Fail at Remote Physiological Measurement? Rethinking with Physiological Grounding and Numerical Alignment VITAL introduces visual-physiological token alignment to enable vision-language models to perform remote physiological measurement alongside general visual reasoning. Ranked #533Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Integrates physiological signals with vision-language models for multimodal video understanding. | |
| Focus, Align, and Diffuse: Time-Series-Aware Keyframe Diffusion for Cardiac Dynamic Synthesis from Sparse Observations CardioFAD resolves temporal ambiguity in sparse cardiac dynamic synthesis by using ECG-aligned motion-salient keyframe diffusion. Ranked #534Preprint0/10 suggested | Multimodal models via arxiv · 15 Oct, 15:06 | On-topic Aligns ECG time-series signals with sparse visual frames for multimodal synthesis. | |
| BridgeAfford: Bridging Query-Target Gap for Generalizable 3D Affordance Grounding Introduces a framework that aligns interaction regions across objects to improve 3D affordance grounding on unseen objects. Ranked #535Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Grounds natural language interaction queries onto 3D visual object regions. | |
| Full-Duplex Interaction with Speech, Expressions and Gestures Presents a full-duplex conversational model that generates real-time speech alongside synchronized facial expressions and body gestures. Ranked #536Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Presents an end-to-end multimodal model coordinating speech, expressions, and non-verbal gesture generation. | |
| X-Fly: Learning to Reach and Stop in Full-Chunk Aerial Vision-Language Navigation Proposes a training framework enabling aerial vision-language agents to navigate in full action chunks and stop reliably at destinations. Ranked #537Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Integrates vision-language inputs to control multi-step aerial navigation trajectories. | |
| Where, How, and When: Query-Guided Grounding for Video Understanding Presents methods for query-guided video grounding across object localization, relationship detection, and temporal moment identification. Ranked #538Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Investigates query-guided video understanding and multimodal grounding across text and video. | |
| TRACER: A Multimodal Harness for Patient Care in Hospitals Introduces a multimodal harness and benchmark pairing continuous video with clinical records to assist patient monitoring in hospitals. Ranked #539Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Integrates continuous patient video feeds with clinical text for multimodal reasoning. | |
| ReasonUni: Reasoning-Augmented Reconstruction Advances Unified Multimodal Models The paper introduces a reasoning-augmented reconstructive post-training framework that unifies multimodal understanding and image generation tasks. Ranked #540Preprint0/10 suggested | Multimodal models via arxiv · 17 Oct, 06:17 | On-topic Couples text-to-image generation and image-to-text reasoning in unified multimodal models using reinforcement learning. |
481–540 of 1,924← PreviousNext →