Episode

MulTaBench: Benchmarking Multimodal Tabular Learning with Text and Image

Podcast
Daily Paper Cast
Published
May 15, 2026
Duration seconds
1453
Processing state
not_requested
Canonical source
https://share.transistor.fm/s/0c7a3b1e
Audio
https://media.transistor.fm/0c7a3b1e/ca925a6a.mp3
JSON
/v1/public/podcasts/daily-paper-cast-7079649/episodes/multabench-benchmarking-multimodal-tabular-learning-with-text-and-image
Markdown
/podcast/daily-paper-cast-7079649/multabench-benchmarking-multimodal-tabular-learning-with-text-and-image.md

Actions

  • POST https://stenobird.com/v1/public/podcasts/daily-paper-cast-7079649/episodes/multabench-benchmarking-multimodal-tabular-learning-with-text-and-image/transcription-requests
    Idempotently request low-priority transcript generation for this episode.
  • GET https://stenobird.com/podcast/daily-paper-cast-7079649/multabench-benchmarking-multimodal-tabular-learning-with-text-and-image.md
    Read the agent-friendly Markdown representation of this episode resource.

Summary

šŸ¤— Upvotes: 122 | cs.LG, cs.CL, cs.CV Authors: Alan Arazi, Eilam Shapira, Shoham Grunblat, Mor Ventura, Elad Hoffer, Gioia Blayer, David Holzmüller, Lennart Purucker, GaĆ«l Varoquaux, Frank Hutter, Roi Reichart Title: MulTaBench: Benchmarking Multimodal Tabular Learning with Text and Image Arxiv: http://arxiv.org/abs/2605.10616v1 Abstract: Tabular Foundation Models have recently established the state of the art in supervised tabular learning, by leveraging pretraining to learn generalizable representations of numerical and categorical structured data. However, they lack native support for unstructured modalities such as text and image, and rely on frozen, pretrained embeddings to process them. On established Multimodal Tabular Learning benchmarks, we show that tuning the embeddings to the task improves performance. Existing benchmarks, however, often focus on the mere co-occurrence of modalities; this leads to high variance across datasets and masks the benefits of task-specific tuning. To address this gap, we introduce MulTaBench, a benchmark of 40 datasets, split equally between image-tabular and text-tabular tasks. We focus on predictive tasks where the modalities provide complementary predictive signal, and where generic embeddings lose critical information, necessitating Target-Aware Representations that are aligned with the task. Our experimental results demonstrate that the gains from target-aware representation tuning generalize across both text and image modalities, several tabular learners, encoder scales, and embedding dimensions. MulTaBench constitutes the largest image-tabular benchmarking effort to date, spanning high-impact domains such as healthcare and e-commerce. It is designed to enable the research of novel architectures which incorporate joint modeli…