# Multimodal datasets and corresponding models

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultimodal-datasets-and-corresponding-models%2F145374%3E%5C
**Category:** Beginners\
**Created:** [March 12, 2025, 10:06am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultimodal-datasets-and-corresponding-models%2F145374 "2025-03-12T10:06:38Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![wRise](https://avatars.discourse-cdn.com/v4/letter/w/e36b37/32.png) [@wRise](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FwRise)%5C
**Post date:** [March 12, 2025, 10:06am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultimodal-datasets-and-corresponding-models%2F145374%2F1 "2025-03-12T10:06:38Z")

</div>

Is there a model that can process multi-modal data like “CMU-MOSI” on huggingface? I’ve just learned, please advise.

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [March 12, 2025, 10:49am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultimodal-datasets-and-corresponding-models%2F145374%2F2 "2025-03-12T10:49:52Z")

</div>

If you search for models that can handle images and text using keywords such as VQA or VL, you should be able to find many. There are still very few models that can handle audio, but the following are some well-known, recent examples.

> **[microsoft/Phi-4-multimodal-instruct · Hugging Face](https://huggingface.co/microsoft/Phi-4-multimodal-instruct)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

> **[Qwen/Qwen2-Audio-7B-Instruct · Hugging Face](https://huggingface.co/Qwen/Qwen2-Audio-7B-Instruct)**
>
> We’re on a journey to advance and democratize artificial intelligence through open source and open science.

---

<div class="post-metadata">

**Author:** ![wRise](https://avatars.discourse-cdn.com/v4/letter/w/e36b37/32.png) [@wRise](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FwRise)%5C
**Post date:** [March 12, 2025, 11:41am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmultimodal-datasets-and-corresponding-models%2F145374%2F3 "2025-03-12T11:41:29Z")

</div>

> [@John6666](#):
>
> If you search for models that can handle images and text using keywords such as VQA or VL, you should be able to find many. There are still very few models that can handle audio, but the following are some well-known, recent examples.

appreciate
