Understanding Multimodal LLMs: Integrating Vision, Language, and Audio
Explore how multimodal LLMs unify text, images, and audio, detailing architecture and future implications in AI.
Tag
#multimodal
4 stories · 6 tools
Stories
Google Unveils Gemma 4 12B: Open-Source Multimodal AI for Local Laptops
Google has released Gemma 4 12B, an open-source multimodal AI model designed to run locally on consumer laptops. The Apache 2.0-licensed model handles vision, audio, reasoning, and agents through a streamlined architecture that eliminates separate heavy encoders.
Google drops Gemma 4 12B: tiny multimodal model runs locally on 16GB VRAM
Google has released Gemma 4 12B, a compact multimodal model capable of running locally on a laptop with just 16GB of VRAM, as the Gemma series surpasses 150 million downloads. The new weights are available on Hugging Face under an Apache 2.0 license.
Google’s Nano Banana 2 and Pro hit general availability with video input
Google has moved Nano Banana 2 and Nano Banana Pro to general availability on its APIs, adding video file support for Nano Banana 2.
Tools
Open source
MiniMax
A full-stack multimodal AI platform offering text, video, voice, music, and agent capabilities for developers and creators.
apiPaid
Open sourceMoonshot AI
Research-driven AI lab offering the Kimi assistant for coding, analysis, slides, and multimodal research with API access.
chatFreemium
Open sourceChatGLM
A Chinese-native AI assistant platform powered by the GLM-5.1 agentic model, offering long-running autonomous agents, multimodal tools, and team collaboration via WeChat and Feishu.
agentsFreemium
Genspark
An all-in-one AI workspace bundling chat, slides, sheets, docs, image, video, music, and audio generation with Microsoft 365 plugins for teams and enterprises.
productivityFreemium
ERNIE
Baidu's multimodal AI assistant combining reasoning, writing, coding, and image generation for Chinese and global users.
chatFreemium
Claude
A general-purpose AI assistant with advanced reasoning, coding, and agentic tools for individuals and enterprise teams.
chatFreemium