Media Understanding
使用 Gemini 2.5 Flash 分析和理解多媒体内容。
Supported Formats
| Type | Formats | Max Size |
|---|---|---|
| Image | jpg, jpeg, png, gif, webp | 20MB |
| Video | mp4, mpeg, mov, webm, YouTube URL | 100MB |
| Audio | wav, mp3, aiff, aac, ogg, flac, m4a | 100MB |
Prerequisites
MAX_API_KEY环境变量（Max 自动注入）- Bun 1.0+（Max v0.0.27+ 内置，无需额外安装）
Usage
bun skills/media-understand/media-understand.js <media_path_or_url> [prompt] [language]Arguments:
media_path_or_url: File path or YouTube URLprompt: Question or analysis request (default: "Please describe this content")language: Output language -chineseorenglish(default: chinese)
Examples
Image Analysis
# Describe image
bun skills/media-understand/media-understand.js ./photo.jpg "请描述这张图片" chinese
# OCR - Extract text
bun skills/media-understand/media-understand.js ./screenshot.png "识别图片中的所有文字" chinese
# Answer question about image
bun skills/media-understand/media-understand.js ./chart.png "这个图表显示了什么趋势？" chineseVideo Analysis
# YouTube video summary
bun skills/media-understand/media-understand.js "https://youtube.com/watch?v=xxx" "总结这个视频的主要内容" chinese
# Local video analysis
bun skills/media-understand/media-understand.js ./video.mp4 "视频中发生了什么？" chinese
# Timestamp-based question
bun skills/media-understand/media-understand.js "https://youtu.be/xxx" "视频 2:30 处讲了什么？" chineseAudio Analysis
# Transcribe audio
bun skills/media-understand/media-understand.js ./recording.mp3 "请转录这段音频" chinese
# Summarize podcast
bun skills/media-understand/media-understand.js ./podcast.m4a "总结这段播客的要点" chinese
# Detect speakers
bun skills/media-understand/media-understand.js ./meeting.wav "识别不同的说话人并整理他们说的内容" chineseCommon Prompts
Image:
- 描述图片: "请详细描述这张图片的内容"
- OCR: "识别并提取图片中的所有文字"
- 物体识别: "图片中有哪些物体？"
Video:
- 总结: "总结这个视频的主要内容"
- 时间戳: "视频 X:XX 处发生了什么？"
- 提取信息: "视频中提到了哪些关键信息？"
Audio:
- 转录: "请转录这段音频的完整内容"
- 总结: "总结这段音频的要点"
- 说话人识别: "识别不同的说话人"
Notes
- Video via Gemini: Best results with YouTube URLs. Local video files may have limited support.
- Audio tokens: ~32 tokens/second
- Video tokens: ~300 tokens/second at default resolution
- Long media files will consume more tokens
Error Handling
File not found: Check the file path is correct
Unsupported format: Use supported formats listed above
File too large: Compress or trim the media file
API error: 请在 Max 设置中检查 Max API Key 是否正确配置