fal-lip-sync
Create talking head videos, sync lips to audio, and animate portraits using fal.ai models.
Scripts
| Script | Purpose |
|---|---|
talking-head.sh | Generate a talking head video from an image + audio/text |
lip-sync.sh | Sync lips in an existing video to new audio |
Usage
Talking Head (Image + Audio → Video)
./scripts/talking-head.sh --image-url "https://example.com/portrait.jpg" --audio-url "https://example.com/speech.mp3" --model veed/fabric-1.0Talking Head (Image + Text → Video with auto TTS)
./scripts/talking-head.sh --image-url "https://example.com/portrait.jpg" --text "Hello, welcome to our presentation" --model fal-ai/creatify/auroraLip Sync (Video + Audio → Synced Video)
./scripts/lip-sync.sh --video-url "https://example.com/video.mp4" --audio-url "https://example.com/new-speech.mp3"Arguments
talking-head.sh
| Argument | Description | Required |
|---|---|---|
--image-url | URL of portrait/face image | Yes |
--audio-url | URL of audio to sync | Yes (or --text) |
--text | Text to speak (auto TTS) | Yes (or --audio-url) |
--model / -m | Model endpoint | No (default: veed/fabric-1.0) |
--tts-model | TTS model for --text mode | No (default: fal-ai/minimax/speech-2.6-turbo) |
--wait / -w | Wait for completion | No (default: true) |
--async / -a | Return request ID immediately | No |
lip-sync.sh
| Argument | Description | Required |
|---|---|---|
--video-url | URL of video to lip sync | Yes |
--audio-url | URL of audio to sync to | Yes |
--model / -m | Model endpoint | No (default: fal-ai/sync-lipsync/v2) |
Finding Models
To discover the best and latest lip sync and talking head models, use the search API:
# Search for talking head models
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "talking head"
# Search for lip sync models
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "lip sync"
# Search for live portrait / expression transfer
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "live portrait"Or use the search_models MCP tool with relevant keywords like "lip sync", "talking head", "avatar".
Output Format
{
"video": {
"url": "https://fal.media/files/...",
"content_type": "video/mp4"
}
}Present the video URL directly to the user.