Video from Frames

Generate smooth video transitions between two frames using Google DeepMind's Veo 3.1 model via fal.ai.

See references/fal-api.md for setup, Python patterns, and error handling.

API Endpoint

fal-ai/veo3.1/first-last-frame-to-video

Parameters

Required

prompt (string): Text description of how the video should transition between frames
first_frame_url (string): URL of the first/starting frame (use fal_client.upload_file() for local files)
last_frame_url (string): URL of the last/ending frame (use fal_client.upload_file() for local files)

Optional

Parameter	Type	Default	Options
`duration`	string	"8s"	"4s", "6s", "8s"
`aspect_ratio`	string	"auto"	"auto", "9:16", "16:9"
`resolution`	string	"720p"	"720p", "1080p"
`generate_audio`	boolean	true	Disable to save ~50% credits

CLI Script

python3 scripts/fal_generate.py \
    --endpoint video-from-frames \
    --prompt "Smooth transition from day to night" \
    --first-frame morning.jpg \
    --last-frame night.jpg \
    --duration 8s \
    --video-resolution 1080p \
    --output video.mp4

Tips

Ensure both frames have similar composition and framing for smooth transitions
Describe the transition motion and action clearly in the prompt
Works best when both frames share the same subject or scene from the same viewpoint
Use longer duration (8s) for complex transitions with many intermediate states
The AI interpolates plausible motion between the two frames
Upload local files with fal_client.upload_file() before passing as frame URLs
Shorter duration (4s) generates faster and works well for simple transitions