Veo 3.1 First-Last-Frame-to-Video

Generate smooth video transitions between two frames using Google DeepMind's Veo 3.1 model via fal.ai.

Prerequisites

• FAL_KEY environment variable must be set (typically in ~/.zshrc)

API Endpoint

POST https://fal.run/fal-ai/veo3.1/first-last-frame-to-video

Parameters

Required

• prompt (string): Text description of how the video should transition between frames
• first_frame_url (string): URL of the first/starting frame
• last_frame_url (string): URL of the last/ending frame

Optional

Usage

cURL

curl --request POST \
  --url https://fal.run/fal-ai/veo3.1/first-last-frame-to-video \
  --header "Authorization: Key $FAL_KEY" \
  --header "Content-Type: application/json" \
  --data '{
    "prompt": "Smooth time-lapse transition from day to night as the sun sets",
    "first_frame_url": "https://example.com/daytime-scene.jpg",
    "last_frame_url": "https://example.com/nighttime-scene.jpg",
    "duration": "8s",
    "resolution": "1080p",
    "generate_audio": true
  }'

Python

import fal_client

result = fal_client.subscribe(
    "fal-ai/veo3.1/first-last-frame-to-video",
    arguments={
        "prompt": "Smooth time-lapse transition from day to night as the sun sets",
        "first_frame_url": "https://example.com/daytime-scene.jpg",
        "last_frame_url": "https://example.com/nighttime-scene.jpg",
        "duration": "8s",
        "resolution": "1080p",
        "generate_audio": True
    }
)

# Access the generated video URL
video_url = result["video"]["url"]
print(f"Generated video: {video_url}")

JavaScript

import { fal } from "@fal-ai/client";

const result = await fal.subscribe("fal-ai/veo3.1/first-last-frame-to-video", {
  input: {
    prompt: "Smooth time-lapse transition from day to night as the sun sets",
    first_frame_url: "https://example.com/daytime-scene.jpg",
    last_frame_url: "https://example.com/nighttime-scene.jpg",
    duration: "8s",
    resolution: "1080p",
    generate_audio: true
  }
});

console.log("Generated video:", result.video.url);

Response Format

{
  "video": {
    "url": "https://storage.googleapis.com/.../output.mp4"
  }
}

Examples

1. Time-lapse transition:

   • First frame: Morning cityscape
   • Last frame: Same cityscape at night
   • Prompt: "Time-lapse of the city from morning to night, lights gradually turning on"

2. Seasonal change:

   • First frame: Summer landscape
   • Last frame: Winter landscape (same location)
   • Prompt: "Seasons change from summer to winter, leaves fall and snow covers the ground"

3. Transformation:

   • First frame: Empty room
   • Last frame: Furnished room
   • Prompt: "Furniture magically appears and arranges itself in the room"

4. Growth animation:

   • First frame: Seed in soil
   • Last frame: Full-grown plant
   • Prompt: "Plant grows from seed, stem emerges and leaves unfold"

5. Scene morphing:

   • First frame: Photo of a person
   • Last frame: Artistic painting of the same person
   • Prompt: "Realistic photo gradually transforms into an impressionist painting"

Tips

• Ensure both frames have similar composition for smooth transitions
• Describe the transition motion/action in the prompt
• Works best when both frames share similar subjects or scenes
• Use longer duration (8s) for complex transitions
• The AI will interpolate the motion between the two frames

Error Handling