Image and Video Animation

Lesson 3: Combining Image and Text for Guided Generation

Lesson Objectives

By the end of this lesson, students should be able to:

  • Use an image as a visual reference alongside a text prompt
  • Understand how image and text inputs interact in generation
  • Evaluate when combined image+text generation suits a creative goal
  • Choose between animation (animate the exact image) and reference generation (use image as reference only)

Lesson Content

Image as reference vs. animation.

Using an image in Pika has two distinct modes: (1) animation – animating the exact image as a starting visual; (2) reference – providing an image as a visual style or subject reference while the text prompt drives what actually happens in the generated video. Understanding which mode is in use (and which is intended) determines the expected output behavior.

Text prompt in combined generation.

When an image is used as reference, the text prompt describes what should happen in the generated video – the image influences the visual style and appearance while the text drives the content and motion. This can produce more visually anchored text-to-video results than text alone.

When to use combined generation.

Combined image+text generation is particularly useful when: you have a visual reference that defines the style or aesthetic you want (from a prior generation, a found reference image, or an illustration) but want to generate new content consistent with it, rather than animating the exact image. The image anchors the visual feel while the text defines the new content.

Evaluating combined results.

Evaluate whether the generated clip is visually consistent with the reference image's style (if used as reference) or whether the animation accurately reflects the motion description (if used as animation). These are distinct success criteria depending on the intended use of the image input.

Enroll to continue this lesson.

The preview above shows the lesson objectives and opening lesson content. Enroll to view the full lesson, complete the practice work, and take the lesson quiz.

Log In / Create Account
Back to Course