Image-to-Video and Video Extension
Lesson 2: Controlling Motion in Animated Images
Lesson Objectives
By the end of this lesson, students should be able to:
- Use motion brush or motion controls to direct animation to specific areas
- Control motion intensity settings
- Write motion prompts that produce specific directional behaviors
- Avoid over-animation that distorts the source visual
Lesson Content
Motion brush and area-specific controls.
Runway has provided motion brush or similar tools that allow directing motion to specific areas of the image – applying movement to a particular element (the background trees) while keeping another element (the foreground subject) more static. Verify current availability and behavior of motion-specific controls at runwayml.com, as these features evolve.
Motion intensity settings.
Many image animation tools provide motion intensity controls – higher intensity produces more dramatic movement but risks more distortion from the source image's visual; lower intensity produces subtle movement with better source image fidelity. Match intensity to the creative intent: subtle atmosphere (low intensity) vs. dramatic motion effect (higher intensity, with acceptance of more distortion).
Writing directional motion prompts.
Motion direction specificity matters: "camera moving right" vs. "camera moving left," "zoom in" vs. "zoom out," "subject walking toward camera" vs. "subject walking away." Clear directional language in the motion prompt reduces ambiguity about the intended motion direction, even if not all motion directions are perfectly controllable in every generation.
Avoiding over-animation distortion.
High motion intensity settings or motion prompts describing very rapid or extreme movement often produce significant distortion from the source image – faces and fine details particularly suffer from over-animation. For content where source image fidelity matters, prefer subtle motion settings and descriptors that favor gentle movement.
Enroll to continue this lesson.
The preview above shows the lesson objectives and opening lesson content. Enroll to view the full lesson, complete the practice work, and take the lesson quiz.
