Text-to-Video Generation
Lesson 1: Writing Effective Text Prompts
Lesson Objectives
By the end of this lesson, students should be able to:
- Structure a prompt with visual, motion, and style elements
- Write specific visual descriptions rather than abstract concepts
- Use quality and style modifiers effectively
- Avoid common prompt structure mistakes
Lesson Content
The four prompt elements.
An effective text-to-video prompt typically includes: (1) visual description – what is in the scene (subjects, environment, lighting); (2) motion description – what is moving and how (camera motion, subject motion); (3) style – the visual aesthetic (cinematic, painterly, photorealistic, stylized); and (4) quality modifiers – words that influence output quality (high quality, detailed, professional cinematography, sharp focus). Not every prompt requires all four, but considering each element produces more controlled results.
Specific visual description.
Vague prompts produce unpredictable results. "A person walking" is vague – "a person in a red coat walking through a rainy city street at night, neon reflections on wet pavement" is specific. The more specific the visual description, the more aligned the generation is likely to be with the intended scene. Describe subjects, environment, time of day, lighting, and any other scene details that matter.
Motion description.
Including motion description helps the model understand what should be moving and how – "slow pan right," "camera tracking forward," "leaves falling gently," "waves rolling toward shore." Without motion description, the model may produce minimal or unpredictable motion.
Style and quality modifiers.
Style descriptors (cinematic, oil painting style, neon-lit cyberpunk aesthetic) shift the visual style of the output significantly. Quality modifiers (8K, highly detailed, professional photography, sharp focus) are commonly used but their effect varies by model – experiment to understand what works with the specific generation model in use.
Enroll to continue this lesson.
The preview above shows the lesson objectives and opening lesson content. Enroll to view the full lesson, complete the practice work, and take the lesson quiz.
