Lately, I’ve been fascinated by how filmmakers are starting to use AI to bring their stories to life. If you’re like me — a writer or director curious about stepping into AI-generated visuals — one question is probably buzzing in your mind: How do you actually tell AI what kind of shots or camera moves you want?
Here’s the thing: When you’re working with a human cinematographer, you can say things like “let’s do a wide shot with a 35mm lens” or “a tight close-up with shallow focus.” But with AI, it’s not that straightforward. You can’t just hand it a camera and lens; you have to describe what you want in words that an AI can understand and turn into images or scenes.
So, how do you get this right?
### Describe the Scene Clearly
Start with a detailed description of what’s happening. Include the setting, the mood, the characters, and what the camera sees. Instead of just saying “close-up,” try saying “a tight close-up of the protagonist’s face, capturing their intense expression, with a softly blurred background.” This gives the AI more to work with.
### Mention Lens and Shot Types in Your Description
While AI tools don’t actually ‘choose’ lenses, adding phrases like “shot with a 50mm lens” or “wide-angle perspective” helps guide the AI’s rendering. It interprets these as cues to adjust the image’s framing, depth of field, and perspective.
### Use Reference Images for Tone and Style
Sometimes words aren’t enough. If you have scanned images, mood boards, or even photos that capture the overall tone or color palette, feed those into the AI if it allows. This helps the AI grasp not just the framing, but the feeling you want in the scene.
### Experiment and Iterate
Don’t expect the first try to be perfect. AI-generated visuals often require multiple tweaks. Change your descriptions, adjust keywords, or swap out reference images to hone in on the right look. It’s a bit like working with a new crew member — it takes some back-and-forth to get on the same page.
### What I Found Useful
In my experience, being super clear and specific helps. Instead of “show a city street,” say “a rainy city street at night, neon signs glowing, shot from a low angle as if looking up the street with a 24mm lens.” This level of detail paints a better picture for the AI.
At the end of the day, AI is just another tool in the filmmaker’s kit. It won’t replace the eye of a seasoned director or DP, but used thoughtfully, it can speed up certain steps or open up new creative paths. So if you’re ready to explore AI for your films, start by talking to it — like you would with a new collaborator who’s eager to learn and create.
Got any tips or stories about your own adventures with AI in filmmaking? I’d love to hear them!