USING AI FOR VIDEO
A Quick Update On The Latest Tips And Tools
Jeff MacDonald
@jeffmacaddress
First, AI Story Boarding
Quickly Tell A Story Using AI Image Generation
Character Reference
Gives us Consistent Characters from Image to Image
In Midjourney
--cref URL
Image of your character
--cw 0-100
character weight, or how much influence it will have
Here’s our original image next to our Character Refrenced Image Generation
Now let’s repeat this style for our next board...
Style Reference
In Midjourney
Gives us a consistent look for future image generations
--sref URL
Image of your style to repeat
--sw 0-1000
style weight, or how much influence it will have
--sw 800
Style Reference
Adobe Firefly
A bit more straightforward, but still allows you to change the weighting.
But doesn’t have character reference, so it doesn’t look like me.
New Adobe Firefly Feature:
Structure Reference
Sketch
Firefly Structure Reference
Gives Us The Chance To Keep our Styles and Influence Layout By Sketching Out Before Hand
taking your story boards and turning them into videos
AI Video Animation
Start to Bring You Images To Life
Pika.art
Takes your images and turns them into videos with some controls on position
Runway
Samething, but with more refined controls
AI Music Generation
Add Sound To Your Videos
Create up to 40 seconds of music for your videos with Google’s AI Music Generator
AI Speech Generation
Add A VO to your videos
Eleven Labs, or similar tools allow you to test the length of you scripts, and make better sound videos.
RECAP
Move From Storyboards to Videos
Use tools like Adobe Firefly’s Structure Reference to go from Sketch To Story Board
Use Style Reference and Character Reference To Create Consistent Story Boards
Use Pika or Runway to turn you storyboards in videos. And generative music and SFX to bring your video to life.
Thank you
Find more of my tips at