How to Animate Over a Video in Procreate
StyleFrame Team8 min read
To animate over a video in Procreate, use Procreate Dreams: import the clip so it becomes its own track, add a new track above it, and draw frame by frame in Flipbook mode. In classic Procreate, one approach is to convert the footage to an image sequence and import the frames as layers in Animation Assist. Either way, the process is the same: match your canvas to the footage, plan the motion, draw on top, then export for compositing.
Procreate vs. Procreate Dreams: Which One You Need
The two apps work differently, and most confusion around this keyword comes from mixing them up.
Procreate Dreams is built for animation. It has a multi-track timeline, a frame-by-frame Flipbook tool with onion skins, and keyframing, so a video clip is simply another track you can draw above. This is the right tool for rotoscope-style linework, hand-drawn FX, and graphic overlays on footage.
Classic Procreate is a painting app with Animation Assist. Its workflow for drawing over footage differs from Dreams, and one approach is a prepared image sequence, covered below.
If you animate professionally, Dreams is the more practical choice for this job. The rest of this guide focuses on it.
Step 1: Set Up the Project to Match Your Footage
Start with the project settings, because changing them later is painful.
- Canvas size: Match your source footage. If you shot or exported 4K UHD widescreen, create a 4K widescreen project so your drawings land at the same resolution as the plate.
- Frame rate: Many hand-drawn artists work at 12 fps, which is the equivalent of drawing on twos in a 24 fps timeline. If your footage is 24 fps, 12 fps drawings keep a classic animated feel and halve your workload. If you need drawings on every frame, such as for tight rotoscoping, set the project to match the footage frame rate instead.
- Duration: Set a project length at least as long as your clip. You can extend it later, but starting with the right length avoids trimming surprises.
Keep your footage frame rate in mind from the beginning. A mismatch between a 12 fps drawing track and a 30 fps plate is manageable, but you should choose it on purpose rather than discover it at export.
Step 2: Import the Video as a Track
Add media with the plus icon in the timeline and pick your clip. You can also drag a video in from another app, and it becomes its own track.
A few practical notes:
- Performance: 4K video can be heavy, especially on older or less powerful iPads. If playback stutters or the app crashes, open the import options and switch the format to the most compatible setting. This adjusts the format so the app handles the clip better.
- Trim first: Cut the clip to the section you actually need in Premiere Pro or another editor before importing. Shorter clips scrub faster and keep the project small.
- Lock the plate: Once the video is in place, lock or otherwise avoid accidentally moving the track. A nudged background invalidates every drawing above it.
Step 3: Add Tracks Above the Video
Create at least two new tracks above the footage:
- A guide track for planning (motion paths, timing marks).
- An animation track for the final drawings.
Keeping them separate means you can hide, lower, or delete the planning layer without touching finished work. For complex shots, add more tracks, such as one per character, effect, or color pass, so each element can be adjusted independently later.
Step 4: Plan the Motion Before You Draw
Straight-ahead animation, where you draw one frame after another without a full plan, gets messy over live footage. A quick guide pass saves time.
On the guide track, pick a high-contrast color that you won't use in the final art. Then:
- Draw the motion path for each element, such as a shape entering the frame or a line tracing a moving subject.
- Add tick marks along the path to set spacing. Marks close together mean slow movement, and wide gaps mean fast movement. This is the same spacing-chart logic you would use in any animation package.
- Lower the guide opacity so it doesn't compete with your drawings.
- Use fill duration to extend the frame so the guide stays visible across the whole stretch you're animating.
The marks do the work of an ease curve. You decide where the action accelerates or settles, and your drawings follow.
Step 5: Draw Frame by Frame in Flipbook
Select the empty animation track and enter Flipbook mode. This is where the hand-drawn work happens.
- Pick a brush that holds up at 4K. A clean inking pen such as the Studio Pen works well for linework. Choose a color that reads against the footage, and test it against both the lightest and darkest parts of the shot.
- Draw the first frame from your first tick mark, then advance a frame and redraw the shape extended to the next mark.
- Taper and vary shapes as the motion develops. Fluid or organic movement needs shape change, not just translation, so leading edges should stretch and tails should thin out.
- Use onion skins sparingly. Showing one previous frame is often enough and keeps the canvas readable. Turn the guide track off when it gets in the way.
- Follow the plate. If the footage contains rotation, such as a spinning record or a turning head, rotate your drawn shapes with it so they feel attached to the scene.
Work in short sections. Finish a few seconds, play it back against the video at full speed, and fix timing before moving on. Problems found early cost minutes; problems found at the end cost hours.
Step 6: Deal with Camera Shake
Handheld footage causes the most trouble when animating over video. Your drawings stay still in the frame while the camera moves, so they appear to slide across the image.
Two approaches:
- Stabilize first. Run the clip through a stabilizer in your video editing or compositing software, export the stable version, and import that into Procreate Dreams. Your drawings then stay put relative to the scene.
- Draw to the shake. For stylized work where the overlay should feel loose, you can ignore minor movement. For graphic elements pinned to objects, stabilize first.
If you plan to composite the drawing track over the original shaky footage later, you can track the motion in After Effects and apply it to your exported animation, but that adds a step. Decide which route fits your pipeline before you draw.
The Classic Procreate Workaround
If you only have classic Procreate, here is the image-sequence method:
- Convert your clip to a numbered image sequence in After Effects, Premiere Pro, or a command-line tool. Keep it short and at a manageable resolution.
- Create a canvas that matches the frame dimensions.
- Turn on Animation Assist from the Actions menu and import the frames as layers, one per frame, as the bottom reference.
- Add a new layer above each reference frame and draw on it.
- Hide or merge the reference layers, depending on whether you need the footage in the export.
This works for short clips, but it is slow and awkward for anything beyond a few seconds. For long shots, Dreams is much better suited to the job.
Exporting and Finishing in Your Compositor
Hand-drawn animation rarely ends in the iPad. Plan the handoff:
- Export the drawing tracks on their own if your version of the app allows it, so you can composite them over the original footage in After Effects or Premiere Pro. Check the export options in your version of the app for what formats and alpha support are available.
- Export at full resolution. Don't downscale in the app; resample in your compositor if you need to.
- Composite for polish. Add grain, blur, glow, or color matching in After Effects so the drawn layer sits in the plate rather than on top of it.
Where Styleframe Fits Beside This Workflow
Drawing every frame by hand gives you total control, but it's expensive for long shots. Styleframe is an AI video and motion tool that some artists may consider alongside this workflow, particularly for the part of the job where you want a drawn look across a whole clip, or want to extend your work.
It doesn't replace hand-drawn animation, and it isn't needed for short overlays. It earns its place when you want a consistent illustrated look over many shots, or when you want to build on your own keyframes.
Quick Troubleshooting
- Video plays back choppy: Switch to the compatible import format, close other apps, or transcode to a lighter codec before importing.
- Drawings drift from the subject: Stabilize the plate or redraw with tighter onion skin reference.
- Timing feels mechanical: Revisit your tick marks; uneven spacing creates natural ease.
- Linework flickers: Reduce variation in line weight between frames, or switch to drawing on twos so each pose holds longer.
- Export doesn't match the footage frame rate: Check project fps against the source before drawing, not after.
Final Checklist
- Match canvas size and frame rate to the footage.
- Import the clip and use a compatible format if performance suffers.
- Add guide and animation tracks above the video.
- Plan motion with paths and tick marks.
- Draw in Flipbook, checking playback often.
- Stabilize footage when drawings need to stick to the scene.
- Export at full resolution and finish in your compositor.
Follow those steps and animating over video becomes a repeatable workflow rather than a one-off trick, whether the drawings are fully hand-made or combined with other tools in your pipeline.