When I shared my Sora AI videos with Emil Lucas, Executive Director of Product Implementation at Vizcom, he recommended that I try Runway ML’s AI video generator. I liked it so much that I got a subscription. In this post, I compare Sora with Runway.
Gen 3-Alpha is Runway’s video generation model which creates a video from an image. What I like about Runway is the quality and smoothness of its videos plus the excellent surface execution of the featured cars. I’ve included examples of videos from each program which were generated from the same Cadillac image. The first two are from Sora and the last two are from Runway. Like Sora, Runway makes up completely new designs, on occasion, which can be frustrating when you’re trying to develop a specific theme.
I also like that Runway gives you 5 to 10 second videos at 720p for $12/mo versus 5 to 10 second videos at 480p (up to 720p) for $20/mo for the base plans. However, Runway’s Gen-3 Alpha burns through its 625 credits/mo quickly to create only six 10 second videos/mo. You can buy more credits as needed.
What sets Runway apart is its camera control capabilities. You can adjust the camera to pan, zoom , tilt or roll plus move horizontally or vertically or any combination thereof. You can also adjust the dolly speed. Adding text in the prompt adds more control.
You can edit your video by cutting its length anywhere you like, unlike Sora which regenerates new video to fill the void up to 5 or 10 seconds.
You can even create special animations with video to video editing.
I’ve included a ‘What is Runway’ link under the AI Video category on my website or checkout the Runway tutorial below.
There are qualities of both AI models that I like. Runway wins on the car surface execution although it can distort the whole car unnaturally in the video. Sora produces dynamic shoots but can contain glitchy artifacts or local distortions of the car’s surface. Runway is more sophisticated with its camera controls and many other capabilities. I’m still learning how to optimize the camera movement and having better luck just using the prompt to describe the camera motion. You be the judge on which looks more appealing.
I took a frame that I liked from the second Sora video of my Cadillac Flagship and rendered it with Photoshop as the featured image. I put that image in Runway to create the CT5 video shown third. The car looks too small in the final Runway video to be called a flagship, so now I’m labeling it a CT5. I purposefully left the grille off since this is meant to be an electric car. The intersecting shapes on the front end imply a Cadillac grille perimeter.
2 Responses
Stunning!
Amazing transformation. Suggestion: Instead of calling it a Cadillac CT5e, how about calling it the Cadillac CT5-V? Gasoline is making a comeback.