Gen-2 by Runway
Overview
Gen-2 is a generative AI model that allows users to generate new videos out of existing ones, using words and images to create compelling pieces of footage. By applying the composition and style of an image or text prompt to the structure of a source video, Gen-2 can realistically and consistently synthesize new videos without the need for lights or cameras.
Gen-2 has 8 modes: Text to Video, Text + Image to Video, Image to Video, Stylization, Storyboard, Mask, Render and Customisation. The Stylization mode allows users to transfer the style of any image or prompt to every frame of a video, resulting in fully stylized and animated renders. The Storyboard mode, on the other hand, turns mockups into fully stylized and animated renders.
According to user studies, results from Gen-2 are preferred over existing methods for image-to-image and video-to-video translation, with 73.53% of users preferring it over Stable Diffusion 1.5 and 88.24% of users preferring it over Text2Live.
Gen-2 represents a significant advancement in generative AI, as it allows users to create new videos without the need for extensive filming and editing. Its ability to turn any video into a compelling piece of footage has the potential to revolutionize the film industry and bring the magic back to making movies.
Overall, Gen-2 represents an exciting step forward for generative AI, and its capabilities have the potential to change the way we approach video production and storytelling.
How much does Gen-2 by Runway cost?
RunwayML Research does not offer pricing plans for their research publications and tools. Their website provides research papers, interviews with researchers, and technical walkthroughs of their AI-powered creative tools, but no pricing information is provided.
Additionally, they are currently hiring for various roles in applied research, engineering, ML Ops, and more. However, no information regarding compensation or benefits for these roles is provided on their website.
It is possible that RunwayML Research generates revenue through their enterprise-level products and services, which may include custom AI models and consulting services. However, information regarding these offerings is not available on their website.