"Generative AI has given immense capabilities to editors & content creators"

Since its conception, artificial intelligence (AI) has advanced significantly and is currently becoming more and more integrated into our daily lives. The creation and production of content is one area where artificial intelligence is making a big influence.

Ashwin Limaye, CPO, VideoVerse in an interaction with VnD explains the role of Videoverse in leveraging AI, Role of Generative AI in Transforming Video Analysis and Editing, The Future of AI and much more.

Videoverse is a technology startup that is helping Indian and global broadcasters to increase their viewership. It does so by using video editing tools using AI and provides a next-generation platform for all enterprise and individual content creators while incorporating the world’s foremost Machine Learning technology to empower all content creators to maximise video content in real time. The company encapsulates an ecosystem of smart video editing tools using AI & ML. Here are some excerpts from the interaction:

VnD: Considering the ongoing World Cup, Please explain the role of AI in enhancing the live streaming and broadcasting experience.

Ashwin Limaye- The World Cup Cricket 2023 has witnessed the advent of a progressive era for cricket, thanks to AI and data analytics. Automated cameras ensure optimal angles and visual effects enhance commentator analysis with real-time stats and player info. Data analytics has introduced the economy rate as a crucial metric for assessing bowlers’ performance. Furthermore, data analytics helps assess player performance and identify opponent strengths and weaknesses for targeted improvement. Analysis as such helps in formulating strategies to optimize the likelihood of victory, allowing teams to implement tactics that can alter the outcome of the game.

This is the first year that ICC is also offering Vertical Feeds and besides the hardware, they are overlaying it with Key features like ball tracking, player tracking and field plotting to fit the vertical format

Player analytics offer real-time insights on performance, while AR and VR create immersive experiences, and automated captioning aids accessibility. Predictive analytics generate forecasts for scores and game-turning moments. ICC have invited over 500 content creators with, access to exclusive content during matches, catering to individual preferences and sustaining viewer engagement. Broadcasters not only elevate game enjoyment but also revolutionize the global cricket experience, broadening their viewer base considerably.

VnD: Please highlight the role of Videoverse in leveraging AI in their video editing tools to improve the quality and engagement of live content.

Ashwin Limaye- Live content is no longer a one-size-fits-all; instead, we see an increasing need to transform live content into a personalized viewer experience; which means that we aim to deliver the content of interest, on demand, on the device of choice.

Our AI tools enable us to analyze live content feeds and create clips and key-moment highlights with tagged events & players so that a viewer can choose to view the most exciting, engaging moments of the live game in near real-time. We also transform live content into a range of aspect ratio formats, to deliver the optimal viewing experience by platform and device.

Tailoring live content to individual preferences is the new norm, moving away from the one-size-fits-all approach. Leveraging advanced AI tools, we meticulously analyze live content streams, generating clips and highlighting pivotal moments with tagged events and players. It enables viewers to swiftly access the most riveting and immersive segments of the live game in near real-time. Furthermore, we adapt live content into a range of aspect ratios, ensuring an optimal viewing experience across diverse platforms and devices. AI translates commentaries, tailoring content to regions in native languages for a global, inclusive experience.

Precision in sports analysis, like cricket bowler detection, poses challenges due to varying camera angles. In response, we have employed a precisely calibrated deep learning model, supported by audio and visual algorithms, to maximize accuracy and track the ball even while editing and resizing the same content.

 VnD: What is the Role of Generative AI in Transforming Video Analysis and Editing?

Ashwin Limaye- Generative AI has given immense capabilities to editors & content creators, enabling them to obtain image/audio/video content on demand, and tools are increasingly building integrations to enable legacy workflows to be automated, while also creating new innovations.

We have seen Adobe integrate GenAI into its suite of products, enabling faster edits, colour corrections and even image/video creation; there is clearly a lot of potential to be explored.

In terms of video analysis and editing, we are exploring potential usecases to:

1. Generate video titles, captions and descriptions from video analysis, that would help editors working on live feeds to automate and optimize their workflows
2. Generating videos in different sizes/formats, while keeping the key object of attention (be it a player, ball or other object) in frame
3. Creating suggested ‘edit templates’ for videos, which would enable editors to select from a list of text/audio/video combinations that would be the best fit for the video

VnD: Considering the Indian Market particularly, what is The Future of AI and Video Content Creation?

Ashwin Limaye- AI has brought about a revolution in content creation, providing creators with increased efficiency, cost savings, and an enhanced ability to think outside the box. The creator community in India is thriving, experiencing a remarkable annual growth rate of over 115%, which exceeds the global average. As AI technology advances, it is becoming increasingly accessible to creators of all kinds, enabling them to work with greater efficiency and effectiveness. AI can automate video editing on content creation platforms, revolutionising the process with unmatched efficiency. Beyond personalising social media feeds, AI adeptly generates compelling, contextually relevant content that is proficient in reshaping production, distribution, and engagement. We help content creators utilise AI and ML algorithms, employing technologies such as OCR, face, and vision recognition, LLMs, and NLP to produce captivating content. AI-powered generators also enable creators to bring imaginative concepts to life seamlessly. Leveraging AI, creators can broaden their social impact, unlocking additional levels of growth and success. VnD: Please explain the  Integration of AI and Virtual Reality in Video Production

Ashwin Limaye- AI has transformed video production, reshaping the creative process from start to finish. The algorithms excel at analysis, pattern recognition, and predicting audience engagement. In live events, AI performs tasks like camera tracking, freeing creators to focus on storytelling. It also leads to enhancing editing, perfecting grading, and generating realistic effects. The tech expansion empowers professionals to craft exceptional content, incorporating special effects, CGI, AI, SFX, and VR for immersive storytelling.

Furthermore, experiencing sports with AI integration and VR has completely transformed the perception of the game. Imagine putting on a VR headset and being instantly transported to a virtual stadium. You can choose your seat, hear the crowd, and even interact with other virtual spectators. Moreover, AI could analyse your viewing habits and preferences to provide real-time suggestions or highlights tailored to your interests. AI enhances the experience for fans by highlighting the key moments of their favourite player during the match. Through the application of advanced algorithms, the virtual environment can be crafted to suit individual preferences, pushing the experience to an entirely different echelon.

VnD:How does Videoverse utilize generative AI to automate and enhance video editing processes?

Ashwin Limaye- VideoVerse utilises Generative AI to revolutionise video production and editing, breaking down barriers to value creation while enhancing viewer engagement. Our transformative technology guides creators in crafting resonant content, seamlessly connecting content creation and consumption. Through automation, the algorithm enhances content personalisation, boosting its discoverability and interaction. Staying attuned to evolving consumption trends is crucial, and Generative AI leads this revolution.

Our enterprise solution empowers sports entities, including leagues, teams, broadcasters, and OTT platforms, to create engaging, real-time content accessible on all devices. Alongside this, we offer a post-production compositing engine for graphic design with GPT integrations. Content creation is strikingly accelerated by the platform's automation, saving time and resources which are directly proportional to fan engagement, popularity, and newer revenue streams. For example, their recent partnership with the Vietnam Basketball League resulted in a remarkable 773% surge in video production, leading to a 76% increase in overall viewership on Facebook.

With no-code and low-code toolsets enabled with Generative AI, Optikka, a recent partner acquisition by Magnifi, empowers content owners and broadcasters to craft visually stunning, brand-tailored content in real time. We now aim to enable clients to transform a plethora of assets into fully designed, consumer-ready highlights and narrative-based packages.