Adobe's AI Integration in Premiere Pro
In a groundbreaking move, Adobe has announced that it is integrating AI video tools from OpenAI and other third-party companies like Runway into its popular video editing software, Premiere Pro. This integration will bring the powerful AI capabilities of tools like OpenAI's SORA directly into the hands of video editors, opening up limitless possibilities in video production.
The integration of these AI tools into Premiere Pro is a significant step for Adobe, a well-known multinational company that specializes in content software. This move is seen as a response to the growing concerns from Wall Street about how AI could pose a threat to Adobe's editing software. By embracing AI, Adobe is positioning itself to stay ahead of the curve and overcome these challenges.
With the integration of these third-party AI tools, Premiere Pro will gain the ability to add AI-generated objects to scenes or remove virtually any object from the video automatically, without the need for extensive input from video editors. Additionally, options will be available to extend clip lengths using generative AI from companies like Runway, as well as to create entirely new AI-generated clips with OpenAI's SORA.
Deepa Sumanium, the Vice President of Product Marketing for Creative Professional Apps at Adobe, has shared more details about the company's plans. She mentioned that Adobe is still deciding how the profits from these third-party AI tools used on its platform will be divided between Adobe and the developers of these tools. Sumanium also emphasized that users will be informed when they are not using commercially safe AI models, and it will be clear which AI technology was used in the videos created with Premiere Pro.
Adobe's commitment to ethical AI use and addressing human bias in their AI work is a testament to the company's dedication to staying relevant and responsible in the rapidly evolving AI and tech industry.
Reka's Powerful New Multimodal Language Model
Amidst the exciting news from Adobe, another AI startup, Reka, has launched a groundbreaking new multimodal language model called Reka Core. This model, developed by researchers from DeepMind, Google, and Meta, is designed to compete with major AI models like GPT-4 and Claude 3.
Reka Core is described as the company's largest and most capable model to date. It is designed to process multiple types of data, including images, audio, and video, allowing it to perform a variety of tasks such as translating scenes from movies like Netflix's "Three Body Problem" from video to text.
Despite being developed in under a year, Reka Core matches or even surpasses some of the top AI models created by well-funded companies like OpenAI and Google. The model's Chief Scientist, Ey, highlighted the team's efforts and achievements in reaching high-performance levels quickly.
Reka Core's large scale and broad capabilities are made possible by its training on thousands of H100 GPUs and its large context window of 128,000 tokens. This allows the model to handle a vast amount of information at once, making it particularly effective for tasks involving large documents.
According to tests, Reka Core has outperformed other leading models in various benchmarks and continues to improve. The model is also priced competitively, with costs for processing input and output data set at $10-$25 per million tokens, respectively. This pricing strategy is part of Reka's effort to introduce the model into various sectors, such as e-commerce, gaming, healthcare, and robotics.
Despite the progress and the push towards innovation, Reka has decided not to open-source its technology, a decision made by the company's co-founder and CEO, Danny Yogatama. This decision is part of Reka's strategy to find the right balance between sharing and protecting their developments to sustain business growth.
Grok 1.5 Vision: xAI's Latest AI Advancement
In addition to the news from Adobe and Reka, Elon Musk's company, xAI, has recently introduced a new version of their Grok 1.5 model, called Grok 1.5 Vision. This updated version can now understand and interact with images, allowing it to analyze pictures and answer questions about them.
This upgrade makes Grok 1.5 Vision similar to other recent AI developments like OpenAI's GPT-4 with vision and Google's Gemini 1.5 Pro, both of which also have vision capabilities. The announcement of Grok 1.5 Vision was made on xAI's official X account, where they shared a blog post detailing the new features.
According to the tests conducted by xAI, Grok 1.5 Vision performed exceptionally well on their own real-world QA Benchmark, which checks how well the model understands space and objects as we do in the real world. While it didn't do as well in some other tests, the addition of computer vision capabilities is a significant step forward for the Grok model.
Computer vision is a field in computer science that helps computers recognize and understand real-world objects in images and videos, aiming to give machines a visual understanding similar to humans. This technology is gaining a lot of attention and investment from major tech companies due to its wide range of potential uses, from nutrition tracking to medical diagnosis and self-driving cars.
Instagram's Creator AI: Automating Influencer Interactions
In another AI-driven development, Instagram is working on a new feature called Creator AI, which would allow popular influencers to use a chatbot to respond to direct messages and possibly comments on the platform. This project is still in the testing phase, but the goal is to help influencers with many followers manage the huge number of messages and comments they receive, making it easier for them to keep up without having to respond to each one personally.
Eva Chen, who heads Instagram's Fashion Partnerships, has been promoting this new feature to content creators, and Instagram has also been discussing it with agencies. However, it's not certain when or if this feature will be widely available.
Influencers would be able to choose what data Instagram uses to train the chatbot, such as their past posts or messages, to ensure the responses sound like them. They can even program specific answers to certain questions. This feature builds on earlier attempts by Meta, the company that owns Instagram, to use AI avatars that look like celebrities to talk to fans.
While some influencers are excited about the prospect of automating their interactions with fans, others are concerned that it might make them say things they don't agree with, and some doubt that a chatbot can truly capture the real interactions they have with their followers. Despite these concerns, companies like School of Bots are already helping influencers automate their messages.
Meta, the parent company of Instagram, is pushing artificial intelligence across its business, using it to improve ads, help with smart glasses, and more. Mark Zuckerberg, the head of Meta, believes that AI will be a big deal for people and businesses everywhere, and the company plans to showcase some of its new AI ideas at an event in New York in May, where they have invited some influencers to come and see what's new.
Conclusion
The recent developments in the world of AI and technology are truly remarkable. From Adobe's integration of AI tools into Premiere Pro to Reka's launch of its powerful new multimodal language model and xAI's advancements with Grok 1.5 Vision, the industry is undergoing a transformative shift. These innovations promise to revolutionize the way we create, consume, and interact with content, opening up new possibilities and challenging the status quo.
As these technologies continue to evolve and become more accessible, it will be fascinating to see how they impact various industries, from video editing and content creation to healthcare, robotics, and beyond. The future of AI-powered tools and applications is indeed exciting, and it will be crucial for companies and individuals to navigate this landscape responsibly and ethically, ensuring that the benefits of these advancements are shared equitably.
Whether you're a video editor, an AI enthusiast, or simply someone who appreciates the rapid progress of technology, these developments are sure to have a lasting impact on the way we live and work. As we move forward, it will be essential to stay informed, embrace the opportunities presented by these innovations, and continue to push the boundaries of what's possible.
.jpg)
0 Comments