Omnimizer greatly reduces the time and cost of deploying AI to the edge by adapting models to fit diverse hardware platforms
OmniML, a startup making artificial intelligence (AI) more accessible to all edge devices, today announced the release of Omnimizer™, a platform that simplifies and accelerates machine learning operations (MLOps) by bridging the gap between ML models and edge hardware.
AI is becoming ubiquitous, powering everything from self-driving cars to nearly every application on mobile devices. However, many ML models are not well-suited for edge devices because they were born in the cloud and do not fit those devices well. Such a mismatch greatly hinders the potential of AI and has been a universal barrier for companies at the frontier of the edge AI revolution.
Omnimizer solves this mismatch by auto-adapting and optimizing models for hardware, allowing ML engineers to focus on model design and training without worrying about the complex details of hardware deployment. It gives deployment engineers the confidence that the models will work properly on target devices without the need for redesign and iterations between multiple teams. As a result, Omnimizer eliminates the inefficiencies that lead to slow deployment, poor performance, and higher costs.
A maker of smart cameras, for example, used Omnimizer to significantly reduce the complexity of designing a model for its low-cost chips, reducing deployment time drastically while achieving superb inference performance on its edge devices.
“There is so much promise in using AI closer to where people live, but it is still too inefficient and costly to deliver these tremendous benefits for everyone,” said OmniML Co-Founder and CEO Di Wu, PhD. “Omnimizer solves this by unifying workstreams of ML development and deployment, enabling enterprises to adapt existing models for their hardware based on their specific business needs.”
The magic behind Omnimizer’s capability comes from the inventors of “deep compression” and its all-star founding team that pioneered industry-leading technologies in hardware-aware neural architecture search (NAS).
But this technical strength is just the beginning. In the year since the company’s inception, the OmniML team has been perfecting Omnimizer and serving industry-leading companies in electrical vehicles, autonomous driving, robotics, smart cameras, and many more. Many ML productivity features were added to empower users to profile, diagnose, optimize, and prototype ML models for edge hardware deployments effortlessly.
Supporting most machine learning capabilities for Computer Vision, Natural Language Processing, and many other domains, Omnimizer can intake open-source or a customer’s existing ML models with a few lines of code. It is powered by a cloud-native backend infrastructure that enables hassle-free model adaption and deployment for almost all major chip platforms including CPUs, GPUs, and AI SoCs.
“Our work with OmniML reflects our continued commitment to develop powerful, next-generation software, advanced machine learning and seamless AI solutions to further advance robotics through platforms such as the Qualcomm® Robotics RB5 Platform,” said Dev Singh, senior director of business development and head of autonomous robotics, drones & intelligent machines at Qualcomm Technologies, Inc.
Current Omnimizer customers are leveraging the platform to optimize ML models for autonomous vehicles, robotics, IoT, and mobile devices. OmniML is also working on proof-of-concept opportunities in industrial automation, smart appliances, and pharmaceuticals, among other industries, as part of its mission to bring the benefits of AI to everyone.
Visit AITechPark for cutting-edge Tech Trends around AI, ML, Cybersecurity, along with AITech News, and timely updates from industry professionals!
