Today at AWS re:Invent, Amazon Web Services, Inc. (AWS), an Amazon.com company (NASDAQ: AMZN), announced Amazon Monitron, Amazon Lookout for Equipment, the AWS Panorama Appliance, the AWS Panorama SDK, and Amazon Lookout for Vision. Together, these five new machine learning services help industrial and manufacturing customers embed intelligence in their production processes in order to improve operational efficiency, quality control, security, and workplace safety. The services combine sophisticated machine learning, sensor analysis, and computer vision capabilities to address common technical challenges faced by industrial customers, and represent the most comprehensive suite of cloud-to-edge industrial machine learning services available. This is why more than a hundred thousand customers are using AWS for machine learning, and why customers of all sizes and across all industries are using AWS services to make machine learning core to their business strategy. To learn more about AWS’s new industrial machine learning services, visit https://aws.amazon.com/industrial/.
Companies are increasingly looking to add machine learning capabilities to industrial environments, such as manufacturing facilities, fulfillment centers, and food processing plants. For these customers, data has become the connective tissue that holds their complex industrial systems together. Industrial systems typically have numerous interdependent processes that operate with small tolerances for error, and even minor issues can have major ramifications. Being able to analyze data about the equipment operating in their facilities helps customers address this challenge, and many customers have embraced services like AWS IoT SiteWise as a way to collect data and generate real-time performance metrics from their industrial equipment. As customers have begun to use the cloud to collect and analyze industrial data, they have also asked for new ways to incorporate machine learning to help make sense of the data and further drive operational efficiency. In some cases, customers want to use machine learning to help them realize the promise of predictive maintenance to reduce costs and improve operational efficiency. In other cases, customers running in disconnected or latency-sensitive environments want to use computer vision at the edge to spot product defects and improve workplace safety. With these evolving needs and opportunities, industrial companies have asked AWS to help them leverage the cloud, the industrial edge, and machine learning together to get even more value from the vast amounts of data being generated by their equipment.
Amazon Monitron and Amazon Lookout for Equipment enable predictive maintenance powered by machine learning
A major challenge facing industrial and manufacturing companies today is the ongoing maintenance of their equipment. Historically, most equipment maintenance is either reactive (after a machine breaks) or preventive (performed at regular intervals to ensure a machine doesn’t break). Reactive maintenance can result in significant costs and downtime, while preventive maintenance can be costly, result in over-maintenance, or fail to prevent breakdown if not performed often enough. Predictive maintenance (the ability to foresee when equipment is likely to need maintenance) is a more promising solution. However, in order to make it work, companies have historically needed skilled technicians and data scientists to piece together a complex solution from scratch. This included identifying and procuring the right type of sensors for the use case and connecting them together with an IoT gateway (a device that aggregates and transmits data). Companies then had to test the monitoring system and transfer the data to on-premises infrastructure or the cloud for processing. Only then could the data scientists on staff build machine learning models to analyze the data for patterns and anomalies, or create an alerting system when an outlier was detected. Some companies have invested heavily in installing sensors across their equipment and the necessary infrastructure for data connectivity, storage, analytics, and alerting. But even these companies typically use rudimentary data analytics and simple modeling approaches that are expensive and often ineffective at detecting abnormal conditions compared to advanced machine learning models. Most companies lack the expertise and staff to build and refine the machine learning models that would enable highly accurate predictive maintenance. As a result, few companies have been able to successfully implement predictive maintenance, and those that have done it are looking for ways to further leverage their investment, while also easing the burden of maintaining their homegrown solutions. Here’s how the new AWS machine learning services can help:
- For customers who do not have an existing sensor network, Amazon Monitron offers an end-to-end machine monitoring system comprised of sensors, a gateway, and a machine learning service to detect anomalies and predict when industrial equipment will require maintenance. Amazon Monitron enables customers to remove cost and complexity from building a sophisticated, machine learning-driven predictive maintenance system from scratch, and it also allows them to focus on their core manufacturing, supply chain, and operations functions. Amazon Monitron detects when machines are not operating normally based on abnormal fluctuations in vibration or temperature, and notifies customers when to examine machinery in order to determine if preventative maintenance is needed. The end-to-end system includes IoT sensors to capture vibration and temperature data, a gateway to aggregate and transfer data to AWS, and a machine learning cloud service that can detect abnormal equipment patterns and deliver results in minutes with no machine learning or cloud experience required. With Amazon Monitron, maintenance technicians can start tracking machine health in a matter of hours, without any development work or specialized training. Amazon Monitron can be used on a variety of rotating equipment, such as bearings, motors, pumps, and conveyer belts in industrial and manufacturing settings. Use cases range from monitoring a few critical machines like the cooling fans or water pumps used in data centers, to large scale installations in manufacturing facilities with production and conveyance systems. Amazon Monitron also includes a mobile app for a customer’s onsite maintenance technicians to monitor equipment behavior in real time. With the mobile app, a technician can receive alerts of any abnormal equipment conditions across different machines, check up on the health of the machine, and decide if they need to schedule maintenance. To increase the accuracy of the system, technicians can enter feedback on the accuracy of the alerts in the mobile app, and Amazon Monitron learns from that feedback to continually improve over time. Amazon Monitron is now generally available. To learn more about Amazon Monitron, visit https://aws.amazon.com/monitron.
- For customers that have existing sensors but don’t want to build machine learning models, Amazon Lookout for Equipment provides a way to send their sensor data to AWS to build models for them and return predictions to detect abnormal equipment behavior. To get started, customers upload their sensor data to Amazon Simple Storage Service (S3) and provide the S3 location to Amazon Lookout for Equipment. Amazon Lookout for Equipment can also pull data from AWS IoT SiteWise, and works seamlessly with other popular machine operations systems like OSIsoft. Amazon Lookout for Equipment analyzes the data, assesses normal or healthy patterns, and then uses the learnings from all of the data on which it is trained to build a model that is customized for the customer’s environment. Amazon Lookout for Equipment can then use the machine learning model to analyze incoming sensor data and identify early warning signs for machine failure. This allows customers to do predictive maintenance, saving them money and improving productivity by preventing the crash of an industrial system line. Amazon Lookout for Equipment allows customers to get more value from their existing sensors, and it helps customers make timely decisions that can materially improve the entire industrial process. To learn more about Amazon Lookout for Equipment, visit https://aws.amazon.com/lookout-for-equipment.
AWS Panorama uses computer vision to improve industrial operations and workplace safety
Many industrial and manufacturing customers want to be able to use computer vision on live video feeds of their facility and equipment to automate monitoring or visual inspection tasks and to make decisions in real time. For example, customers routinely need to inspect high-speed processes to determine if adjustments are needed (e.g. fine milling or laser tooling), to monitor site and yard activity to ensure operating compliance (e.g. ensure pedestrians and forklifts remain in designated work zones), or to assess worker safety within their facilities (e.g. appropriate social distancing or use of PPE). However, the typical monitoring methods used today are manual, error prone, and difficult to scale. Customers could build computer vision models in the cloud to monitor and analyze their live video feeds, but industrial processes typically need to be physically located in remote and isolated places, where connectivity can be slow, expensive, or completely non-existent. This problem is even more difficult for industrial processes that involve manual review like quality checks on manufactured parts or security feeds. For example, if a quality issue emerges on a high throughput production line, customers want to know immediately because the costs of letting the problem persist is steep. This type of video feed could be automatically processed in the cloud using computer vision, but video feeds are high bandwidth and can be slow to upload. As a result, customers are required to monitor video feeds in real time, which is hard to do, error prone, and expensive. While there is a desire to use smart cameras that have enough processing power to run these models, getting low latency performance with good accuracy from these cameras can be challenging. Most customers end up running unsophisticated models that can’t be programmed to run custom code that integrates into the industrial machines. Here’s how AWS can now help:
- The AWS Panorama Appliance provides a new hardware appliance that allows organizations to add computer vision to existing on-premises cameras that customers may already have deployed. Customers start by connecting the AWS Panorama Appliance to their network, and the device automatically identifies camera streams and starts interacting with the existing industrial cameras. The AWS Panorama Appliance is integrated with AWS machine learning services and IoT services that can be used to build custom machine learning models or ingest video for more refined analysis. The AWS Panorama Appliance extends AWS machine learning to the edge to help customers make predictions locally in sites without connectivity. Each AWS Panorama Appliance can run computer vision models on multiple camera streams in parallel, making possible use cases like quality control, part identification, and workplace safety. The AWS Panorama Appliance works with AWS and third party pre-trained computer vision models for retail, manufacturing, construction, and other industries. Also, customer-developed computer vision models developed in Amazon SageMaker can be deployed on the AWS Panorama Appliance.
- The AWS Panorama Software Development Kit (SDK) enables hardware vendors to build new cameras that can run meaningful computer vision models at the edge. Cameras that are built with the AWS Panorama SDK run computer vision models for use cases like detecting damaged parts on a fast-moving conveyor belt or spotting when machinery is outside of a designated work zone. These cameras can use chips designed for computer vision from NVIDIA and Ambarella. By using the AWS Panorama SDK, manufacturers can build cameras with computer vision models that can process higher quality video with better resolution for spotting issues. They can also build more sophisticated models on low-cost devices that can be powered over Ethernet and placed around a site. Customers can train their own models in Amazon SageMaker and deploy them on cameras built with the AWS Panorama SDK with a single click. Customers can also add Lambda functions to cameras built with the AWS Panorama SDK to be alerted to potential issues via text or email. AWS also offers pre-built models for tasks like PPE detection and social distancing, and can deploy these models in minutes without doing any machine learning work or special optimizations.
To learn more about AWS Panorama, as well as supporting vendors and partners, visit https://aws.amazon.com/panorama.
Amazon Lookout for Vision offers automated fast and accurate visual anomaly detection for images and video at a low cost
One use case where AWS customers are excited to deploy computer vision with their cameras is for quality control. Industrial companies must maintain constant diligence to maintain quality control. In the manufacturing industry alone, production line shutdowns due to overlooked errors result in millions of dollars of cost overruns and lost revenue every year. The visual inspection of industrial processes typically requires human inspection, which can be tedious and inconsistent. Computer vision brings the speed and accuracy needed to identify defects consistently, but implementation can be complex and require teams of data scientists to build, deploy, and manage the machine learning models. Because of these barriers, machine learning-powered visual anomaly systems remain out of reach for the vast majority of companies. Here’s how AWS can now help these companies:
- Amazon Lookout for Vision offers customers a high accuracy, low-cost anomaly detection solution that uses machine learning to process thousands of images an hour to spot defects and anomalies. Customers send camera images to Amazon Lookout for Vision in batch or in real-time to identify anomalies, such as a crack in a machine part, a dent in a panel, an irregular shape, or an incorrect color on a product. Amazon Lookout for Vision then reports the images that differ from the baseline so that appropriate action can be taken. Amazon Lookout for Vision is sophisticated enough to handle variances in camera angle, pose, and lighting arising from changes in work environments. As a result, customers can accurately and consistently assess machine parts or manufactured products by providing as few as 30 images of the baseline “good” state. Amazon Lookout for Vision also runs on Amazon Panorama appliances. Customers can run Amazon Lookout for Vision in AWS starting today, and beginning next year, customers will be able to run Amazon Lookout for Vision on AWS Panorama Appliances and other AWS Panorama devices so customers will be able to use Amazon Lookout for Vision in locations where Internet connectivity is limited or non-existent. To learn more about Amazon Lookout for Vision, visit https://aws.amazon.com/lookout-for-vision.
“Industrial and manufacturing customers are constantly under pressure from their shareholders, customers, governments, and competitors to reduce costs, improve quality, and maintain compliance. These organizations would like to use the cloud and machine learning to help them automate processes and augment human capabilities across their operations, but building these systems can be error prone, complex, time consuming, and expensive,” said Swami Sivasubramanian, Vice President of Amazon Machine Learning for AWS. “We’re excited to bring customers five new machine learning services purpose-built for industrial use that are easy to install, deploy, and get up and running quickly and that connect the cloud to the edge to help deliver the smart factories of the future for our industrial customers.”
Fender Musical Instruments Corporation is an iconic brand and the world’s foremost manufacturer of guitars, basses, amplifiers, and related equipment. “Over the past year we worked with AWS to help develop the critical but sometimes overlooked part of running a successful manufacturing business, knowing your equipment condition. For manufacturers worldwide, maintaining equipment uptime is the only way to remain competitive in a global market. Unplanned downtime is costly both in loss of production and labor due to the fire-fighting nature of breakdowns,” said Bill Holmes, Global Director of Facilities at Fender. “Amazon Monitron can give both large industry manufacturers as well as small ‘mom and pop shops’ the ability to predict equipment failures, giving us the opportunity to preemptively schedule equipment repairs.”
RS Components is a leading player in the industrial components and predictive maintenance space. “We are constantly trying to innovate how we serve the maintenance needs of our customers. With the emergence of IoT, we have seen our customers looking to bring real-time condition monitoring capabilities into the factory environment to reduce reactive maintenance and improve asset reliability,” said Richard Jeffers, Technical Director at RS Components. “We are excited to be working with AWS to bring Amazon Monitron to our customers because it allows them to deploy a cost effective, easy to use, continuously improving condition monitoring solution and enable predictive maintenance across a broader set of equipment in their asset base. Although we stock over 500,000 products from 2,500 different suppliers, this is the first end-to-end wireless vibration and temperature condition monitoring solution in our portfolio. We plan to make Amazon Monitron available to our customers via our e-commerce platform, and leverage it to deliver condition-based monitoring and reliability services through RS Monition, our data led, reliability services business. Working with AWS will enable us to support our customers’ efforts to adopt IoT and machine learning as emerging technologies and accelerate their Industry 4.0 strategies.”
GS EPS is a South Korean Industrial Conglomerate. “We have been generating data across our assets for over a decade now but have only been using physics and rules based methods to gain insights into our data,” said Kang Bum Lee, Executive Vice President of GS EPS. “Amazon Lookout for Equipment is enabling our plant operation teams to build models on our equipment with no ML expertise required. We are leading the transformation of our organization into a data-driven work culture with AWS and Amazon Lookout for Equipment.”
Doosan Infracore is a leading global manufacturer of heavy duty equipment and engines. “Leveraging AI is critical in advancing Doosan’s next generation equipment, so we are working with AWS to develop use cases where automated and scalable machine learning could be leveraged,” said Mr. Jae Yeon Cho, Vice President of Doosan Infracore. “Based on this, we are excited to continue to work with AWS to leverage Amazon Lookout for Equipment in our next generation IoT platform.”
OSIsoft is a manufacturer of application software for real-time data management, called the PI System. “Today, there are more than 2 billion sensor-based data streams inside OSIsoft PI Systems, and thousands of customers relying on the PI System daily to run their operations. These customers are constantly looking for methods to easily serve up insights for improving their competitiveness. OSIsoft products can be integrated with AWS services to help customers unlock additional value from their data. Amazon Lookout for Equipment expands the scope of services and insights available to customers by delivering automated machine learning built specifically for equipment monitoring,” said Michael Graves, Director of Strategic Alliances at OSIsoft.
“Every month, millions of trucks enter Amazon facilities so creating technology that automates trailer loading, unloading, and parking is incredibly important,” said Steve Armato, VP Middle Mile Production Technology at Amazon.com. “Amazon’s Middle Mile Products & Technology (MMPT) has begun using AWS Panorama to recognize license plates on these vehicles and automatically expedite entry and exit for drivers. This enables safe and fast visits to Amazon sites, ensuring faster package delivery for our customers.”
BP is a global energy company, providing customers with fuel for transport, energy for heat and light, lubricants to keep engines moving, and the petrochemicals products used to make everyday items as diverse as paints, clothes, and packaging. The organization has 18,000 service stations and more than 74,000 employees worldwide. “Our engineering teams here at bpx are working very closely with AWS to build an IoT and cloud platform that will enable us to continuously improve the efficiency of our operations,” said Grant Matthews, Chief Technology Officer at BP America. “One of the areas we have explored as part of this effort is the use of computer vision to help us further improve security and worker safety. We want to leverage computer vision to automate the entry and exit of trucks to our facility and verify that they have fulfilled the correct order. Additionally, we see possibilities for computer vision to keep our workers safe in a number of ways, from monitoring social distancing, to setting up dynamic exclusion zones, and detecting oil leaks. AWS Panorama offers an innovative approach to delivering all of these solutions on a single hardware platform with an intuitive user experience. Our teams are excited to work with AWS on this new technology and expect it to help us address many new use cases.”
Siemens Mobility offers intelligent and efficient mobility solutions for urban, interurban, and freight transportation.“Siemens Mobility has been a leader for seamless, sustainable, and secure transport solutions for more than 160 years. The Siemens ITS Digital Lab is the innovation team in charge of bringing the latest digital advances to the traffic industry and uniquely positioned to provide data analytics and AI solutions to public agencies,” said Laura Sanchez, Innovation Manager, Siemens Mobility ITS Digital Lab. “As cities face new challenges, municipalities have turned to us to innovate on their behalf. Cities would like to understand how to effectively manage their assets and improve congestion and direct traffic. We want to use AWS Panorama to bring computer vision to existing security cameras to monitor traffic and intelligently allocate curbside space, help cities optimize parking and traffic, and improve quality of life for their constituents.”
ADLINK Technology offers hardware/software platforms enabling customers to implement edge AI solutions for real-time delivery of actionable data in industrial markets such as manufacturing, transportation, healthcare, energy, and communications. “The integration of AWS Panorama on ADLINK’s industrial vision systems makes for truly plug-and-play computer vision at the edge,” said Elizabeth Campbell, CEO at ADLINK USA. “In 2021, we will be making AWS Panorama-certified ADLINK NEON cameras powered by NVIDIA Jetson AGX Xavier available to customers to drive high-quality computer vision powered outcomes much, much faster. This allows ADLINK to deliver ML digital experiments and time to value for our customers more rapidly across logistics, manufacturing, energy, and utilities use cases.”
INDUS.AI is the world’s most advanced construction intelligence solution that enables real estate investors, owners, developers, and general contractors to have real-time visibility and actionable insights into all activities, productivity, and risks at their construction sites. INDUS.AI seeks to make construction sites and projects safer, more efficient, and completely transparent. “Construction zones are dynamic environments. At any given time you’ve got hundreds of deliveries and subcontractors sharing the site with heavy equipment and it’s changing every day. INDUS.AI is focused on delivering construction intelligence for general contractors,” said Matt Man, CEO of INDUS.AI. “Computer vision is an especially valuable tool for this because of its ability to handle multiple tasks at once. We are looking forward to delivering real-time insights on job-site management and safety in a SaaS-like experience for AWS Panorama customers.”
Dafgards is a household name in Sweden, manufacturing a broad assortment of foods. One of their most successful brands is Billys Pan Pizza, a microwaveable pizza baked and packed at a speed of 2 pizzas per second. “To uphold our brand and deliver the freshest and tastiest customer experience, we want to ensure that all our pizzas are adequately covered in cheese and with the correct toppings. Previously, we installed a machine vision system to detect proper coverage of cheese across a pizza’s surface. While this system served well for our original inspection requirement, it was unable to detect defects on new product types that include multiple toppings,” said Fredrik Dafgård, Head of Operational Excellence and Industrial IoT at Dafgards. “Amazon Lookout for Vision automates and scales inspection of diverse product types such as a cheese pizza with vegetables. We successfully expanded our quality assurance for new product types with minimal impact to operations.”
GE Healthcare is a leading global medical technology and digital solutions innovator that develops, manufactures, and distributes diagnostic imaging agents, radiopharmaceuticals, medical diagnostic equipment, including CT and MRI machines, and intelligent devices supported by its Edison intelligence platform. “Today, we use human inspection to verify the quality of our medical equipment. To uphold our brand and deliver best-in-class products trusted by healthcare professionals, we’re excited about the possibility of using Amazon Lookout for Vision to programmatically improve the speed, consistency, and accuracy of detecting product defects across our factories in Japan and potentially in other plants globally in the near future,” said Kozaburo Fujimoto, Operating Officer, General Manager, Manufacturing Division, Plant Manager at GE Healthcare Japan.
Nukon, a SAGE Group company, is a digital transformation consultancy and delivery company that delivers custom-designed solutions which combine strategy, analysis, and technology to give visibility into key business processes so they can be optimized. “We are excited about how Amazon Lookout for Vision will help us detect product defects in real-time within the manufacturing facility for our sister company, SAGE Automation, in line with their stringent quality control program. We are excited to now apply this technology to other manufacturers and integrate it into their quality systems,” said Rafael Amaral, Chief Technology Officer at Nukon.
