Hailo
Unleash real-time AI processing at the edge with Hailo.. [Contact for Pricing]
Last verified:
What is Hailo?
Hailo is an edge AI chip company that designs and manufactures high-performance AI processors for deep learning applications on edge devices. Their processors enable real-time AI inference with low power consumption and high cost-efficiency, supporting neural networks, vision transformer models, and large language models (LLMs) directly on edge devices without cloud connectivity.
The company offers a comprehensive product lineup including the Hailo-15 AI Vision Processor (20 TOPS) for smart cameras, the Hailo-10H AI Accelerator (40 TOPS INT4) for generative AI at the edge, the Hailo-8 AI Accelerator (26 TOPS), and the entry-level Hailo-8L (13 TOPS). They also provide various form factors including M.2 modules, Mini PCIe modules, and PCIe cards like the Hailo-8 Century (up to 208 TOPS).
Hailo's AI Software Suite includes a dataflow compiler that integrates with common ML frameworks, HailoRT runtime software with intuitive APIs, Model Zoo Vision for computer vision pre-trained models, and Model Zoo GenAI for generative models including LLMs, VLMs, ASR, and Stable Diffusion. The software is compatible with x86 and ARM host processors and available as open-source via GitHub.
Hailo is designed for developers, enterprises, and manufacturers building AI-powered edge devices across industries including automotive (ADAS/AD), robotics and drones, security and physical security, retail (smart retail), industrial automation, intelligent transportation systems, and personal computing. The processors power real-world products like Husqvarna Automower robots, ASUS UGen300 USB AI Accelerator, and Vicon NEXT Modular Camera System.
Hailo pricing
Pricing model: Freemium
Hailo does not offer a free tier or SaaS subscription model. Pricing is hardware-based with modules sold through distributors. Hailo-8L M.2 module (13 TOPS) costs approximately €115, Hailo-8 M.2 module (26 TOPS) costs approximately €195, Hailo-8 M.2 Starter Kit costs €279, Hailo-8R Mini PCIe module (13 TOPS) costs €175, Hailo-8 Century PCIe Starter Kit (104 TOPS) costs €739, and Hailo-15H AI Vision Processor SBC Kit (20 TOPS) costs €475. Raspberry Pi AI Kit with Hailo-8L costs €77.95, and Raspberry Pi AI HAT+ 2 with Hailo-10H costs €142.90. The AI Software Suite is free with hardware purchase but requires customer registration for software downloads.
Hailo pros
- 26 TOPS performance in Hailo-8 surpasses many GPUs for machine learning
- 40 TOPS INT4 performance on Hailo-10H for generative AI at edge
- Up to 208 TOPS with Hailo-8 Century PCIe card for high-performance needs
- Extremely power-efficient architecture with low power consumption under 3W
- penny-sized form factor for compact edge device integration
- Supports wide range of neural networks including vision transformers and LLMs
- Enables offline AI without cloud connectivity for privacy and latency benefits
- Comprehensive AI Software Suite with dataflow compiler and runtime
- Seamless integration with common ML frameworks like PyTorch and TensorFlow
- HailoRT is open-source lightweight production-grade runtime with intuitive APIs
- Model Zoo Vision provides pre-trained models for rapid prototyping
- Model Zoo GenAI includes precompiled LLMs, VLMs, ASR, Stable Diffusion
- Compatible with OpenAI and Ollama REST APIs for GenAI workflows
- Multiple form factors: M.2, Mini PCIe, PCIe, and SoC options
- Industry-leading AI performance per watt and per dollar
- Reference applications and GStreamer pipelines for faster development
- Supports both x86 and ARM host processors
- Designed specifically for generative AI on the edge era
- 20 TOPS on Hailo-15 with minimal DRAM requirements as low as 1GB
- Low latency inference for real-time deep learning applications
Hailo cons
- No free tier available - requires hardware purchase for use
- Software downloads require customer registration and approval
- Model training still requires cloud, only inference runs on edge
- Limited to edge inference not cloud-scale AI workloads
- Hardware must be purchased separately (€77-€739 for modules)
- Entry-level Hailo-8L limited to 13 TOPS performance
- Some modules frequently sold out indicating supply constraints
- Primarily optimized for vision tasks not general-purpose computing
- Requires specific hardware integration expertise for deployment
- Docker-based software suite adds complexity to installation
Frequently asked questions about Hailo
What is Hailo AI?
Hailo is an edge AI chip company offering breakthrough AI processors uniquely designed to enable high-performance deep learning applications on edge devices. Their processors support real-time deep learning inference with low power consumption and high cost-efficiency, enabling generative AI, perception, and video enhancement on edge devices without cloud connectivity.
What products does Hailo offer?
Hailo offers the Hailo-15 AI Vision Processor (20 TOPS) for smart cameras, Hailo-10H AI Accelerator (40 TOPS INT4) for generative AI, Hailo-8 AI Accelerator (26 TOPS), Hailo-8L Entry-Level Accelerator (13 TOPS), plus M.2 modules, Mini PCIe modules, and the Hailo-8 Century PCIe card (up to 208 TOPS).
What is the Hailo AI Software Suite?
The Hailo AI Software Suite is a comprehensive software package that enables compilation of deep learning models and implementation of AI applications in production. It includes a dataflow compiler integrating with ML frameworks, HailoRT runtime with intuitive APIs, Model Zoo Vision, and Model Zoo GenAI for pre-trained models.
What is HailoRT?
HailoRT is a production-grade, lightweight, scalable runtime software providing a robust library with intuitive APIs in C/C++ for optimized performance. It is available as open-source software via Hailo's GitHub and runs on host processors (x86, ARM) when utilizing Hailo AI accelerators.
What industries does Hailo target?
Hailo targets automotive (ADAS & AD), robotics and drones, security and physical security, intelligent transportation (perimeter protection, access control), industrial automation (automatic optical inspection), retail (smart retail), healthcare, HVAC, and personal compute markets.
Can Hailo run LLMs on the edge?
Yes, the Hailo-10H AI Accelerator is the industry's first edge AI accelerator to bring immersive generative AI capabilities directly to edge devices. It supports LLMs via the Model Zoo GenAI, with demos showing ChatGPT-style offline AI chat using Ollama interface fully compatible with OpenAI REST APIs.
What is the Hailo Model Zoo?
Hailo offers two Model Zoo repositories: Model Zoo Vision provides pre-trained deep learning models for computer vision tasks enabling rapid prototyping, while Model Zoo GenAI features precompiled generative models including LLMs, VLMs, ASR, and Stable Diffusion accessible via CLI and REST API.
Does Hailo require cloud connectivity?
No, Hailo processors enable AI inference entirely on the edge without internet connection. While model training remains in the cloud, inference is performed locally with exceptional efficiency, enabling offline AI applications like the Husqvarna Automower and ASUS UGen300 USB AI Accelerator.
What form factors are available?
Hailo offers multiple form factors including M.2 modules (M Key 2280, B+M Key 2280, A+E Key 2230), Mini PCIe (mPCIe) modules, PCIe cards (Hailo-8 Century), SoC for cameras (Hailo-15), and reference sensor modules. These integrate with Raspberry Pi, PCs, edge devices, and smart cameras.
How do I get Hailo software?
Software downloads are available from the Developer Zone software downloads section of the Hailo website, but access requires registration as a Hailo customer. The AI Software Suite is distributed as Docker containers, and HailoRT is available as open-source via Hailo's GitHub page.