“Digital Scent” & “Aerial Imaging” Tech: Reimagining the Future of HMI for Industrial Displays

For decades, the Human-Machine Interface (HMI) in industrial settings has been a conversation dominated by sight and touch. We’ve progressed from physical buttons and indicator lights to sophisticated, high-resolution touchscreens. But what if the next leap forward isn’t just about clearer images or faster touch response, but about engaging entirely new senses? The convergence of two nascent technologies—digital scent (olfactory technology) and aerial imaging—is poised to shatter our current understanding of HMI, creating a future where operators can not only see and touch but also smell and interact with data in mid-air. This evolution promises to transform complex industrial environments, making them more intuitive, safer, and efficient.

From Touchscreens to Multi-Sensory Experience: The Next HMI Frontier

The core function of an industrial HMI is to translate complex machine data into actionable human insight. While modern touch displays are incredibly effective, they still present limitations. Operators in harsh environments may need to wear gloves, hindering touch interaction. A cluttered screen filled with alarms can lead to cognitive overload. The next frontier of HMI design aims to alleviate these pressures by creating a multi-sensory experience. This is not science fiction; it is the logical evolution toward a more human-centric industrial digital twin. By adding new sensory channels, we can reduce cognitive load on the visual system and provide more intuitive, powerful cues for operators, a critical step explored in display requirements for the industrial metaverse.

Deconstructing the Future: How Do These Technologies Work?

To appreciate the transformative potential, it’s essential to understand the fundamental principles behind these groundbreaking technologies. Each addresses a different aspect of sensory interaction, moving beyond the flat plane of a traditional display.

The Science of Digital Scent (Olfactory Technology)

Digital scent technology, or digital olfaction, aims to digitize and recreate smells. The process mimics the human olfactory system. It works in two main phases: detection and synthesis. An “electronic nose” uses an array of chemical sensors to detect various airborne compounds, creating a unique digital signature for a specific odor. This signature is then analyzed by software, often leveraging AI and machine learning, which compares it against a database of known smells.

To reproduce the scent, a “scent synthesizer” or generator uses a cartridge system containing various primary aromatic compounds. Based on the digital signal, it precisely releases and mixes small amounts of these compounds to replicate the target smell. Early attempts like Smell-O-Vision in the 1950s were clumsy, but modern systems using piezoelectric transducers or microfluidics offer far more precise and localized scent delivery.

The Magic of Aerial Imaging (Mid-Air Displays)

Aerial imaging technology creates visuals that appear to float in mid-air, without the need for a physical screen. These are not true holograms but rather real, light-based images formed in space. Several methods exist to achieve this effect:

• Plate-Based Systems: Technologies like ASKA3D from Japan use highly specialized optical plates composed of thousands of microscopic mirrors or gratings. When light from a standard display (like a TFT-LCD) passes through this plate, the light rays are reflected and converged at a focal point in mid-air, forming a crisp, visible image.
• Laser-Induced Plasma: A more advanced method uses focused femtosecond lasers to ionize air molecules at specific points in space, causing them to emit light as plasma. By rapidly scanning the laser, a 3D image, or “fairy light,” can be drawn directly in the air. This technology allows for truly volumetric, see-through displays.

When combined with motion sensors (like infrared grids or cameras), these floating images become interactive, allowing users to “press” buttons or manipulate graphics in mid-air, creating a true contactless HMI.

A New Paradigm for Interaction: Industrial Display Integration

Separately, these technologies are impressive. Together, integrated with industrial control systems, they forge a powerful new HMI paradigm that fundamentally changes operator interaction.

Beyond the Glass: Synergies and Capabilities

Imagine a control room where a critical alert is not just a flashing red icon but is accompanied by the distinct, unmistakable smell of overheating electronics or a specific chemical leak. This olfactory cue would instantly cut through the visual noise, directing the operator’s attention to the problem’s nature and location before they even fully process the on-screen alarm. It leverages our innate, primal sense of smell for rapid threat identification.

Simultaneously, an aerial display could project a 3D schematic of the failing component directly in the operator’s line of sight, with interactive controls floating beside it. The operator, wearing gloves and without touching a surface, could manipulate the 3D model, call up maintenance procedures, or initiate a shutdown protocol. This synergy transforms the HMI from a passive information panel into an active, immersive partner in problem-solving.

Traditional HMI vs. Sensory HMI: A Comparative Outlook

Feature	Traditional HMI (Touchscreen)	Future Sensory HMI (Aerial + Olfactory)
Primary Interaction	Visual, Touch	Visual, Auditory, Olfactory, Gestural (Contactless)
Information Delivery	2D graphical data on a flat screen. Prone to information overload.	3D data visualization in physical space, supplemented by intuitive olfactory cues.
Operator Environment	Requires clean hands/stylus. Can be difficult with gloves. Surface requires cleaning.	Fully contactless. Ideal for sterile, hazardous, or heavy-duty environments.
Alarm/Alert Handling	Visual and auditory alarms compete for attention. Requires cognitive processing to interpret.	Scent-based alerts provide immediate, pre-cognitive identification of the problem type (e.g., electrical vs. chemical).
Ergonomics & Ergonomics	Fixed screen position can cause physical strain.	Interfaces can be projected at ergonomically optimal positions. Reduced physical contact.

Envisioning the Factory of the Future: Practical Application Scenarios

The abstract concepts of sensory HMI translate into tangible, high-impact applications on the factory floor.

Problem → Solution → Result: Process Control & Safety Alerts

• Problem: A chemical mixing tank is approaching a dangerous pressure level. A small valve has begun to leak a volatile substance. On a busy control panel, the flashing pressure gauge icon might be missed for a critical few moments.
• Solution: The HMI system detects the pressure anomaly and the chemical signature of the leak via integrated e-nose sensors. It immediately releases a faint but distinct “danger” scent associated with that chemical and projects a flashing 3D model of the tank with the leaking valve highlighted in mid-air next to the operator’s station.
• Result: The operator is alerted by the smell even before looking at the screens, instantly understanding the nature of the hazard. The aerial display provides immediate spatial context, allowing them to initiate emergency protocols without delay, preventing a potential system failure or safety incident.

Immersive Training and Remote Assistance

• Problem: A new technician needs to learn a complex, multi-step maintenance procedure on a critical piece of machinery. Traditional manual-based or screen-based training can be slow and lacks hands-on context.
• Solution: The technician wears AR glasses integrated with the HMI. An aerial display overlays instructions, diagrams, and tool selections directly onto the machine. When a specific lubricant is required, the system releases a faint scent of that lubricant, helping the technician identify the correct one from the supply cabinet. This creates a multi-sensory link that reinforces memory.
• Result: Training time is drastically reduced, and retention improves. The combination of visual, spatial, and olfactory cues creates a richer, more effective learning experience. It builds on similar principles to how haptic feedback enhances interaction.

Quality Control and Material Identification

• Problem: In food processing or pharmaceutical manufacturing, ensuring raw material consistency is paramount. Subtle variations in aroma can indicate spoilage or incorrect formulation, which may not be visually apparent.
• Solution: An electronic nose integrated into the HMI system continuously “smells” batches of incoming materials. It compares the digital scent signature to a “golden standard” profile stored in its database. Any deviation triggers an alert.
• Result: Quality control becomes automated and highly precise. Contaminated batches are flagged instantly, preventing them from entering the production line, saving significant costs and ensuring product safety.

The Engineer’s Roadmap: Challenges and Design Considerations

Despite the immense potential, deploying these technologies in rugged industrial environments presents significant engineering challenges that must be addressed.

• Scent Cartridge Logistics and Standardization: Scent generators require consumable cartridges. For industrial use, these must be long-lasting, easily replaceable, and standardized. A robust supply chain and maintenance protocol is non-negotiable.
• Environmental Factors and Contamination: Factories are often filled with ambient dust, chemicals, and varying airflow. Olfactory systems must be designed to avoid cross-contamination and function reliably in “noisy” scent environments. Similarly, aerial displays using plasma or precision optics like those from AUO‘s R&D labs need to be robust against dust and vibration.
• Optical Precision and Power Consumption: High-quality aerial displays require precise alignment and can be power-intensive, especially laser-based systems. Engineering them into compact, energy-efficient, and durable enclosures suitable for industrial settings is a major hurdle. The quality of the underlying display, especially its brightness and viewing angle, is critical for the final projected image.
• Software and Sensory Data Integration: The most significant challenge lies in the software. Creating a seamless control loop where sensor data (from an e-nose or PLC) correctly triggers a specific olfactory and visual response requires sophisticated integration with SCADA and MES systems. Developing an intuitive grammar for scent—what does “low pressure” smell like?—will require extensive human factors research.

Key Takeaways: Engineering a More Intuitive and Safer Industrial Future

The fusion of digital scent and aerial imaging represents a fundamental reimagining of the industrial HMI. This is not merely about adding features; it’s about creating a more symbiotic relationship between operator and machine. By expanding communication into new sensory realms, we can design systems that are not just more powerful, but more human.

Key points for engineers and technical decision-makers to consider:

1. Beyond Vision: The future of HMI is multi-sensory. Olfactory and contactless gestural interfaces will supplement and, in some cases, surpass traditional touchscreens in efficiency and safety.
2. Context is King: The power of these technologies lies in delivering the right sensory cue at the right time. Scent alerts for chemical processes and aerial displays for spatial tasks are prime examples of context-driven design.
3. Robustness is Non-Negotiable: For these innovations to move from concept to control room, they must meet the stringent reliability and durability standards of the industrial world.
4. Integration is the Final Frontier: The ultimate success will depend on seamless software integration that can translate machine states into a coherent and intuitive sensory experience.

While widespread adoption is still on the horizon, the technologies are maturing rapidly. Forward-thinking organizations who begin to explore and prototype these sensory HMI concepts today will be best positioned to lead the next wave of industrial automation and create safer, smarter, and more efficient factories of the future.