Twitter icon
Facebook icon
LinkedIn icon
Google icon
Reddit icon
StumbleUpon icon
Del.icio.us icon

ShAIdes 2.0

Added to IoTplaybook or last updated on: 10/01/2020
ShAIdes 2.0

Story

UpgrAIde your ShAIdes!

ShAIdes 2.0 is a much smaller, more practical, redesign of the original ShAIdes. Effect change in your surroundings by wearing these AI-enabled glasses. ShAIdes is a transparent UI for the real world.

My AI is still so bright, I gotta wear shades.

Things used in this project

Hardware components

 
NVIDIA Jetson Xavier NX
 
× 1  
 
ESP32-CAM
 
× 1

Bill of Materials

  • 1 x NVIDIA Jetson Xavier NX
  • 1 x ESP32-CAM
  • 1 x USB Battery Bank (500mAh or greater recommended)
  • Miscellaneous wires
  • Glasses/sunglasses

Program files on GitHub

How It Works

ShAIdes was initially designed as an all-in-one device; a camera attached to the glasses was hardwired to an NVIDIA Jetson Nano that the user hung around their neck in a small box. ShAIdes 2.0 greatly reduces the size and power requirements of the device by mounting a tiny ESP32-CAM to a pair of glasses.

The Jetson Nano has been replaced by a Jetson Xavier NX, and rather than carrying it around, it has been repurposed as an edge AI device. The ESP32-CAM remotely communicates with the NX over WiFi. As such, the Jetson can now be located anywhere in the same building (or further, depending on network configuration) as the device, and no longer needs to draw on the device battery power.

The reason for upgrading the Jetson to an NX is to minimize inference latency. Some small amount of latency is added by switching from a hardwired camera to a WiFi-enabled camera, so the additional horsepower of the NX gets that time back on the processing side and keeps the response time very low.

The fundamentals of the project (model creation, training, and inference) are the same as the original ShAIdes and can be referenced for anyone needing further details.

Media

YouTube demonstration:ShAIdes 2.0 video

The ShAIdes:

The brains of the operation, an NVIDIA Jetson Xavier NX:

About the Author

Nick A. Bild, MS

Credits

Nick Bild Nick Bild

 16 projects • 34 followers

R&D, creativity, and building the next big thing you never knew you wanted are my specialties.

 

Hackster.io

This content is provided by our content partner Hackster.io, an Avnet developer community for learning, programming, and building hardware. Visit them online for more great content like this.

This article was originally published at Hackster.io. It was added to IoTplaybook or last modified on 10/01/2020.