Friday 4 January 2019

360 degree Video with Image Classification

Hello, today I would like to show you how to capture 360 degree live video with an image classifier. It is useful in robotics platforms to detect objects in all directions.






Traditionally in robotics to achieve a 360 degree view we will use an Omnidirectional Lens



Previously, I used a cheap dollar store phone lens to create a wider image capture to perform AI image classification.

We can also use a much wider Fisheye lens to achieve spherical video capture. These are available cheaply on various online stores. Look around for them.

We can capture images that are much wider field of view


Using stream_infer.py on the Movidius Neural Compute Stick we can improve on our object detection and image classification area coverage. Initially we just rely on fisheye video to show us objects, but this is not great as it does not provide general direction. Adding a digital compass to our raspberry pi will also provide direction to our objects
Allowing us to turn the robot to face the object or gesture in that direction.

Another approach is to dewarp the image. There are some resources on github to allow us to do this.


It is also possible to dewarp live video using the Movidius Neural Compute Stick in real time

Thanks for Reading.


No comments: