Hello, today I would like to show you how to capture 360 degree live video with an image classifier. It is useful in robotics platforms to detect objects in all directions.
Traditionally in robotics to achieve a 360 degree view we will use an Omnidirectional Lens
Previously, I used a cheap dollar store phone lens to create a wider image capture to perform AI image classification.
We can also use a much wider Fisheye lens to achieve spherical video capture. These are available cheaply on various online stores. Look around for them.
We can capture images that are much wider field of view
Traditionally in robotics to achieve a 360 degree view we will use an Omnidirectional Lens
Previously, I used a cheap dollar store phone lens to create a wider image capture to perform AI image classification.
We can also use a much wider Fisheye lens to achieve spherical video capture. These are available cheaply on various online stores. Look around for them.
We can capture images that are much wider field of view
Using stream_infer.py on the Movidius Neural Compute Stick we can improve on our object detection and image classification area coverage. Initially we just rely on fisheye video to show us objects, but this is not great as it does not provide general direction. Adding a digital compass to our raspberry pi will also provide direction to our objects
Allowing us to turn the robot to face the object or gesture in that direction.
Another approach is to dewarp the image. There are some resources on github to allow us to do this.
and also here
It is also possible to dewarp live video using the Movidius Neural Compute Stick in real time
Thanks for Reading.
No comments:
Post a Comment