This application is specifically designed for students and electronics engineers and hobbyist working with Arduino and Raspberry Pi micro controllers. It uses OpenCV libararies for computer vision detection and classification including Google Tensorflow Lite machine learning.
The application can detect and track various types of objects from your phones camera such as lines, colour blobs, circles, rectangles and people. Detected object types and screen positions can then be sent to a Bluetooth receiver device such as HC-05.
If using an appropriate micro-controller e.g. Arduino or Raspberry Pi users can analyse the detected objects for further robotics based projects. A typical example could be to attach a phone to a 2 or 4W robot kit which can then track/follow a ball or person.
Key Application Features:
1. Colour Blob Detect and Track
2. Circle Detect and Track
3. Line Detect
4. People Detect and Track Using Histogram of Gradients (HoG)
5. Detection of TensorFlow Lite Coco Label Objects (E.g. Persons, Cats, Cars, TV, etc)
6. Use custom Tensorflow models.
7. Send detected object parameters over Bluetooth.
Note that all image processing operations work best in good lighting conditions. If you are unable to detect objects please try changing some of the configuration settings. Also note that the tracking algorithms implemented are simplistic and hence will not work reliably when multiple objects overlap each other.
To use custom Tensorflow models, load a compatible mobilenet tfile model. An example for this is the pet_detect.tflite, and pet_labels.txt. However you need to rename these to custom.tflite and custom.txt and place them in your phones internal storage public document folder. Also please ensure you enable android app permission for storage access.
Bluetooth Data Transmit Formats:
All data communication is sent as ASCII text in the following format:
"Object Type":"ID":"XPos","YPos","Width","Height"
Example Colour Blob Object: "CO:0:-40,60,0,0"
Where ID is a number between 0 and 4 with no tracking, or any unique integer tracked ID number with tracking option.
The x and y positions relate to the centre of the colour blob with 0,0 being at the centre of the camera preview screen.
Example Circle Object No Tracking: "CC:0:-40,60,20,0"
Where x,y positions give centre of circle, and width gives radius of circle.
In tracking mode the x,y,w,h provide the inside rectangle of the circle.
Example Circle Object with Filter On Colour: "FC:0:-40,60,20,0"
Where x,y positions give centre of circle, and width gives radius of circle.
Example Line Object: "LO:0:-40,60,20,200"
Where x,y positions gives first line point, and w,h givds second line point.
Example People Object No Tracking: "PO:0:-40,60,20,0"
Where x,y positions gives top left of rectangle, and w, h gives width and height.
Example People Object with Filter On Colour: "FP:0:-40,60,20,0"
Where x,y positions gives top left of rectangle, and w, h gives width and height of rectangle.
All tracked objects: "TO:0:-40,60,20,40".
where x,y positions gives centre of rectangle, and w, h gives width and height from centre of rectangle. Note that if filtering on circle and people, tracked object ids will reset to zero for overlapped colour objects.
TensorFlow Objects: "ObjectTitle:0:-40,60,20,40"
Where ObjectTitle is any classified TensorFlow object e.g. "Person", "Cup", "Bottle" etc.. X,Y positions gives centre of rectangle, and w, h gives width and height from centre of rect. Note that if filtering on colour blob intersection ensure that colour blob tracking is enabled.
Format for Filter on TensorFlow: "FTF:Person:-40,60,20,40". Where "Person" can be any of the available detected TensorFlow object types defined within the coco_labels_list.txt (See Google TensorFlowLite).
Full online help at Git Hub:/
https://github.com/GemcodeStudios/ObjectDetectionTracking
Copyright Gemcode Studios 2019
Recent changes:
Version 2 Release Notes:
1. Automatic save on all user settings including colour blob selection.
2. Automatic Bluetooth re-connection.
3. Select custom Tensorflow tflite models.
4. Removed rectangle detection.
Any issues related to storage permissions please ensure this is enabled in app permission settings in Android.
Tensorflow models should be renamed as "custom.tfilte" and "custom.txt" and placed in internal storage document folder.
Show more
Show less
