wiki:object_detector_app
Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
|
wiki:object_detector_app [2022/10/07 11:17] vizycam |
wiki:object_detector_app [2022/10/13 15:18] vizycam [Overview] |
||
|---|---|---|---|
| Line 3: | Line 3: | ||
| ===== Overview ===== | ===== Overview ===== | ||
| - | The Object Detector detects 80 different common objects: bicycles, cars, motorcycles, airplanes, buses, traisn, trucks, boats, traffic lights, fire hydrants, stop signs, parking meters, benches, birds, cats, dogs, horses, sheep, cattle, elephants, bears, zebras, giraffes, backpacks, umbrellas, handbags, ties, suitcases, frisbees, skis, snowboards, sports balls, kites, baseball bats, baseball gloves, skateboards, surfboards, tennis rackets, bottles, wine glasses, cups, forks, knives, spoons, bowls, bananas, apples, sandwiches, oranges, broccoli, carrots, hot dogs, pizza, donuts, cake, chairs, couches, potted plants, beds, dining tables, toilets, tv's, laptops, computer mice, remotes, keyboards, cell phones, microwaves, ovens, toasters, sinks, refrigerators, books, clocks, vases, scissors, teddy bears, hair driers, and toothbrushes. | + | The Object Detector detects 80 different common objects: bicycles, cars, motorcycles, airplanes, buses, trains, trucks, boats, traffic lights, fire hydrants, stop signs, parking meters, benches, birds, cats, dogs, horses, sheep, cattle, elephants, bears, zebras, giraffes, backpacks, umbrellas, handbags, ties, suitcases, frisbees, skis, snowboards, sports balls, kites, baseball bats, baseball gloves, skateboards, surfboards, tennis rackets, bottles, wine glasses, cups, forks, knives, spoons, bowls, bananas, apples, sandwiches, oranges, broccoli, carrots, hot dogs, pizza, donuts, cake, chairs, couches, potted plants, beds, dining tables, toilets, tv's, laptops, computer mice, remotes, keyboards, cell phones, microwaves, ovens, toasters, sinks, refrigerators, books, clocks, vases, scissors, teddy bears, hair driers, and toothbrushes. |
| It uses the recent [[https://ai.googleblog.com/2020/04/efficientdet-towards-scalable-and.html|EfficientDet]] convolutional neural network (CNN) detector implemented in the TensorFlow Lite framework. | It uses the recent [[https://ai.googleblog.com/2020/04/efficientdet-towards-scalable-and.html|EfficientDet]] convolutional neural network (CNN) detector implemented in the TensorFlow Lite framework. | ||
| Line 20: | Line 20: | ||
| {{wiki:image_1211.jpg?600}} | {{wiki:image_1211.jpg?600}} | ||
| - | To test, you can present various objects such as a bottle, cup, scissors, and yourself (person). Bear in mind that some objects (such as forks and spoons) rely to some degree on contextual cues (such as tables and plates). You can adjust the detection sensitivity (see section on [[#Controls and Settings|Controls and Settings]] depending on how many false negative detections (increase sensitivity) or false positive detections (decrease sensitivity). | + | To test, you can present various objects such as a bottle, cup, scissors, and yourself (person). Bear in mind that some objects (such as forks and spoons) rely to some degree on contextual cues (such as tables and plates). You can adjust the detection sensitivity (see section on [[#Controls and Settings|Controls and Settings]]), depending on how many false negative detections (increase sensitivity) or false positive detections (decrease sensitivity). |
| {{wiki:image_1209.jpg?600}} | {{wiki:image_1209.jpg?600}} | ||
| Line 45: | Line 45: | ||
| * **Detection sensitivity**: Increasing the sensitivity will result in more detections, but possibly more false positive detections. Decreasing the sensitivity will result in fewer detections, but possibly more false negative detections. | * **Detection sensitivity**: Increasing the sensitivity will result in more detections, but possibly more false positive detections. Decreasing the sensitivity will result in fewer detections, but possibly more false negative detections. | ||
| * **Enabled classes**: Check the checkbox of object classes that you're interested in and clear the checkbox of the classes that you're not interested in. The enabled classes will be logged in the media queue. | * **Enabled classes**: Check the checkbox of object classes that you're interested in and clear the checkbox of the classes that you're not interested in. The enabled classes will be logged in the media queue. | ||
| - | * **Trigger classes**: Check the checkbox of object classes that you want to trigger events and clear the checkbox of the classes that you don't want to trigger events. See the section on [[#Texting|Texting]]. | + | * **Trigger classes**: Check the checkbox of object classes that you want to trigger events -- in particular, texting a picture of the detected object -- and clear the checkbox of the classes that you don't want to trigger events. See the section on [[#Texting|Texting]]. |
| * **Upload to Google Photos**: Check this if you want the media items in the media queue to be uploaded to Google Photos. Google services need to be configured, however. See the section on [[#Configuring Google services|Configuring Google services]]. | * **Upload to Google Photos**: Check this if you want the media items in the media queue to be uploaded to Google Photos. Google services need to be configured, however. See the section on [[#Configuring Google services|Configuring Google services]]. | ||
| Line 62: | Line 62: | ||
| Or you can ask it to show you pictures of the most recent detections (see [[#Text commands|Text commands]] below). One of the advantages of texting is that you can interact with your Vizy from practically anywhere as long as your Vizy has a network connection. It's also quick! | Or you can ask it to show you pictures of the most recent detections (see [[#Text commands|Text commands]] below). One of the advantages of texting is that you can interact with your Vizy from practically anywhere as long as your Vizy has a network connection. It's also quick! | ||
| - | |||
| - | === Configuring texting === | ||
| - | |||
| - | You will need to [[wiki:texting|set up texting]] to take advantage of this feature. Don't worry though -- it's easy, and it's totally free. 8-) | ||
| === Text commands === | === Text commands === | ||
| Line 96: | Line 92: | ||
| In particular, the **event_type** value specifies the type of the event. The different types are listed below: | In particular, the **event_type** value specifies the type of the event. The different types are listed below: | ||
| - | * **trigger**: This event indicates that a trigger class object has been identified. The **image** and **timestamp** are included. The default implementation of ''handle_event'' sends a text message with the object class, timestamp and image. | + | * **trigger**: This event indicates that a trigger class object has been identified. The **image** and **timestamp** are included. The default implementation of ''handle_event'' sends a text message with the object class, **timestamp** and **image**. |
| - | * **register**: This event indicates when a bird or non-bird has entered the scene. The birds and non-birds are listed in the **dets** field. | + | * **register**: This event indicates when an object has entered the scene. The objects are listed in the **dets** field. |
| - | * **deregister**: This event indicates when a bird or non-bird has left the scene. The birds and non-birds are listed in the **dets** field. | + | * **deregister**: This event indicates when an object has left the scene. The objects are listed in the **dets** field. |
| - | * **daytime**: This event indicates when it has entered the "daytime" state and has enough light to reliably identify species. | + | * **daytime**: This event indicates when it has entered the "daytime" state and has enough light to reliably identify objects. |
| * **nighttime**: This event indicates when it has entered the "nighttime" state and is inactive. | * **nighttime**: This event indicates when it has entered the "nighttime" state and is inactive. | ||
wiki/object_detector_app.txt · Last modified: 2023/05/09 16:27 by vizycam
Page Tools
Except where otherwise noted, content on this wiki is licensed under the following license: CC Attribution-Share Alike 4.0 International
