How to create a custom object detection classifier

riccardo.brue
Posts: 10
Joined: Fri Jun 21, 2019 1:49 pm

How to create a custom object detection classifier

Postby riccardo.brue » Thu Oct 24, 2019 11:48 am

Hi, I need to detect objects from the captured frames of the esp-eye. In order to do that, I have trained a tensorflow model following this tutorial https://tensorflow-object-detection-api ... ining.html and as I can see here viewtopic.php?p=47138#p47138 it has been explained that there is a way to convert a tensorflow model to be read by the esp-who library (dl_lib.h). But I cannot understand how to do such conversion from a tensorflow model (.pb file). Can please anyone guide me through this operation with some more detailed advices? Thank you in advance.

caleb221
Posts: 8
Joined: Sun Jul 28, 2019 12:38 pm
Contact:

Re: How to create a custom object detection classifier

Postby caleb221 » Tue Nov 05, 2019 8:34 am

hey,
so i'm still a bit lost on this as well (im very new to deep learning)
from my understanding you need to train the model using whatever you like (tensorflow, pytorch, whatever..)
to get your inference graph...once you have that its

when you build the model in C for the ESP you can use a lot of functions in the ESP-WHO liibrary
mainly:
image_util.h
fb_gfx.h
fd_forward.h
fr_forward.h
mtmn.h
dl_lib.h
dl_lib_matrix3dq.h
they help get your data into the right format and perform operations you need
(look at the header files for names/explanations of the functions available)
finally, once all thats done youll want to make your inference
I'm sorry i dont have code yet, i'm still working it all out myself

caleb221
Posts: 8
Joined: Sun Jul 28, 2019 12:38 pm
Contact:

Re: How to create a custom object detection classifier

Postby caleb221 » Thu Jan 09, 2020 8:31 am

Hey, as an update I think i've figured out how to get custom object detection working
( the code has a few bugs that I'm working out, but the model does run)
code is found here:
https://github.com/caleb221/ESP32-Leaf

Who is online

Users browsing this forum: No registered users and 4 guests