or you can use bonding/pairing without passkey and during pairing add device to whitelisted, finally you can allow to connect only whitelisted devices. For example you will need just one gpio/button, when its high on esp32 startup then you will allow to connect and pair new device and when its low ...

Hi,

you found a solution for this?
I'm working on a simmilar project like this.