ESP32-S2-Drone_V1.2 won't fly without USB connection

[jmarple4]

I am trying to set up the ESP32-S2-Drone_V1.2 drone to fly.
It has an ESP32-S2-WROVER board on it.

I believe I have followed the guidelines on the ESP-Drone documentation website.
However, I can only throttle up the motors via the android app when the USB cable is plugged in along with the battery.

I have tried using different batteries; 3.7V 1800mAh and 250mAh. Both work when the USB cable is plugged in.
When I try and fly the drone using just the power from the battery, the drone boots up correctly but as soon as I throttle up the motors freeze almost instantly, after moving ever so slightly. The Red LED turns on solid and then the vehicle reboots.

I wasn't certain if espefuse.py set_flash_voltage 3.3V would solve the issue, but seeing as that would burn an efuse, I avoided trying.
I believe it is a software issue but I'm not sure what/how to fix it