Bluetooth Serial Connection not stable when connected to Windows

[QuiteFrankly]

We are using an ESP32 Wrover module, and the Arduino Bluetooth Serial libraries.
When connecting the ESP32 to the computer, it only sometimes works. The device will always pair, but the Bluetooth serial ports that connect do not always work. Sometimes, these Bluetooth serial com ports don't even display.

We use a very simple Bluetooth setup:

#include "BluetoothSerial.h"
BluetoothSerial SerialBT;

void setup() {
Serial.begin(115200);
SerialBT.begin("ESP32test");
}
...
The rest of the code sends some data periodically over the Bluetooth Serial.

As seen in the attached picture, the com ports are visible. However when trying to connect using PuTTY, it displays "Unable to open connection to COM26, Unable to open serial port".
The same thing happens to COM41.

This happens about 30% of the time, and is very frustrating to try to reconnect it.

If anyone can provide some insight into why this is happening, and how to fix it, it would be very much appreciated.