A bit of feedback in case someone has the same question. The swap went fine but I had an interesting challenge with my usb connection. The 32D seems to drain slightly less power at start. I suspect it peaks when powerung up the wifi. The 32 pushed my design over the edge causing dropput of my CH340 ...

Thank you for your answer!

Due to component shortage, I am considering replacing my WROOM-32D With a WROOM-32, i.e. an older version of the WROOM module.

Is this possible without hardware changes or Arduino SW changes?

Thanks
/Jonas