@Richu-Bini I'm not sure if this is the root cause but normally, you should add an RC delay on the EN pin. This is because the BOOT pin should reach 3.3V before the EN reaches 3.3V hence, the RC delay on the EN pin. A 10K resistor and a 1μF Cap should do it. Here's a sketch on how it should look like:
Here is the part in the datasheet of the WROOM32 that tells you to do it:
