Windows is notorious for having Bluetooth connection issues, but you can do something about them.
I have had so many weird problems with Win11 and Bluetooth... Unpair, reboot, repair. If that doesn't work, check Windows update / additional updates to see if there's a driver update. If that doesn't ...
A step-by-step guide to using the DualShock 4 on PC via Bluetooth.