Ubuntu 24.04LTS Hotspot/AP not working, unable to set Wireless channel

So i have been runing ubuntu 23.10. And i had this setuped. ( https://www.raspberrypi.com/documentation/computers/configuration.html#use-your-raspberry-pi-as-a-network-bridge ) now i have switched to m.2 hat and reinstalled the os fresh with 24.04LTS. But now when i follow this guide. The bridge says:

connecting (getting IP configuration)

and when looking into journalctl is see:

Jun 08 21:07:57 ubuntu kernel: brcmfmac: brcmf_set_channel: set chanspec 0xd022 fail, reason -52
Jun 08 21:07:57 ubuntu kernel: brcmfmac: brcmf_set_channel: set chanspec 0xd026 fail, reason -52
Jun 08 21:07:57 ubuntu kernel: brcmfmac: brcmf_set_channel: set chanspec 0xd02a fail, reason -52
Jun 08 21:07:57 ubuntu kernel: brcmfmac: brcmf_set_channel: set chanspec 0xd02e fail, reason -52
Jun 08 21:07:59 ubuntu kernel: brcmfmac: brcmf_set_channel: set chanspec 0xd090 fail, reason -52
Jun 08 21:07:59 ubuntu kernel: brcmfmac: brcmf_set_channel: set chanspec 0xd095 fail, reason -52
Jun 08 21:07:59 ubuntu kernel: brcmfmac: brcmf_set_channel: set chanspec 0xd099 fail, reason -52
Jun 08 21:07:59 ubuntu kernel: brcmfmac: brcmf_set_channel: set chanspec 0xd09d fail, reason -52
Jun 08 21:07:59 ubuntu kernel: brcmfmac: brcmf_set_channel: set chanspec 0xd0a1 fail, reason -52
Jun 08 21:07:59 ubuntu kernel: brcmfmac: brcmf_set_channel: set chanspec 0xd0a5 fail, reason -52

which i think might be related. Full log: https://pastebin.com/GrV29ZR4