When I hit play, it starts playing after two seconds or so when I use the Studio Display XDR speakers

When I hit play, it starts playing after 2 seconds or so when I use the Studio Display XDR speakers. If I change the speakers to MacBook Pro speakers or my audio interface, the latency goes away.