AI Denoise creates swirl artifacts (Astrophotography)

I've noticed this in a bunch of nightsky images, AI denoise sometimes creates swirly artefacts in the dark regions between stars or in low texture regions. 

These swirls are not real and would not appear in longer exposure tracked images. They seem like overenhanced noise patterns which the AI denoiser should ignore. 
TopazAI for example doesn't create these artefacts. 

This happens both with traditional Bayer filter cameras, as well as Fuji X-trans images. 

Lightroom 13.4, Camera Raw 16.4
Windows 10

Example:

(AI denoise is applied with 60% opacity)

The forum doesn't allow me to attach the raw file (it's too big), but it can can be sourced from here (use the Request RAW button under Download Options):
https://eol.jsc.nasa.gov/SearchPhotos/photo.pl?mission=ISS071&roll=E&frame=257753