The Substance Blender addon stops working after making adjustments

I really like the new updates made to the Blender addon, but when I change the properties in the Substance panel after having applied it to an object, it stops updating all of a sudden. When I delete the material and try to import/create it again, I get the "could not connect to the Substance 3D remote engine" error. 

It only works after closing and reopening Blender again. Have anyone tried something similar?

I'm using a MacBook Pro 16" from 2019, running Blender 3.1and version 0.18.5 of the addon.