prevent use of creative cloud apps after deactivation

I have tested pushing the package onto one of our Macs using ARD.  The install worked, but now I have deactivated the device license.  I noticed that the applications will still launch and load on the test machine.  Does this ability remain until the apps 'check in'?

Thanks