How to completely delete files from Libraries on the computer?

A few days ago I posted this post asking for the location of the files when we add items to a Library:

https://community.adobe.com/t5/photoshop/library-assets-location/m-p/11379498?page=1#M357494

Initially it was not clear where and how, but today I found that in my case this is where they go:

~/Library/Application Support/Adobe/Creative Cloud Libraries/LIBS/"looooongNumber"_AdobeID/creative_cloud/dcx/"anotherLooooongNumber"/components

Here's the issue:

Even if I delete files from a library, it doesn't delete them from this folder, meaning I will have files taking up space. Not a big problem with vector, but for images and all that, imagine the amount of space this is taking...

I went to my Cloud and permanently deleted all the "deleted files", still no luck.

Any ideas if there's a way to refresh the library on the computer so it syncs properly and deletes all "orphan" files?

Thanks!