Creative Clouds Library files Under Files tab not showing anywhere

I am not sure if the correct way I use the Library. The library concept is beneficial yet confusing to me.

When I have created Illustrator files and saved them in the Library (without creating a new library), it is stored under the Files tab on the CC library. When I try to access these files from the Library within any software such as After Effects or Premiere, they are not showing up. However, other files stored under libraries I have created are showing up.

So here I am, baffled and needing help understanding how the Library works. I would be grateful if anyone could explain me in-depth or provide a link to a video demonstrating how to utilize the Library fully.