Library Panel becomes a static image that is skewable

When I first open Illustrator, my library works fine. After a certain amount of time, it becomes a static image where I can't click on anything and when I resize the panel, it just elongates or skews the panel like it is an image. This is not true of any other items in my tools. The only way to fix it is to fully quit Illustrator and reopen. It was just happening in Illustrator, but recently has started happening to my InDesign as well.
