Indeed that is the case. You cannot format the glossary. And it is also correct that if you do want a formatted glossary as well as an ability to have links and images, you would need to create a topic that would serve as the Glossary. And it's also true that you would not be able to place that topic in the Glossary panel. But you could have a toolbar button that would open the topic into the topic pane.