Renaming Catalogs

When I rename a catalog in Photoshop Elements, the software seems to create a new catalogue by adding a folder in the location where my catalogs are with the new catalog name and copying the relivant files.   I noticed that the folder with the old catalog name is not deleted and is seems like all of hte relivant files are still there.  I did not expect this, thining ti would just remane the catalog folder name.  Do I have this correctly.  Is there any harm done by deleteing the old catalog files and folder?

Thanks for the help.

Tom