How do i remove some noise from the image without smoothing out the edges?

Duplicate layer or convert it to Smart object layer before using any filter then mask areas which should ramain sharp using layer or filter mask. It is easier in your case to fill mask with black then to paint white where smoothing is required.

Smart Blur and Surface Blur offer some edge detection (protection), however, at higher values you may still wish to use layer masks or selections to control and isolate where the filtering is applied.