Colorize function misses parts of photo - how to fix?

When I use the colorize function in PSE it sometimes misses part of the photo. For example, this morning I colorized an old photo of a man sitting with his pants rolled up. The function colorized his face and hands but missed his legs which remained B&W. 

Is there a way to select the parts it missed and have them re-colorized? 

Thanks.