Color management Issues

Okay so I have multiple different file formats in my sequence (rec.709 and 2100 HLG) so when I change the work space for one of them so that the particular clip's color space is matching source file, it ends up changing all of the clips in the sequence to the same settings. This is frusturating as I need some of those clips to stay with different color space. Please Help. Then of course when I export it some of the clips are over exposed. Is there some setting I am missing to turn off this feature that changes every clip in the sequence to the same color space?