I think the issue is that you have selected the label to be part of the component. I have created a file based on my comprehension of what you are trying to do. Can you have a look and let me know? I have shared my XD file with you over a private message. Have a look and let me know if that helps.
Thanks a lot for your sample. The only thing is that the color of the label is changing. When no option are selected it's grey and when on of the two buttons is activated it's changing to a color to highlight the label.