Scroll to top button glitching

I'm really hoping someone can help me as this is driving me mad.

I'm currently doing a protoype in xd for learning modules. I have added a scroll to top on the first module and i can scroll down and click on the button, it jumps to the top and everything works perfectly.

I have another module which I assumed I did exactly the same way but, when I click on the 'back to top' button, it jumps to the top as it should.... However, once I then try to scroll down with my mouse after it has jumped to the top, my scroll triggers the page to jump to the bottom again rather than scrolling down as it should.

It's really frustrating, I can't seem to find anyone with a similar issue.

I would really appreciate the help.

Thanks