Yes, this is the way the Overlay feature works currently. You cannot apply it below the scroll. Use this link Overlays below the viewport height in scrollable artboards – Adobe XD Feedback : Feature Requests & ... to vote for this feature as also provide suggestions.
if i may, that is a bug, not a feature.
just like adding an element below viewport hight would be unconcievable.