Objects / assets disappearing when out of frame (until I rescan the anchor)

Is this normal? If yes it feels pretty clunky to have the user keep their phone as static as possible to not lose the scene.

I want to make a 90-360 degree experience, so essentially slightly rotating to the left or right wipes the objects off the screen prompting the user to either be confused and exit, or to go and scan the scene again.