right to left visual and logical

It turns out that this is an old bug. I never new (I only use logical cursor movement) but when I searced to find an answer to your question, I found this post by Zaid Al Hilali. One thing you can do is to vote on that bug to increase its visibility to the developers; hopefully the InDesign development team will address it in a future release. 

This one feels like a clunky solution, but you could also make a keyboard shortcut set that you only turned on when you were working inright-to-left languages, where you swapped the keyboard shortcuts for moving or selecting text with the control and/or shift keys:

Similarly, I'm able to imagine a solution for you where you used a script or a third-party application to swap directions of your keyboard input. For instance, if I were in your shoes I might try to write an AutoHotkey script that sent a Ctrl + Left Arrow when you input a Ctrl + Right Arrow on your keyboard, and vice versa, only when the InDesign window was active. However, you'd still have to suspend that script when attempting to use the keyboard to navigate text in a left-to-right script.