Mouse dragging is extremely lagging in my After Effects extension

I was trying to integrate node editing functionality with reactflow in my extension.
But the mouse dragging is extremely lagging barely useable. I tried to find the cause with performance to in the devtools. But the weird thing is after click the recording button the dragging become smooth! When I stop recording the dragging become lagging again. (see attached video) I tried setting z-index and transform to translateZ(0) and also will-change: transform but no luck.
It seems that AE imposed some limitation on extensions.
Is there any workaround?