Motion Vectors in AfterEffects

[CinnaCian]

Hi,

The plugin i am developing needs Motion vectors. Looking at the SDK documentation the only  reference I have found in the sdk docs for motion vectors are in relation to the PF_CHANNELSUITE1, PF_GetLayerChannelTypedRefAndDesc. Which I read to only be availiable if they were in the underlying "file type", not quite sure what that means but doesn't sound like something I can depend on. Does after effects provide access to motion vectors for the input layer of effects?

Thanks,

Cian.

[Mike_Basil]

Hi,

What exactly do you mean by motion vectors? Do you mean optical flow (http://en.wikipedia.org/wiki/Optical_flow)? Then you have to compute them yourself, e.g. using OpenCV.

greets

[CinnaCian]

Thank you for your response. I am not really interested in identifing objects or surfaces in frame.

I am refereing to  http://en.wikipedia.org/wiki/Motion_vector that would descibe a pixels or block of pixels movement from one frame to another. These might be used for creating motion compensated frames (http://en.wikipedia.org/wiki/Motion_compensation).  

So I am hearing this is a no?

Thanks,

Cian.

[Mike_Basil · Accepted solution]

I am not an expert in video compression, but it seems to be the field specific term for the same concept.

After Effects does not provide any image processing algorithms beyond standard pixel blending and colour conversion, so yes, you would need to obtain pixels of the layer, call a custom algorithm and then write it back to the output layer/world. Beware that after effects uses ARGB channel sequence in a pixel, which is different to what most other libraries use (e.g. BGRA or RGBA).

greets