Set the mask in AE and use AEGP_GetLayerNumMasks to query the number of masks. The return value is 0

[elegant_videographer1766]

Hello All

I have a question when using c++ to develop AE export plug-in,Set the mask in AE and use AEGP_GetLayerNumMasks to query the number of masks,The return value is 0,The specific code is as follows：

AE Version: 2025

System version: M3 Pro,macOS 15.3

  A_long numMasks = 0;
  RECORD_ERROR(suites.MaskSuite6()->AEGP_GetLayerNumMasks(layerHandle, &numMasks));
  for (int i = 0; i < numMasks; i++) {
    AEGP_MaskRefH maskHandle;
    RECORD_ERROR(suites.MaskSuite6()->AEGP_GetLayerMaskByIndex(layerHandle, i, &maskHandle));
    auto mask = ExportMask(context, maskHandle);
    masks.push_back(mask);
    RECORD_ERROR(suites.MaskSuite6()->AEGP_DisposeMask(maskHandle));
  }

Has anyone encountered similar problems?

[shachar carmi]

the code looks ok. is the layer handle valid? does AEGP_GetLayerMaskByIndex return some error?

[elegant_videographer1766]

hi,The layer can be exported normally, indicating that the layhandle is valid.

Because the return value of AEGP_GetLayerNumMasks is 0, the code will not be executed to the line where AEGP_GetLayerMaskByIndex is located.

If I do not check the number of masks and directly call AEGP_GetLayerMaskByIndex to get the mask with index 0, AE will report the following error

The above error message indicates that the current layer does not have an exportable mask.

But the mask has indeed been set in AEtThe following is the corresponding project file

 Please help answer this question, thanks!

[shachar carmi]

i don't know what the RECORD_ERROR macro is, but it it's similar to ERR then it won't execute the enclosed command if the value of err is not 0. so, what is the value of err before hitting AEGP_GetLayerNumMasks? what's the value of err after?

[elegant_videographer1766]

hi,After executing the following code, the values ​​of err1 and err2 are 0 and 3 respectively.

  A_Err err1 = suites.MaskSuite6()->AEGP_GetLayerNumMasks(layerHandle, &numMasks);
  AEGP_MaskRefH maskHandle2;
  A_Err err2 = suites.MaskSuite6()->AEGP_GetLayerMaskByIndex(layerHandle, 0, &maskHandle2);

// err1:0,err2:3

[shachar carmi]

intersting...

are you absolutely sure your're cheking the correct layer? can you check that on a project with just one layer?

[elegant_videographer1766]

Hi,track masking requires two layers (the mask layer and the masked layer).Cannot set mask if there is only one layer

[elegant_videographer1766]

Also, I can confirm that the layers I checked are correct. Because there are only two layers in total, calling AEGP_GetLayerNumMasks and AEGP_GetLayerMaskByIndex on these two layers will return the same value--err1:0,err2:3

 Is there a better debugging method for this problem?

[shachar carmi · Accepted solution]

hold on... a track ammte and a mask are two different things...

1. track matte - one layer operating with the alpha/luma of the layer above it.

2. mask - a vector shape drawn on a layer with the pen tool.

if your situation is the same as #1, then the mask suite is the wrong way to go as there are no masks on that layer, and then getting 0 as the num_masks actually makes sense...

[elegant_videographer1766]

Yes,My situation is the same as #1.

Which API should be used to export the track mask? Is there any sample code that I can refer to?