"Unknown Exception" when using app.beginUndoGroup() on startup

With Ae 2023 (does not seem to happen on either 2022 or the latest beta) seems like scripts that run on startup and use:

app.beginUndoGroup(), app.endUndoGroup()

Result in After-Effects throwing an erorr:

It's pretty simple to reproduce:

1. Create a jsx file with the following contents:

app.beginUndoGroup("Undo Group Test");
app.endUndoGroup();

 2. Save it and place it in the "Startup" folder of After-Effects

3. Relaunch After-Effects 2023

This is also relevant to ScriptUI panels that are docked to the interface.

Let me know if you need any further information. It happens to my on my M1 MacBook Pro 14" but users reported the same on Windows 11.