I don't believe there is a way of doing this, but I'm going to confirm. In the meantime, a workaround could be used. If you use a global variable that signifies, "I care about this event", you could check that value in the callback and return early if the value is false. Let me know if that doesn't make sense.
I confirmed with engineering that there is not a way to do this. If folks need an example of the workaround I mentioned above, just ask. I also added an enhancement request specifically for this support. (That's not a promise it will be added, but I shared this forum post in the request.)