Unauthorized OAuth when getting Assets from within AEM Runtime Action

I am using a runtime action to do some post processing and integrations with other systems after an Asset in AEM is published. I need to be able to do a get request based on the path from the parameters passed into the Runtime action. When using a local JWT token (or setting up JWT) I can pull down the data on the assets. 

The issue I run into is that when using OAuth, I can get a Bearer Token but using that Bearer Token results in a 401 unauthorized error when getting the asset. I have tried reading through a lot of the docs for the various APIs I can configure from the project to add to the OAuth Scope but keep running into the same unauthorized error. I have looked through the docs on https://experienceleague.adobe.com/en/docs/experience-manager-65/content/assets/extending/mac-api-assets on CRUD API  calls for assets but OAuth scope is never mentioned for being able to access these endpoints. 

What am I missing in being able to access the assets from within a Runtime Action?