Hide User Action on Form Advanced Data Grid but not Report

Is there a way to hide a user action on an advanced data grid with in a form, but still have it visible on a report within a page? I have an entity configuration with three user actions - two of them should be available when right clicking on an advanced data grid within a form. The other should only be visible when right clicking on a report within a page. I have figured out how to limit the action visibility on the page report, but do not see this same option for advanced data grid. I have also tested user action visibility rules, but do not see an option that would work for my needs.

Any help with this would be greatly appreciated! Thank you!