Is there a way to fix this issue with a highlight?

I’ve recently discovered the “Highlight” which is a great easy way to add a cell shade to an object. However, if I add this to a tool, the highlight spreads to the player as well. I’ve looked through the properties and found nothing to prevent this.
Without tool
Screenshot_20230203_063309
With tool
Screenshot_20230203_063321

Set the adornee to the mesh in the tool

Just tried that, it still has the outline on the player. I guess I could manually create the cel shading but I was hoping to avoid it