There is no way to reliably do this. You can work around it by getting the template asset ID and adding one until you get to a shirt with the same owner. This is very inefficient and unreliable, but unfortunately there is no better way to do this. I recommend using a different system.
Note that there was a feature request posted in 2017 similar to this.