IMO Looking only at the size of the tree tells me nothing about a deer's size. Years ago I watched a spike horn rub a highline power pole (at least 24" dia). Now if there are other trees the antlers touch say 12-14" behind or next to the rub...that will tell you something about tine length and width. Also max height off the ground does tell some too.
Some rubs are "community rubs" that get visited by several deer. Some get made and never revisited. If you see that it is active and continues to be visited, put a camera on it.
Dont judge a deers size by its rub, the smallest bucks can still rub a big tree. Same as a big buck can still rub small trees. Setup a stealth cam!