That's basically the way it is around here. Fence lines are 9 out of 10 times the property line that have been used for years and most when surveyed aren't the actually line. But nothing is ever said and most the time everyone agrees to just leave it where it is. But we have good neighbors that you've known your whole life and not much ground changes hands so most the time nothing ever comes up.