I would personally let him pass. With that being said, my opinion should have nothing to do with the decision you might find yourself making if he happens to present a shot. I've shot several buck like that when I was younger and was tickled, but like others have said, I was in a much different time in my hunting career and like to give those young ones the chance to grow now. He could be a nice 10 point next year and then possibly a 140+ class P&Y in 2 years.
I would definitely pass him if it were me. That's said, it's not. It's you. Ultimately you are the final say on what you choose to do like others have said. If that deer will make you happy, then it is by all means a shooter regardless of potential, score age etc. the bottom line is that you shouldn't need someone else to tell you what you should or shouldn't shoot. Don't listen to the guys who shove what they would shoot down your throat. Their opinion becomes irrelevant once they pass it is a hunting law for all. For my first buck with a bow I would have shot him in a heartbeat. I just feel that I'm at the point where I'm willing to let younger ones go in order to possibly see them reach their full potential. What ever you decide to do I wish you the best of luck.