Sure, I'd say it probably is.
Two reasons I don't think it is a big deal....
1. I am reasonably sure most politicians do a lot worse.
2. If I was him I'd do the same for my son under the same circumstances, and if it cost my political career, then so be it.
If he gets dinged for some kind of ethics violation, so be it. I'm just not gonna throw the first stone when I would have done the same though.