Everyone needs a vacation, including the President.
I had to cut vacations short twice due to crises of various sorts. It sucked, but it goes with the territory.
I didn't like when the left criticized Bush after being led by the noses by Michael Moore, stating repeatedly that there is no such thing as a vacation for a President. It doesn't happen.
That said, I think the optics would have been better for Obama if he cut this one short and returned home to the WH. I remember people melting down like the Wicked Witch because Bush didn't jump up in the room of kids on 9/11, screaming and running to do something. Those minutes he sat in the chair caused more meltdowns than you can imagine. If Bush was supposed to react in a nanosecond, the same standard should be applied to Obama. At the same time, the people who obsess about Obama's golfing need to generally speaking cut him some slack. If the world is in relative calm, there is nothing wrong with him swinging some clubs. If the world is in chaos, as is the case today, he would be wise to get his priorities in line.