I really can't picture Obama or Trump swinging a golf club, and I seriously doubt Trump has the attention span for 18 holes.
Trump goes there because he wants to and doesn't give a eff what people think. Bush went to the Crawford Ranch until the left harassed him into submission. Obama is an idiot and nobody gives a crap what he does or did in his spare time, of which there was seemingly an endless amount.