I've had my PA arrange doctor's appointments, it's great. It's not a matter of working too much, it's that I only have so much mental energy to go around. Decisions can be draining. Dealing with people can be draining. These things aren't draining to the same extent for everyone.
These days with everybody understaffed, making a doctor's appointment can be very time-consuming, as well! You might on hold / re-routed and the whole call could take 15 or 20 minutes, which is a lot in the middle of the day.