I have 2 Apple TV at home, and the symmetrical design drives me crazy.

The way I did fix it is that I put some ugly tape on the bottom of the remote.

Pretty sure Steve or Jony would hate to see what I ave did to their beautiful remote :-), But at least now I know how I am holding it with looking at it.