I do that, and I put my keys on top of it to indicate that I don't plan to pick it up or answer it.

Funny, I didn't realize until just know that I was doing this.

I make a small show of putting it on silent mode.

upside down is a good idea but you need to have the discipline of not looking at every beep or noise.