One way to say this is "present company excluded" as when saying: culpability is general in the population, but not to accuse those you're speaking to.

Like "us but not you"? That's mean.

Yeah it iw called the exclusive form lol.

But if you think about it seems normal... "we went to the city" is not really mean.

We already use this with "we", it's just not clear from the word if 'you' are included or not. Example: "We had eggs for breakfast".

Not when you’re delivering an insult to everyone present.

Us lot?