I'll agree that "looter" could be understood to be a scavenger and not an inherently anti-social player.
So if you just said looter I'd agree with you. When you say griefer I don't - IMO a griefer is inherently a jerk (player, not character)