Right, but people without a To Do list also spend time thinking about the priority of things and what needs to be done.

In fact, that's my personal takeaway from GTD- that the list is there to stop you from thinking about upcoming stuff all day, because it's saved somewhere and can be shuffled at a calm minute.