That's because those things are inherently tied. It's not about taking your time and making the layman an expert to understand some hard topic. It's about being able to relate it to them in simple terms.

Obviously, if you use the "hairy" physics etc terms, then the layman wont understand your explanation, because he is not familiar with them.