There's plenty of other waste that's more dangerous and produced in far greater quantities that people mostly don't care about. Why all the attention on nuclear waste specifically?
Anything that has a half-life of 500,000 years isn't very radioactive at all. The half life is directly related to the amount of harmful stuff it puts out.