> I just don't get why more people haven't tried to build on it

You should look at Kaluza-Klein theory, where electric charge is just momentum in a 5th spatial dimension of space-time.