There are a number of benefits, one that comes immediately to mind is having a common army and saving costs. Another one is that having a common currency, but not a common fiscal policy is not a good idea.

I don't think language differences are a problem. There are a couple of nations with multiple official languages.