"a set of standard low-level control primitives ... Are there technical challenges preventing this from happening, or is it mainly inertia and lack of need from the current market?"

It's easier to iterate faster without having to deal with a standardization committee. See OpenGL history for some context.