This stems from a limitation of rgl—if rgl ever gets around to supporting a virtual frame buffer (which has been in rgl’s TODO document for a while), rayshader would support that feature.