Since you mention it in connection to Together/RedPajama, are you saying that what they are publishing isn't actually open source? Most of the stuff I see them publish is licensed under Apache-2.0 which is a FOSS license, so I find it weird to mention it here.