There's an enormous amount of literature and technique in the mainframe world for dealing with data bigger than ram. Because that was the norm.

Whole companies have been built around the problem. e.g. syncsort.com

I hope some interesting techniques don't get locked up and lost in proprietry mainframe software.