Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
floki999
on Nov 11, 2019
|
parent
|
context
|
favorite
| on:
When your data doesn’t fit in memory: the basic te...
Dask anyone? Allowed me to handle a 60 Gb dataset on a machine with 16 Gb RAM. High level of compatibility with Pandas dataframes.
roaur
on Nov 12, 2019
|
next
[–]
I'm a Dask evangelist. It's a remarkable tool and is one of the first I reach for when this problem arises. Maybe it's not well known?
xiaodai
on Nov 12, 2019
|
prev
[–]
I mean, don't reach for Spark. Just get Dask, a databased or R's disk.frame is mostly fine.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
