Did you know DVC doesn't handle large datasets? Neither did we and here's how we fixed it
Filed in Machine Learning
We hit a nice roadblock yesterday while working on a dataset with 5 million samples. It took us 8 hours to upload the dataset and 11 hours to download and unpack it. We learned some valuable lessons there that I’ll discuss in this post so you don’t have to run into the same issues.
Read more