André Figueira

Systems engineer - I write apps, I make websites, opinions are my own...

I recently had to run a big ingestion at work, and as it was generally a test run we didn't want to do too many at a time, so we split them into chunks of 1 million each, see here how to do it with unix

Recently I've been working with dealing with huge datasets in code, and I've needed to test this by generating data I can use for my tests, vim, seemed the easiest way to do this!