On Sat, Mar 28, 2015 at 3:56 PM, Matthew Lai <m...@matthewlai.ca> wrote:
> Just wondering if there is an option to divide things up in blocks of lines? > > For example, if there is a file with a million lines, is there a way to run > 4 processes, with 250k lines input each? > > I have a large file I want to process in parallel, but the command has high > startup overhead. Before I answer that, please tell me whether you have: * watched the intro videos (http://pi.dk/1) * walked through the tutorial (man parallel_tutorial) * read the examples in the man page (LESS=+/EXAMPLE: man parallel) /Ole