shareimprove this question

asked Feb 6 '13 at 10:48

alpha_cod

590725

Shuf? en.wikipedia.org/wiki/Shuf – Anders Lindahl Feb 6 '13 at 10:51

millions of lines for a 16MB file: you have very short lines? BTW: 16 MB is not big. It will fit in core, and sorting will take less than a second, I guess. – wildplasser Feb 6 '13 at 10:56 

@AndersLindahl : What's the entropy Shuf introduces? Is it as random as 'sort -R' – alpha_cod Feb 6 '13 at 11:05

@wildplasser : Oh...its a 16 Million line file, not 16 MB. Sorting is quite fast on this file, but 'sort -R' is very slow. – alpha_cod Feb 6 '13 at 11:05

@alpha_cod: I would guess it's /dev/random. You can control then entropy source with --random-source. – Anders Lindahl Feb 6 '13 at 11:33

This is a similar thread stackoverflow.com/questions/2153882/… – Ifthikhan Feb 6 '13 at 12:10

@AndersLindahl How about suggesting that as an answer? – that other guy Feb 6 '13 at 20:02