MyTetra Share
Делитесь знаниями!
Removing Duplicate Lines With Sort, Uniq and Shell Pipes
Время создания: 22.12.2017 10:36
Текстовые метки: linux text duplicate line
Раздел: Linux

Use the following syntax:
sort {file-name} | uniq -u
sort file.log | uniq -u

Here is a sample test file called garbage.txt:

this is a test
food that are killing you
wings of fire
we hope that the labor spent in creating this software
this is a test
unix ips as well as enjoy our blog

Type the following command to get rid of all duplicate lines:
$ sort garbage.txt | uniq -u
Sample output:

food that are killing you
unix ips as well as enjoy our blog
we hope that the labor spent in creating this software
wings of fire

Where,

  • -u : check for strict ordering, remove all duplicate lines.
Так же в этом разделе:
 
MyTetra Share v.0.53
Яндекс индекс цитирования