There is a function in the Libreoffice spreadsheet to remove duplicate entries. It is hidden under the Standard Filter. Here is a video showing how to do it.
About the author
Xuan Ngo is the founder of OpenWritings.net. He currently lives in Montreal, Canada. He loves to write about programming and open source subjects.