Remove Duplicate files

[jaideep_jdof]

I have a big collection of mp3s about 30 GB and I think there are some duplicate files. Is it possible to remove them. Is there any app available.

[Eren.Turkay]

There is a command line tool named "fdupes". However, it hasn't been packaged but you can easily compile with 1 command and use it.

Enter these commands to compile and install fdupes;

Code:

wget http://netdial.caribe.net/~adrian2/programs/fdupes-1.40.tar.gz
tar -xvf fdupes-1.40.tar.gz
cd fdupes-1.40
make
sudo cp fdupes /usr/bin
sudo chmod +x /usr/bin/fdupes

Now, fdupes is ready to use. You can see what options you can use by typing "fdupes --help". To see what files are duplicated in directory, enter;

Code:

fdupes -r /duplicated/files/directory

It will calculate and show what are duplicated, to delete it, you should add "-d" parameter but it will prompt you for every file and this is very annoying. To achieve this, you will give "1" option to everything prompted to delete 1 copy of duplicated file. Just type to delete 1 copy of duplicated file in directory;

Code:

yes 1 | fdupes -rd /duplicated/files/directory

You can also check this link; http://ubuntu.wordpress.com/2005/10/08/find-duplicate-copies-of-files/

[jaideep_jdof]

Thanks its a good app. Should be added to the repos. It will be very useful to other users.