Plz suggest good duplicate file finder

coldhart · Aug 15, 2012

Frnds plz suggest good duplicate file finder, which not limited upto mp3 or images.
Os
Windows 7 ultimate X64 SP1

thanks in advance

msn · Aug 15, 2012

Duplicate Finder will find duplicate photos, songs, documents, spreadsheets, MP3 files, and more.

nbaztec · Aug 15, 2012

If you're looking for some out of the box solution, I recommend trying this script I wrote long ago:

Save the following code as filedup.ps1, somewhere.

Code:

param
(
	[string]$root = $null,
	[switch]$verbose
);
  
#----------------------------------------------------------------
function filedup()
{	
	$dupfiles = @{}
	$hashAlgorithm = new-object -TypeName "System.Security.Cryptography.MD5CryptoServiceProvider";
	$files = @(Get-ChildItem -Path $root -recurse -ErrorAction SilentlyContinue);
	foreach ($file in $files)
	{
		#"MD5($($file.PsIsContainer))"
		if(!$file.PsIsContainer)
		{
			$stream = $file.OpenRead();
			$hashByteArray = $hashAlgorithm.ComputeHash($stream);
			$stream.Close();
			
			$md5StringBuilder = New-Object System.Text.StringBuilder
			
			$hashByteArray | % {[void] $md5StringBuilder.Append($_.ToString("x2"))}
			$md5h = $md5StringBuilder.ToString()
			if($verbose)
			{
				"Processed $($file.Fullname) with hash $md5h"
			}
			if(!$dupfiles.ContainsKey($md5h))
			{
				$dupfiles[$md5h] = @()
			}
			$dupfiles[$md5h] = $dupfiles[$md5h] + ($file.Fullname);		
		}


		# Ensure stream is closed if exceptions occurred.
		trap
		{
			if ($stream -ne $null) { $stream.Close(); }
			break;
		}
	}
	""
	"Showing duplicate files:"
	foreach ($item in $dupfiles.GetEnumerator())
	{				
		if($item.value.length -gt 1)
		{
			"------------------------"
			foreach($f in $item.value)
			{				
				"	$f"
			}						
		}		
	}
	"------------------------"
	}

filedup -root $root -verbose $verbose;

You need to specify Set-ExecutionPolicy Unrestricted on your PowerShell (in elevated mode), and use (since running scripts is disabled by default, lol?):

Code:

     C:\path-to-filedup> filedup [path]

Sample Output:

Showing duplicate files:
------------------------
M:\Android\data\com.sonyericsson.advancedwidget.photo\cache\876841530
M:\Android\data\com.sonyericsson.advancedwidget.photo\cache\2053167327
------------------------
M:\DCIM\.thumbnails\1343033167966.jpg
M:\DCIM\.thumbnails\1342765585552.jpg
------------------------
M:\DCIM\.thumbnails\1343033170957.jpg
M:\DCIM\.thumbnails\1342720605743.jpg
------------------------
M:\DCIM\.thumbnails\1343033168904.jpg
M:\DCIM\.thumbnails\1343033168427.jpg
M:\DCIM\.thumbnails\1342969542076.jpg
M:\DCIM\.thumbnails\1342969542668.jpg
------------------------
M:\Android\data\com.imangi.templerun\files\ALT_recordmanager.dat
M:\Android\data\com.imangi.templerun\files\recordmanager.dat
------------------------
M:\Android\data\com.google.android.apps.maps\cache\cache_its.m
M:\Android\data\com.google.android.apps.maps\cache\cache_its_ter.m
------------------------
M:\DCIM\.thumbnails\1343033169664.jpg
M:\DCIM\.thumbnails\315965723744.jpg
------------------------
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\local-video-thumbsindex
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\picasa-thumbsindex
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\facebook-thumbsindex
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\facebook-external-thumbsindex
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\local-skip-cacheindex
------------------------
M:\DCIM\.thumbnails\1343033172059.jpg
M:\DCIM\.thumbnails\1342760458147.jpg
M:\DCIM\.3d_thumbnails\1342760457748.jpg
------------------------
M:\etc\vcf\165.jpeg
M:\etc\vcf\69.jpeg
------------------------
M:\openfeint\webui\manifest.db-journal
M:\openfeint\webui\.nomedia
M:\Android\data\.nomedia
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\DiskCache-1846414157.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\DiskCache1626353870.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\DiskCache-1365806458.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\DiskCache-488892092.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-video-thumbs\DiskCache414606222.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache-1860964188.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache-918256541.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache-336822090.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache-986136113.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache-1390951967.tmp
M:\Android\data\com.sonyericsson.gallery\cache\picasa-thumbs\DiskCache710368691.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-476832466.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1074568624.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-197269216.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache1360638136.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1617356993.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache137293844.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1886669858.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache755762041.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache221800308.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1157825444.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache646965425.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-281113941.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1677706542.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache903623688.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache353946614.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache2055979548.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache648323188.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1591143989.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1361172682.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache-1416938626.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-thumbs\DiskCache712610374.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache753130979.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-506294499.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-506592007.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1863474300.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache797419049.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-1204633699.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-1900551467.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache528775514.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-366279902.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-1718019842.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache805728803.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1585624781.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1103719878.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1307194636.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-2111001672.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache179172769.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1229544147.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-835005131.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache1760002341.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-2118075359.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-1977954009.tmp
M:\Android\data\com.sonyericsson.gallery\cache\facebook-external-thumbs\DiskCache-846127180.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache540583917.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-711115542.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-650040929.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-2100792832.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache335316934.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache1732910097.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache1869392582.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache1147087655.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-929308634.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache385740157.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache261008572.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-58505230.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-457520109.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-1142166614.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache688636638.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache-161464925.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-meta-cache\DiskCache427114200.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-582455047.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1249363929.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1102890385.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache1128820084.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache983514924.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1398346286.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache1985618740.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1026246859.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-903508065.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1917144530.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache2111392572.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache1250655684.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache986260249.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-215086520.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache722150289.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-1147744311.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache-276866338.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache1683258517.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache620729589.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-skip-cache\DiskCache1180837295.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-image-thumbs\DiskCache1820139299.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-image-thumbs\DiskCache-552667837.tmp
M:\Android\data\com.sonyericsson.gallery\cache\local-image-thumbs\DiskCache878653914.tmp
M:\Android\data\com.google.android.apps.genie.geniewidget.news-content-cache\.nomedia
M:\foursquare\cache\.nomedia
M:\tmp\.astro\astro.db-journal
M:\tmp\nx.android.feedreader\feeddigit.dump
------------------------
M:\Android\data\com.google.android.apps.maps\cache\cache_vts_GMM.m
M:\Android\data\com.google.android.apps.maps\cache\cache_vts_labl_GMM.m
------------------------

LuiFigo · Oct 31, 2012

If you are looking for a good duplicate file finder then i will suggest you to search it on search engines since it gives the best results in series.

gameranand · Oct 31, 2012

You can use glary utilities for finding duplicate files also. However please be more specific, what do really want to find, images , audio files ???

topgear · Nov 1, 2012

@ Op - use this ;-)

Anti Twin - Duplicate file search (Freeware) - Find and delete duplicate files or similar images
or
Find duplicate files with Auslogics Duplicate File Finder

Plz suggest good duplicate file finder

coldhart

Journeyman

msn

खिड़की माने Windows

nbaztec

Master KOD3R

LuiFigo

Right off the assembly line

gameranand

Living to Play

topgear

Super Moderator