Comments on: fdupes Tutorial http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/ Tons of fun at a xterm! Fri, 16 Oct 2009 18:58:04 +0000 http://wordpress.com/ hourly 1 By: none http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5692 none Fri, 16 Oct 2009 18:58:04 +0000 http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5692 you'll need to adjust the quotes in my example above since the blog soft replaced them you’ll need to adjust the quotes in my example above since the blog soft replaced them

]]> By: none http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5681 none Fri, 25 Sep 2009 14:28:02 +0000 http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5681 you can pipe the list of files into the iterator: cat dupes.txt | while read line;do rm -v "$line";done you can pipe the list of files into the iterator:

cat dupes.txt | while read line;do rm -v “$line”;done

]]> By: James McGill http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5601 James McGill Sat, 18 Apr 2009 18:36:26 +0000 http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5601 I'm on the ambitious task of finding and removing duplicates against an 8 terabyte network attached storage. Even breaking it down into reasonably sized chunks, fdupes takes days (maybe weeks, we don't know yet) to run, but it doesn't overgrow in memory when presented with huge numbers of files. (That's what I was afraid it would do, and fslint choked on our filesystem.) I’m on the ambitious task of finding and removing duplicates against an 8 terabyte network attached storage.

Even breaking it down into reasonably sized chunks, fdupes takes days (maybe weeks, we don’t know yet) to run, but it doesn’t overgrow in memory when presented with huge numbers of files.
(That’s what I was afraid it would do, and fslint choked on our filesystem.)

]]> By: Sergio http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5577 Sergio Wed, 04 Feb 2009 13:02:47 +0000 http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5577 This is a nice approach: <code>b="" fdupes tmp/ --recurse | \ while read f do if [ "$f" = "" ] then b=”" else if [ "$b" = "" ] then b=”$f” else rm “$f” && echo “Removed \”$f\”" fi fi done</code> (Source: http://www.miriamruiz.es/weblog/?p=79 ) This is a nice approach:

b=""
fdupes tmp/ --recurse | \
while read f
do
if [ "$f" = "" ]
then
b=”"
else
if [ "$b" = "" ]
then
b=”$f”
else
rm “$f” && echo “Removed \”$f\”"
fi
fi
done

(Source: http://www.miriamruiz.es/weblog/?p=79 )

]]> By: James http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5541 James Wed, 24 Dec 2008 01:47:17 +0000 http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5541 A little unclear. The sort command doesn't specify which filelists should be passed as arguments (previous steps mention two filelists: the original -rf one, the one with first entries omitted). The while loop doesn't mention which of the three filelists to pass, and where. Ryan's Comment 1 defines variables as a tutorial should. Last, the while loop command mentioned in the tutorial is still incorrect lacking "< $removelist". There are also various typos, which are annoying ("use start"). A little unclear. The sort command doesn’t specify which filelists should be passed as arguments (previous steps mention two filelists: the original -rf one, the one with first entries omitted). The while loop doesn’t mention which of the three filelists to pass, and where. Ryan’s Comment 1 defines variables as a tutorial should. Last, the while loop command mentioned in the tutorial is still incorrect lacking “< $removelist”. There are also various typos, which are annoying (“use start”).

]]> By: Recursive copy to a RANDOM name - Page 2 - UNIX for Dummies Questions & Answers - The UNIX and Linux Forums http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5530 Recursive copy to a RANDOM name - Page 2 - UNIX for Dummies Questions & Answers - The UNIX and Linux Forums Thu, 23 Oct 2008 11:19:34 +0000 http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5530 [...] mind that the file paths/names had difficult characters. The following fdupes tutuial was useful: fdupes Tutorial Life at the CLI I've double checked the results with variations on the following command: find . -type f -exec [...] [...] mind that the file paths/names had difficult characters. The following fdupes tutuial was useful: fdupes Tutorial Life at the CLI I’ve double checked the results with variations on the following command: find . -type f -exec [...]

]]> By: Ahsan Ali http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5447 Ahsan Ali Fri, 30 May 2008 13:34:05 +0000 http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5447 Thanks, this was very useful even all the way over here in Pakistan. :) Thanks, this was very useful even all the way over here in Pakistan. :)

]]> By: fdupes Tutorial @ โหน่ง : N^o^NG http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5292 fdupes Tutorial @ โหน่ง : N^o^NG Sun, 09 Dec 2007 14:35:22 +0000 http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-5292 [...] http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/  [...] [...] http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/  [...]

]]> By: Flightlessbird http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-4970 Flightlessbird Sat, 13 Oct 2007 13:10:12 +0000 http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-4970 Fantastic help - even a total newbie like me could follow it. Very useful. Fantastic help – even a total newbie like me could follow it. Very useful.

]]> By: Paul http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-4814 Paul Tue, 02 Oct 2007 15:29:45 +0000 http://dosnlinux.wordpress.com/2007/02/18/fdupes-tutorial/#comment-4814 Aha, I switched to bash and now all is OK. Aha, I switched to bash and now all is OK.

]]>