Welcome, Guest
Python Scripts for ComicRack

TOPIC: Duplicates Manager (v Alpha - 0.6)

Re: Duplicates Manager (v Alpha - 0.6) 4 years 3 months ago #36669

  • burnshroom
  • burnshroom's Avatar
  • Offline
  • Junior Boarder
  • Posts: 25
  • Thank you received: 2
  • Karma: 2
How would I TS (troubleshoot) an error message I get from time to time when running this script:

Exception has been thrown by the target of an invocation.
Last Edit: 4 years 3 months ago by burnshroom.
The administrator has disabled public write access.

Re: Duplicates Manager (v Alpha - 0.6) 4 years 3 months ago #36685

  • Wolfbanes
  • Wolfbanes's Avatar
  • Offline
  • Junior Boarder
  • Posts: 31
  • Thank you received: 2
  • Karma: 8
600,

Thank you worked like a charm. Think I am happy with the way this works I mean if it works for the great 600 or is it Lord 600 then it should be just fine for me. Thank you once again mate. Just one question I noticed that some c2c were moved to the dupe folder, if I wanted to keep the issues with ads what do I need to change it to. filename keep c2c? Once again thank you for sharing the knowledge.
The administrator has disabled public write access.
The following user(s) said Thank You: 600WPMPO

Re: Duplicates Manager (v Alpha - 0.6) 4 years 3 months ago #36686

  • 600WPMPO
  • 600WPMPO's Avatar
  • Offline
  • Moderator
  • Posts: 3788
  • Thank you received: 557
  • Karma: 233
Wolfbanes wrote:
Just one question I noticed that some c2c were moved to the dupe folder, if I wanted to keep the issues with ads what do I need to change it to. filename keep c2c? Once again thank you for sharing the knowledge.
I think that "filename keep c2c" should be just fine.
Wolfbanes wrote:
...I mean if it works for the great 600 or is it Lord 600...
Ha...! :laugh:

Now Playing: The ComicRack Manual (Online)

See my new comics & gadgets on: Tumblr!
The administrator has disabled public write access.

Re: Duplicates Manager (v Alpha - 0.6) 4 years 2 weeks ago #37496

  • solidus0079
  • solidus0079's Avatar
  • Offline
  • Senior Boarder
  • Posts: 76
  • Thank you received: 3
  • Karma: 1
WOW, thanks 600WPM. You've already saved me a ton of work (and disk space).

I am having a small issue, which I've tried troubleshooting to no avail. Your script managed to snag most of the duplicates, but not all.

The remaining all seem to be exact duplicates, same file size and everything. I was previously using "filesize keep largest" so I figured the script wasn't able to make a decision since neither were "largest". I removed that rule and no change, so that's not it.

I checked file/directory write permissions (my comics are on a network share). I also went into the duplicates folder and moved the files elsewhere in the event it couldn't move files that already had an exact filename match there. Neither were a fix.

I'm not using any real rules, since the duplicates don't have any variance in covers, resolution, etc. Granted, it's not a "huge" amount of duplicates left, your script already bagged a vast quantity. I was just curious for my own knowledge here (and maybe someone else who stumbles in).


File Attachment:

File Name: logfile.log.zip
File Size:1 KB
Last Edit: 4 years 2 weeks ago by solidus0079.
The administrator has disabled public write access.

Re: Duplicates Manager (v Alpha - 0.6) 4 years 4 days ago #37628

  • dantreacy
  • dantreacy's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 1
  • Karma: 0
I appear to have uncovered a small bug.

After running DM and getting the dreaded

"Exception has been thrown by the target of an invocation"

I went looking and found the following
STOPPED PROCESSING BECAUSE OF EXCEPTION:
Traceback (most recent call last):
File "C:\Users\xxx\AppData\Roaming\cYo\ComicRack\Scripts\Duplicates Manager\duplicatesmanager.py", line 80, in DuplicatesManager
File "C:\Users\xxx\AppData\Roaming\cYo\ComicRack\Scripts\Duplicates Manager\duplicatesmanager.py", line 279, in ProcessDuplicates
exceptions.UnicodeDecodeError: ('unknown', u'\xbd', 0, 1, '')

A quick bit of googling unicode characters lead me to discover that \xbd is the inciode character for 1/2 (half, written in unicode, obviously).

After checking the list of filenames I discovered that indeed one of the filenames was using the unicode 1/2 in it's name.

This would appear to be a relatively easy fix and if I had some more time I might have a go myself, but time is sadly lacking at the moment.

Just thought I'd let people know in case anyone else happens to run across it.

The fix, if it does affect you, is pretty simple, just delete the unicode character the script doesn't understand (in this case 1/2) out of the filename(s).

If anyone wants to have a stab at fixing it let me know as I'll hold onto the original copy of the file with the funky filename so you can do some testing.
The administrator has disabled public write access.

Duplicates Manager (v Alpha - 0.6) 3 years 9 months ago #38400

  • WraithTDK
  • WraithTDK's Avatar
  • Offline
  • Junior Boarder
  • Posts: 36
  • Thank you received: 1
  • Karma: 0
Sounds really useful. Unfortunately, I keep getting this:




When I try to run it. Help?
I am currently reading every Marvel Superhero comic book every printed, in chronological order, and blogging about the milestones, footnotes, and other interesting moments I read at http://www.wraithscomicjourney. I'll be adding DC when I hit 1985, and other companies when they launch.
The administrator has disabled public write access.

Duplicates Manager (v Alpha - 0.6) 3 years 8 months ago #38644

  • Jothay
  • Jothay's Avatar
  • Offline
  • Senior Boarder
  • 1
  • Posts: 47
  • Thank you received: 24
  • Karma: 6
nevermind, of course I should have read like two posts up and seen a better description of my issue
Last Edit: 3 years 8 months ago by Jothay.
The administrator has disabled public write access.

Duplicates Manager (v Alpha - 0.6) 3 years 2 months ago #40716

  • krandor
  • krandor's Avatar
  • Offline
  • Gold Boarder
  • Posts: 206
  • Thank you received: 21
  • Karma: 4
I love this script but my one and only issue is that sometimes you have a TPB that comes out the same year as the original comic so this script sees them as the same since comicvine volume information is based just on the year.

How hard would it be the adjust the script to also look at the CVDB value when deciding dupes? I am not a programmer and looked at the code and looks like the code is already setup to grab the CVDB information but there is just no logic built to use that.

What would it take to make it where issues are not considered dupes if they have different CVDB values?
The administrator has disabled public write access.

Duplicates Manager (v Alpha - 0.6) 2 years 11 months ago #41379

  • t_jay17
  • t_jay17's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 13
  • Karma: 0
Can someone help me? When I try to use it says that dmrules.dat cannot be found.
The administrator has disabled public write access.

Duplicates Manager (v Alpha - 0.6) 2 years 10 months ago #41594

  • boshuda
  • boshuda's Avatar
  • Offline
  • Gold Boarder
  • Posts: 296
  • Thank you received: 65
  • Karma: 8
t_jay17 wrote:
Can someone help me? When I try to use it says that dmrules.dat cannot be found.
You might want to read the wiki. It outlines where to put a dmrules.dat, and how to modify it. Overall wiki:
code.google.com/p/comicrack-duplicates-manager/w/list

Rules wiki (answers your question pretty directly)
code.google.com/p/comicrack-duplicates-m...wiki/RulesFileSyntax

Chances are your dmrules.dat lives in C:\Users\t_jay17\AppData\Roaming\cYo\ComicRack\Scripts\Duplicates Manager (change t_jay17 to your windows username). It looks like there's a dmrules.dat.demo in mine, I don't know if that came with the script or if I renamed it.

Here's mine, but keep in mind it will actually remove the files to the c:\__dupes__ directory and not simply create the log file. I also keep all of my files in an unscraped directory until I've sorted them, which is reflected below in that if all else fails I would rather keep the file that's already in my main library and toss the new one in the unscraped directory:
# All possible rules at the end of the file

# this example removes fileless and 
# selects the noads files with largest filesize

@ MOVEFILES True
@ REMOVEFROMLIB True
@ C2C_NOADS_GAP 120

filesize 	keep 	largest 40%
pagecount 	remove 	fileless
filename 	keep 	noads
filename 	keep 	Kryptonian-DCP
filename 	keep 	Jojo
filename 	keep 	fixed
filename 	keep 	Minutemen
filename 	keep 	(2048px)
filename 	remove 	"cover only"
covers 		keep 	all
pagecount 	keep 	noads 
filetype	keep	cbz
filepath	remove	unscraped

#
#
# filename    keep    c2c
# filename    remove  c2c
# filetype    keep    zip rar
# filetype    remove  pdf
# filetype    remove  fileless
# filepath    keep    c2c
# filepath    remove  c2c
# tags        remove  c2c
# tags        keep    c2c
# notes       keep    c2c
# notes       remove  c2c
# text        keep    c2c
# text        remove  c2c
# scan        keep    abc
# scan        remove  abc
# covers      keep    all
# covers      keep	  some
# filesize    keep    largest
# filesize    keep    largest	10%
# filesize    remove  largest
# filesize    remove  largest	10%
# filesize    keep    smallest
# filesize    keep    smallest	10%
# filesize    remove  smallest
# filesize    remove  smallest	10%
# pagecount   keep    largest
# pagecount   remove  largest
# pagecount   keep    smallest
# pagecount   remove  smallest
# pagecount   keep    fileless
# pagecount   remove  fileless
# pagecount   keep    noads
# pagecount   keep    c2c
# keep        first
The administrator has disabled public write access.
The following user(s) said Thank You: t_jay17
Time to create page: 0.256 seconds

Who's Online

We have 242 guests and 3 members online