Welcome, Guest
Python Scripts for ComicRack
  • Page:
  • 1
  • 2

TOPIC: Problems and Solutions - put your Ideas for smartlist scripts here!

Problems and Solutions - put your Ideas for smartlist scripts here! 2 weeks 6 days ago #48465

  • Xelloss
  • Xelloss's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 455
  • Thank you received: 117
  • Karma: 24
I am currently working in a script that detect scanner information based in duplicate pages... It is yet to be fully released, but the hashing part seems to work quite fine right now... You can find it here:

comicrack.cyolito.com/forum/13-scripts/3...eta-scripts?start=50

If you run it once in any comic, it will scan all comics with scan information in them (I can easily modified it to do it in all comics if you want) and store an array of all pages hashes in a custom value called page_hashes (than it uses for another thing but you don't mind about that part)

Then if you use my Same X Different Y script you can find all comics with same page_hashes, and my First X of Y script to select only the first of each duplicate pair... (or group), and presto! instant duplicate comics deletion XD

Of course I can make a script that does all that automatically, but if you don't want to wait you can just do that XD

If you don't have many versions of the same comic and different scanner, and have them comicvine scraped, you can just use Same X Different Y script to search for files with same series, same volume and same month of release.... That would surely find all duplicates, although it will detect different versions of the same comic as the same...

About the script that copy the CVDB from the notes to the comicvine_issue custom value, I think I have it somewhere, let me look for it and I will post it here when I do (never posted it here I think)
Last Edit: 2 weeks 6 days ago by Xelloss.
The administrator has disabled public write access.
The following user(s) said Thank You: beardyandy

Problems and Solutions - put your Ideas for smartlist scripts here! 2 weeks 6 days ago #48466

  • Xelloss
  • Xelloss's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 455
  • Thank you received: 117
  • Karma: 24
ok, I remember now, I didn't do a script that only did that... but if you you use this other script I made some time ago:

comicrack.cyolito.com/forum/13-scripts/3...-format?limitstart=0

with the last database (it is in the post), it will repopulate not only comicvine_issue custom value, but also comicvine_volume as well of all comics selected... Remember this only work if you still have the notes from the scraper... (that is stored in the comicfiles if you store data inside the files, not like the custom values that are only stored in the comicrack library)
Last Edit: 2 weeks 6 days ago by Xelloss.
The administrator has disabled public write access.

Problems and Solutions - put your Ideas for smartlist scripts here! 1 week 6 days ago #48504

  • krandor
  • krandor's Avatar
  • Offline
  • Gold Boarder
  • Posts: 204
  • Thank you received: 21
  • Karma: 4
beardyandy wrote:
Krandor - love to look at that script if possible please, and will look at duplicate manager again properly. I suspect it's the answers to a lot going forward. If, as I seem to remember, it allows checking two files are of a similar filesize (e.g. withing 10% and/ or 1Mb of each other) then I think it's a good answer.
.

I'll do so along with my notes. Basically I created my changed version due to some GNs coming out the same year as the comics leading to two "volumes" with same volume number per comicvinescraper. I worked around that with an organizer script based on number of pages The final straw was secret wars where you had a volume that ran during secret wars and then a new ongoing right after (like A-Force) and again with comicvinescraper both showed as same volume. So finally decided then I needed something to decide duplicate by CVDB ID and not Series/Volume.

I'm working on learning python and have some other things I'd like to add to dupliate manager once I learn more so I hope I can eventually fork the project into something I can release but for now I have my own private branch but I'm happy to send you a copy and I'll explain caveats when I send it. It is a hack and nothing more and really want one day to be able to do more then that and make a releasable fork.
The administrator has disabled public write access.
The following user(s) said Thank You: beardyandy

Problems and Solutions - put your Ideas for smartlist scripts here! 4 days 23 hours ago #48602

  • beardyandy
  • beardyandy's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 15
  • Thank you received: 1
  • Karma: 0
Hey Krandor,

Not chasing you for that but I've been using Xeloss' hashing script and it's excellent. Although I'm a little unsure of a couple of the details of how it works but if I'm right.

Makes searching for genuine duplicates a definite match. Actually I think it has great potential, if anyone was willing to do it... as it gives a definite fingerprint for each scan there could potentially be a database of each scan and it's relevant comicvine information/ scanner info etc etc. Although that may attract unwanted attention. Not sure if that's where you're going with it Xeloss?
That's something I'd definitely give my data/ time to help with (although skills are lacking)

I don't (yet) have the python skills to hack apart duplicate manager to include the page_hashes field, as you have done with comicrack_issue but if you're serious about developing it further I'd definitely give it a look and perhaps include that page_hashes field as you have done with comicvine_issue. Just a thought

Thank you all so much.
The administrator has disabled public write access.

Problems and Solutions - put your Ideas for smartlist scripts here! 4 days 23 hours ago #48603

  • beardyandy
  • beardyandy's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 15
  • Thank you received: 1
  • Karma: 0
Back to the subject of script suggestions.

Would there be some way to chain a workflow.

Not sure what people's workflow is but mine is largely...
Convert to cbz
Scan with comicvine scraper
Apply Data Manager rules
Update
Move with File manager

I appreciate exceptions would be the problem here and may not work for all, but if there was some way of getting 80% in a single click?
Last Edit: 4 days 23 hours ago by beardyandy.
The administrator has disabled public write access.

Problems and Solutions - put your Ideas for smartlist scripts here! 4 days 5 hours ago #48609

  • Xelloss
  • Xelloss's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 455
  • Thank you received: 117
  • Karma: 24
My system would be more or less:

-Move comics to main comic folder
-Scan folder to import new comics
-Scan for Scanner name in file (scanner script)
-Autopopulate data from already organized books to new books (autopopulate script)
- Remove comics added by mistake
-Scrap books with not recognised cvvolume (cvscraper manually)
-Scrap books with recignised cvvolume (cvscraper automatic)
-Decide group, subgroup, format and count (1 if oneshot or 0 if not) of new volume comics
-Complete autonatic field rules (Datamanager script)
- Search for any kind of incongruencies in my 40+ smartlist designed to search for incongruencies in the above procedures and fix them
- Move files to correct folder (Library Organized script)
- Load resolution and delete ads of all pages in all comics, also recognise multiple covers (with pages preview)
- Export files to new, clean cbz files
- Update data into comics
- Add tags with my autotag scripts
- Fix comments (extract cover information) with my clean comment script
- Search for duplicate pages in new comics and delete them (custom script)
- Search for comics with low resolution to download new hd ones if possible (custom script)
- Search for Missing comics (Missing comic Script)
- Search for new events or changes to smart list in collections
- Search for finished series to add finished field Yes and correct count (custom script and manual checking)

I am surely forgetting many steps that some smartlist will warn me to check XD

As you can see there are still a lot of manual criteria and things to check that are imposible to automate... So in my case a one buttom solution is imposible :/
The administrator has disabled public write access.
  • Page:
  • 1
  • 2
Time to create page: 0.184 seconds

Who's Online

We have 226 guests and 3 members online