Welcome, Guest
News and Announcements

TOPIC: Comic Vine Scraper 1.0.53-58

Re: Comic Vine Scraper 1.0.53-54 4 years 10 months ago #29297

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1328
  • Thank you received: 508
  • Karma: 182
Hey guys, I've updated Comic Vine Scraper to incorporate fixes for a few bugs that were reported, and add in some language pack updates. See the first post in this thread for more details.
Last Edit: 4 years 10 months ago by cbanack.
The topic has been locked.
The following user(s) said Thank You: 600WPMPO

Re: Comic Vine Scraper 1.0.53-54 4 years 10 months ago #29391

  • forkicks
  • forkicks's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 871
  • Thank you received: 109
  • Karma: 37
I'm scraping this week's new releases.

First of all, showing the right number cover? Its FANTASTIC.

Second of all, PLEASE make automatic image matching, either following the algorithm cYo suggested or even something much easier as image subtraction below a certain threshold.

The whole scraper is -so close- to being completely automatic that its scary.

Thanks, its amazing.
fK
The topic has been locked.
The following user(s) said Thank You: 600WPMPO

Re: Comic Vine Scraper 1.0.53-54 4 years 10 months ago #29392

  • 600WPMPO
  • 600WPMPO's Avatar
  • Offline
  • Moderator
  • Posts: 3788
  • Thank you received: 557
  • Karma: 233
forkicks wrote:
The whole scraper is -so close- to being completely automatic that its scary.
'Nuff said! :)
Now Playing: The ComicRack Manual (Online)

See my new comics & gadgets on: Tumblr!
The topic has been locked.

Re: Comic Vine Scraper 1.0.53-54 4 years 10 months ago #29393

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1328
  • Thank you received: 508
  • Karma: 182
forkicks wrote:
Second of all, PLEASE make automatic image matching, either following the algorithm cYo suggested or even something much easier as image subtraction below a certain threshold.

I'm not totally sure what you mean by automatic image matching? It would be cool if the scraper could find individual comics based on the cover of each cbz file, but that isn't possible unless ComicVine changes their API to allow searching based on cover image (because only they have the complete list of available covers to search through.)

Or are you just imagining something that automatically finds the "best" cover match when you click on the "more covers" link?
The topic has been locked.

Re: Comic Vine Scraper 1.0.53-54 4 years 10 months ago #29394

  • forkicks
  • forkicks's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 871
  • Thank you received: 109
  • Karma: 37
I mean if the cover of the comic matches the cover that the scraper shows for the current issue (or one of the alternate covers, if those exist), then the scraper could automatically match the comic without user intervention.



I suggested something along the lines:
Cover_Comic_In_Library (A) - Cover_Pulled_By_Scraper (B ) <= some threshold, then consider it a match. Consider resulting pixel color average or something along those lines. I could make something in c# like this fairly easy, but i don't know python enough to do it. Or any other image comparison algorithm, it doesn't really matter which. Doesn't python have anything builtin for that?

The scraper is already showing the right cover for each issue. In my case, it never failed to find the right cover for this week's new releases. So i'm pressing OK to confirm that image A is equal to image B (confirming its the right issue) when it could be done automatically.

fK
Last Edit: 4 years 10 months ago by forkicks.
The topic has been locked.

Re: Comic Vine Scraper 1.0.53-54 4 years 10 months ago #29395

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1328
  • Thank you received: 508
  • Karma: 182
Ahh, I see what you mean. :)

I'm not an expert on image matching, but I guess the hardest problems would be matching images that have different color saturation or brightness levels, and matching images that have different proportions. For this to work the way you describe, the algorithm would need to be match images with a high degree of accuracy (basically 100% accurate for the ones that it chooses to do automatically.)

That's a cool idea, I will give it more thought.
The topic has been locked.

Re: Comic Vine Scraper 1.0.53 4 years 10 months ago #29397

  • ComicTagger
  • ComicTagger's Avatar
  • Offline
  • Senior Boarder
  • Posts: 43
  • Thank you received: 13
  • Karma: 7
ComicTagger has this implemented with a pretty simple image processing algorithm, called an average hash, that is surprisingly effective. Feel free to plunder the source as much as you want. Particularly, look at the ImageHasher.py and IssueIdentifier.py files.

CT site is here: code.google.com/p/comictagger/

Algorithm description here: www.memonic.com/user/aengus/folder/coding/id/1qVeq
The topic has been locked.

Re: Comic Vine Scraper 1.0.53 4 years 10 months ago #29398

  • forkicks
  • forkicks's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 871
  • Thank you received: 109
  • Karma: 37
I also found this very interesting answer in stackoverflow:
image comparison algorithm
Check out Peter Hansen's sample.

fK
The topic has been locked.

Re: Comic Vine Scraper 1.0.53 4 years 10 months ago #29404

  • cYo
  • cYo's Avatar
  • Offline
  • Moderator
  • Posts: 3476
  • Thank you received: 676
  • Karma: 182
These seem to be quite robust image comparison algorithms and should not be that hard to implement.

If used, I think the best way would be a two pass scanning process. First pass tags all the comics that are identified as being correct by the cover comparison.
A second pass could then have user interaction.
The topic has been locked.

Re: Comic Vine Scraper 1.0.53 4 years 10 months ago #29405

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1328
  • Thank you received: 508
  • Karma: 182
Ah yes, those algorithms do look pretty straightforward. If they work as well as we're hoping for matching comic book covers, this feature may be something I can do. I will look into it as time permits over the coming weeks...

EDIT: Oh yeah, and thanks for the links + source code, ComicTagger and fK. :)
Last Edit: 4 years 10 months ago by cbanack.
The topic has been locked.
Time to create page: 0.222 seconds

Who's Online

We have 240 guests and 2 members online