Welcome, Guest
News and Announcements

TOPIC: Comic Vine Scraper

Re: Comic Vine Scraper 1.0.65 4 years 5 months ago #33821

  • wojosama
  • wojosama's Avatar
  • Offline
  • Gold Boarder
  • Posts: 180
  • Thank you received: 45
  • Karma: 11
Just scraped around 300 comics and aside from 5 or so comics that had completely butchered file names, I didn't have to do a single thing! I just hit scrape and it went to work, found everything flawlessly.

Also, like others have said, I didn't see any kind of noticeable increase in the amount of time it took which I find completely mind boggling :silly: .
Absolutely amazing job man.


EDIT: Forgot to mention, the one exception was that I did have that weird issue with talon #8 that others had.
Last Edit: 4 years 5 months ago by wojosama.
The administrator has disabled public write access.

Re: Comic Vine Scraper 1.0.65 4 years 5 months ago #33822

  • 600WPMPO
  • 600WPMPO's Avatar
  • Offline
  • Moderator
  • Posts: 3788
  • Thank you received: 557
  • Karma: 232
Yes, working great here too! :cheer:

But, we had 2 issues from Marvel with the AU numbering, and it missed both.
Now Playing: The ComicRack Manual (Online)

See my new comics & gadgets on: Tumblr!
Last Edit: 4 years 5 months ago by 600WPMPO.
The administrator has disabled public write access.

Re: Comic Vine Scraper 1.0.66 4 years 5 months ago #33831

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1327
  • Thank you received: 508
  • Karma: 182
Thanks for the feedback, guys!
600WPMPO wrote:
Yes, working great here too! :cheer:

But, we had 2 issues from Marvel with the AU numbering, and it missed both.
Hmm what were the filenames for those two ? The image matching doesn't work at all if the scraper can't guess the right series based on the comic's filename.
Last Edit: 4 years 5 months ago by cbanack.
The administrator has disabled public write access.

Re: Comic Vine Scraper 1.0.66 4 years 5 months ago #33833

  • krandor
  • krandor's Avatar
  • Offline
  • Gold Boarder
  • Posts: 204
  • Thank you received: 21
  • Karma: 4
cbanack wrote:
Thanks for the feedback, guys!
600WPMPO wrote:
Yes, working great here too! :cheer:

But, we had 2 issues from Marvel with the AU numbering, and it missed both.
Hmm what were the filenames for those two ? The image matching doesn't work at all if the scraper can't guess the right series based on the comic's filename.

The issue I think is recognizing that "15AU" is the issue number. Even without the automatic, the scraper doesn't recognize 15AU as an issue number and it has to be manually selected. So I think it is detecting the series, but not the issue number.
The administrator has disabled public write access.

Re: Comic Vine Scraper 1.0.66 4 years 5 months ago #33834

  • 600WPMPO
  • 600WPMPO's Avatar
  • Offline
  • Moderator
  • Posts: 3788
  • Thank you received: 557
  • Karma: 232
krandor wrote:
cbanack wrote:
Thanks for the feedback, guys!
600WPMPO wrote:
Yes, working great here too! :cheer:

But, we had 2 issues from Marvel with the AU numbering, and it missed both.
Hmm what were the filenames for those two ? The image matching doesn't work at all if the scraper can't guess the right series based on the comic's filename.

The issue I think is recognizing that "15AU" is the issue number. Even without the automatic, the scraper doesn't recognize 15AU as an issue number and it has to be manually selected. So I think it is detecting the series, but not the issue number.
No. While it did not automatically recognise 'Uncanny Avengers 8AU', when it presented the choose series box, I just had to click ok (I didn't have to choose the 8AU issue).
Now Playing: The ComicRack Manual (Online)

See my new comics & gadgets on: Tumblr!
The administrator has disabled public write access.

Re: Comic Vine Scraper 1.0.66 4 years 5 months ago #33835

  • Ludwig
  • Ludwig's Avatar
  • Offline
  • Gold Boarder
  • Posts: 197
  • Thank you received: 12
  • Karma: 9
Hi Cbanack

Just tryed the new version

And i got a mismatch with several 'Avengers' files I got yesterday.

Let me explain, fe
file avengers 002 (2010) (digital) (zone-empire).cbz
file avengers 002 (2013) (digital) (zone-empire).cbz

After scraping the scraper gives me both the 2010 -info.
I noticed because I have a smartlist for duplicates after CVS.

Scraper was set to 'try to choose the correct series automatically'.
The two files are neighbours in the directory.

I did a uninstall of the script .
Reinstalled.
Took a copy of the two files placed them in another folder.
Renamed them (instead of 002, 004). Checked that no xml file was embedded.
Did a scrape.
Same result.

It should make a difference based on year and image ?
The administrator has disabled public write access.

Re: Comic Vine Scraper 1.0.65 4 years 5 months ago #33837

  • T3KN0Gh057
  • T3KN0Gh057's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 407
  • Thank you received: 114
  • Karma: 27
i think this AU numbering is retarded, this is one of the reasons i avoid marvel books, because they do stupid shit!
The administrator has disabled public write access.

Re: Comic Vine Scraper 1.0.66 4 years 5 months ago #33838

  • wojosama
  • wojosama's Avatar
  • Offline
  • Gold Boarder
  • Posts: 180
  • Thank you received: 45
  • Karma: 11
Ludwig wrote:
Hi Cbanack

Just tryed the new version

And i got a mismatch with several 'Avengers' files I got yesterday.

Let me explain, fe
file avengers 002 (2010) (digital) (zone-empire).cbz
file avengers 002 (2013) (digital) (zone-empire).cbz

After scraping the scraper gives me both the 2010 -info.
I noticed because I have a smartlist for duplicates after CVS.

Scraper was set to 'try to choose the correct series automatically'.
The two files are neighbours in the directory.

I did a uninstall of the script .
Reinstalled.
Took a copy of the two files placed them in another folder.
Renamed them (instead of 002, 004). Checked that no xml file was embedded.
Did a scrape.
Same result.

It should make a difference based on year and image ?

I believe the scrapping is assuming same volume since they are in the same folder (also probably relevant is one of the issues in the 2010 volume has a cover date on CV of January 2013).
Last Edit: 4 years 5 months ago by wojosama.
The administrator has disabled public write access.
The following user(s) said Thank You: Ludwig

Re: Comic Vine Scraper 1.0.66 4 years 5 months ago #33863

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1327
  • Thank you received: 508
  • Karma: 182
wojosama wrote:
I believe the scrapping is assuming same volume since they are in the same folder (also probably relevant is one of the issues in the 2010 volume has a cover date on CV of January 2013).
Yes, this is exactly what's happening...the scraper can't consider years in the filename as a way of recognizing different series, because lots of times the "year" could mean different things (year the comic was published, year the series was started, year the scan was made, etc.) So the scraper is seeing those two avengers comics as belonging to the same series, even though they don't. Plus, the scraper always ignores anything in brackets anyway.

One solution is simply to store those two series in separate directories. The scraper will not assume that comics in different directories are part of the same series.

The other solution is to scrape all of the comics from the 2010 series first, and then scrape the 2013 comics.
Last Edit: 4 years 5 months ago by cbanack.
The administrator has disabled public write access.
The following user(s) said Thank You: Ludwig

Re: Comic Vine Scraper 1.0.66 4 years 5 months ago #33864

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1327
  • Thank you received: 508
  • Karma: 182
600WPMPO wrote:
No. While it did not automatically recognise 'Uncanny Avengers 8AU', when it presented the choose series box, I just had to click ok (I didn't have to choose the 8AU issue).
I just gave this a try with a couple of AU comics, and it seemed to work alright for me. Could you tell me the filenames of one or two of the comics that didn't work? Maybe there's something there I can fix.
The administrator has disabled public write access.
Time to create page: 0.230 seconds

Who's Online

We have 198 guests and 2 members online