Welcome, Guest
News and Announcements
  • Page:
  • 1
  • 2

TOPIC: Comic Vine Scraper 1.0.21

Comic Vine Scraper 1.0.21 7 years 6 months ago #6821

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181
Comic Vine Scraper 1.0.21 is now available.

It's got some bug fixes and couple of minor new features. Specifically, this release addresses issues 58, 65, 69, 74, 77, and 79.

Of particular interest:

- the "Search" input dialog now has a "Skip" button.
- the "series" list is sorted better; the series you want is usually at the top now.
- the scraper now automatically skips over comics that have a 'CVDBSKIP' tag instead of the regular CVDB tag.

That last feature is aimed at advanced users who know how to find and replace the CVDB tags in their comic books. It should come in handy if you have comics in your collection that you know you'll never want to scrape.

As usual, if you find any bugs in this new release please report them on the issue tracker (just use your google/gmail login!) or you can post them in this forum thread.

My sincere thanks to those users who have been submitting bugs and suggestions for Comic Vine Scraper. You guys are helping out with this project in a big way. :)

Enjoy!
Last Edit: 7 years 1 month ago by cbanack.
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.21 7 years 6 months ago #6829

  • forkicks
  • forkicks's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 869
  • Thank you received: 108
  • Karma: 37
Running steady for a while now with the new one, already fed around 2k issues through it, not a problem so far. The new sorting order REALLY helps :-).

Thanks,
fK
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.21 7 years 6 months ago #6832

  • RevQuixo
  • RevQuixo's Avatar
  • Offline
  • Gold Boarder
  • Posts: 279
  • Thank you received: 25
  • Karma: 12
So far so good. Enjoying the improvements, glad to help with the bugs & suggestions. ;)
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.21 7 years 6 months ago #6833

  • perezmu
  • perezmu's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1114
  • Thank you received: 64
  • Karma: 51
cbanack wrote:
Of particular interest:

- the "Search" input dialog now has a "Skip" button.
- the "series" list is sorted better; the series you want is usually at the top now.
- the scraper now automatically skips over comics that have a 'CVDBSKIP' tag instead of the regular CVDB tag.

As usual, you deliver much more than expected and asked for! Thanks once more!
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.21 7 years 6 months ago #6834

  • perezmu
  • perezmu's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1114
  • Thank you received: 64
  • Karma: 51
BTW, the "smart ordering" of series works like a charm!
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.21 7 years 6 months ago #6835

  • perezmu
  • perezmu's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1114
  • Thank you received: 64
  • Karma: 51
but... I think I found a bug...

When scraping XXXXXXXX 003 (or 067) the issue number is not correctly detected as 3 or 67 and the list of all issues is presented for election.
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.21 7 years 6 months ago #6836

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181
perezmu wrote:
but... I think I found a bug...

When scraping XXXXXXXX 003 (or 067) the issue number is not correctly detected as 3 or 67 and the list of all issues is presented for election.

So this seems to be being caused by the leading zeros in the issue number (i.e. "003" or "067", rather than "3" and "67")? If so that'll be an easy one to fix (I might have introduced that problem while trying to make sure the scraper would correctly handle weird issue numbers like 1A and 1B.)
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.21 7 years 6 months ago #6838

Great work cbanack, all your efforts are greatly appreciated!
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.21 7 years 6 months ago #6843

  • kisa360
  • kisa360's Avatar
  • Offline
  • Junior Boarder
  • Posts: 31
  • Karma: 1
Great work! I can't break it or find anything to complain about.
The administrator has disabled public write access.

i hope this is where i'm supposed to put this 7 years 5 months ago #7270

  • Dr.RoXo
  • Dr.RoXo's Avatar
  • Offline
  • Senior Boarder
  • Posts: 53
  • Karma: 0
got this error tonight it said i should report it, so:



Comic Vine Scraper, v1.0.21
Cache Directory: C:\Users\brent\AppData\Roaming\cYo\ComicRack\ Scripts\Comic Vine Scraper\localCache/
Settings File: C:\Users\brent\AppData\Roaming\cYo\ComicRack\ Scripts\Comic Vine Scraper\settings.dat


loaded settings from file: C:\Users\brent\AppData\Roaming\cYo\ComicRack\ Scripts\Comic Vine Scraper\settings.dat

[X] Series [X] Number [X] Month
[X] Title [X] Alt Series [X] Writer
[X] Penciller [X] Inker [X] Cover Art
[X] Colorist [X] Letterer [X] Editor
[X] Summary [X] Notes [X] Tags
[X] Imprint [X] Year [X] Publisher
[X] Volume [X] Characters

[X] Overwrite Existing [ ] Ignore Blanks
[X] Convert Imprints [X] Specify Series
[X] Cover Thumbs


=======> scraping next eComic book: 'Hulk Smash #1'
no CVDB tag found in book, beginning search...
asking user for series search term...
...the user provided: 'Hulk Smash'
querying comicvine for all series that match: 'hulk smash'
comicvine provided 1 results for the search
displaying the series selection form...
... chose series 6654 ('Hulk Smash')
searching for issue in series: 6654 ('Hulk Smash')
querying comicvine for all available issues...
...got 2 issue IDs from the comicvine database, 0 from the local cache
trying to find issue ID for issue number: 1
...chose issue ID 47560 for this book
querying comicvine for issue details...
setting values for this comic book ('*' = changed):
--> Series : Hulk Smash
--> Issue Number : 1
--> *Title : Part One
--> Alt/Arc :
--> *Summary : The demented duo of Garth Ennis (PUNISHER) and John McCrea (Hitman) un ...
--> *Year : 2001
--> *Month : 3
--> *Volume : 2001
--> *Publisher : Marvel Comics
--> Imprint :
--> *Characters : Hulk, Lt. Patrick D. Mitchell, Mj. Lucas Parker
--> *Writers : Garth Ennis
--> *Pencillers : Kevin Nowlan, John McCrea, John McCrea
--> *Inkers : Kevin Nowlan, Klaus Janson, John McCrea
--> *Colorists : Kevin Nowlan, Chris SOTO Sotomayor
--> *Letterers : Comicraft, Wes Abbott, Richard Starkings
--> *CoverArtists : Kevin Nowlan
--> *Editors : Stuart Moore, Nanci Dakesian, Joe Quesada
--> *Tags : CVDB47560
--> *Notes : Scraped metadata from ComicVine [CVDB47560] on 2010.04.21 00:00:02.


=======> scraping next eComic book: 'Hulk Smash #2'
no CVDB tag found in book, beginning search...
searching for issue in series: 6654 ('Hulk Smash')
trying to find issue ID for issue number: 2
...chose issue ID 47561 for this book
querying comicvine for issue details...
setting values for this comic book ('*' = changed):
--> Series : Hulk Smash
--> Issue Number : 2
--> *Title : Part Two
--> Alt/Arc :
--> *Summary : Garth Ennis unleashes the Hulk! What hope do mere mortal men have agai ...
--> *Year : 2001
--> *Month : 4
--> *Volume : 2001
--> *Publisher : Marvel Comics
--> Imprint :
--> *Characters : Hulk, Lt. Patrick D. Mitchell, Mj. Lucas Parker
--> *Writers : Garth Ennis
--> *Pencillers : Kevin Nowlan, John McCrea, John McCrea
--> *Inkers : Kevin Nowlan, Klaus Janson, John McCrea
--> *Colorists : Chris SOTO Sotomayor, Kevin Nowlan
--> *Letterers : Richard Starkings, Comicraft, Wes Abbott
--> *CoverArtists : Kevin Nowlan
--> *Editors : Stuart Moore, Nanci Dakesian, Joe Quesada
--> *Tags : CVDB47561
--> *Notes : Scraped metadata from ComicVine [CVDB47561] on 2010.04.21 00:00:02.


=======> scraping next eComic book: 'Marvel Age - Hulk #1'
no CVDB tag found in book, beginning search...
asking user for series search term...
...the user provided: 'Marvel Age - Hulk'
querying comicvine for all series that match: 'marvel age hulk'
no comicvine results found for this search. try again...
no CVDB tag found in book, beginning search...
asking user for series search term...
...the user provided: 'Hulk'
querying comicvine for all series that match: 'hulk'
comicvine provided 136 results for the search
displaying the series selection form...
...chose to SKIP this book


=======> scraping next eComic book: 'Marvel Age - Hulk #2'
no CVDB tag found in book, beginning search...
asking user for series search term...
...the user provided: 'Marvel Age - Hulk'
querying comicvine for all series that match: 'marvel age hulk'
no comicvine results found for this search. try again...
no CVDB tag found in book, beginning search...
asking user for series search term...
...and the user clicked 'skip'


=======> scraping next eComic book: 'Marvel Age - Hulk #3'
no CVDB tag found in book, beginning search...
asking user for series search term...
...and the user clicked 'skip'


=======> scraping next eComic book: 'Marvel Age - Hulk #4'
no CVDB tag found in book, beginning search...
asking user for series search term...
...and the user clicked 'skip'


=======> scraping next eComic book: 'Startling Stories - Banner #1'
no CVDB tag found in book, beginning search...
asking user for series search term...
...the user provided: 'Startling Stories - Banner'
querying comicvine for all series that match: 'startling stories banner'
comicvine provided 1 results for the search
displaying the series selection form...
... chose series 9471 ('Startling Stories: Banner')
searching for issue in series: 9471 ('Startling Stories: Banner')
querying comicvine for all available issues...
...got 4 issue IDs from the comicvine database, 0 from the local cache
trying to find issue ID for issue number: 1
...chose issue ID 77965 for this book
querying comicvine for issue details...
setting values for this comic book ('*' = changed):
--> *Series : Startling Stories: Banner
--> Issue Number : 1
--> *Title : [untitled]
--> Alt/Arc :
--> Summary :
--> *Year : 2001
--> *Month : 7
--> *Volume : 2001
--> *Publisher : Marvel Comics
--> Imprint :
--> *Characters : Hulk, Doc Samson
--> Writers :
--> Pencillers :
--> Inkers :
--> *Colorists : Studio F
--> Letterers :
--> CoverArtists :
--> Editors :
--> *Tags : CVDB77965
--> *Notes : Scraped metadata from ComicVine [CVDB77965] on 2010.04.21 00:01:32.


=======> scraping next eComic book: 'Startling Stories - Banner #2'
no CVDB tag found in book, beginning search...
searching for issue in series: 9471 ('Startling Stories: Banner')
trying to find issue ID for issue number: 2
...chose issue ID 77966 for this book
querying comicvine for issue details...
setting values for this comic book ('*' = changed):
--> *Series : Startling Stories: Banner
--> Issue Number : 2
--> *Title : [untitled]
--> Alt/Arc :
--> Summary :
--> *Year : 2001
--> *Month : 8
--> *Volume : 2001
--> *Publisher : Marvel Comics
--> Imprint :
--> *Characters : Hulk, Doc Samson
--> Writers :
--> Pencillers :
--> Inkers :
--> *Colorists : Studio F
--> Letterers :
--> CoverArtists :
--> Editors :
--> *Tags : CVDB77966
--> *Notes : Scraped metadata from ComicVine [CVDB77966] on 2010.04.21 00:01:33.


=======> scraping next eComic book: 'Startling Stories - Banner #3'
no CVDB tag found in book, beginning search...
searching for issue in series: 9471 ('Startling Stories: Banner')
trying to find issue ID for issue number: 3
...chose issue ID 77967 for this book
querying comicvine for issue details...
setting values for this comic book ('*' = changed):
--> *Series : Startling Stories: Banner
--> Issue Number : 3
--> *Title : [untitled]
--> Alt/Arc :
--> Summary :
--> *Year : 2001
--> *Month : 9
--> *Volume : 2001
--> *Publisher : Marvel Comics
--> Imprint :
--> *Characters : Hulk, Doc Samson, General Thunderbolt Ross
--> Writers :
--> Pencillers :
--> Inkers :
--> *Colorists : Studio F
--> Letterers :
--> CoverArtists :
--> Editors :
--> *Tags : CVDB77967
--> *Notes : Scraped metadata from ComicVine [CVDB77967] on 2010.04.21 00:01:33.


=======> scraping next eComic book: 'Startling Stories - Banner #4'
no CVDB tag found in book, beginning search...
searching for issue in series: 9471 ('Startling Stories: Banner')
trying to find issue ID for issue number: 4
...chose issue ID 77968 for this book
querying comicvine for issue details...
setting values for this comic book ('*' = changed):
--> *Series : Startling Stories: Banner
--> Issue Number : 4
--> *Title : [untitled]
--> Alt/Arc :
--> Summary :
--> *Year : 2001
--> *Month : 10
--> *Volume : 2001
--> *Publisher : Marvel Comics
--> Imprint :
--> *Characters : Hulk, Doctor Ford, Doc Samson, General Thunderbolt Ross
--> Writers :
--> Pencillers :
--> Inkers :
--> *Colorists : Studio F
--> Letterers :
--> CoverArtists :
--> Editors :
--> *Tags : CVDB77968
--> *Notes : Scraped metadata from ComicVine [CVDB77968] on 2010.04.21 00:01:34.


=======> scraping next eComic book: 'The Incredible Hulk - Gamma Games #1'
no CVDB tag found in book, beginning search...
asking user for series search term...
...the user provided: 'The Incredible Hulk - Gamma Games'
querying comicvine for all series that match: 'incredible hulk gamma games'
no comicvine results found for this search. try again...
no CVDB tag found in book, beginning search...
asking user for series search term...
...the user provided: 'Hulk - Gamma Games'
querying comicvine for all series that match: 'hulk gamma games'
comicvine provided 1 results for the search
displaying the series selection form...
... chose series 32547 ('Hulk: Gamma Games')
searching for issue in series: 32547 ('Hulk: Gamma Games')
querying comicvine for all available issues...
...got 0 issue IDs from the comicvine database, 0 from the local cache
trying to find issue ID for issue number: 1
displaying the issue selection form...
PYTHON ERROR
Caught ValueError: Specified argument was out of the range of valid values.

Parameter name: rowIndex
Traceback (most recent call last):
File "C:\Users\brent\AppData\Roaming\cYo\ComicRack\ Scripts\Comic Vine Scraper\ComicVineScraper.py", line 89, in main
File "C:\Users\brent\AppData\Roaming\cYo\ComicRack\ Scripts\Comic Vine Scraper\ComicVineScraper.py", line 142, in _scrape
File "C:\Users\brent\AppData\Roaming\cYo\ComicRack\ Scripts\Comic Vine Scraper\ComicVineScraper.py", line 249, in _scrape_book
File "C:\Users\brent\AppData\Roaming\cYo\ComicRack\ Scripts\Comic Vine Scraper\ComicVineScraper.py", line 557, in _search_for_issue_id
File "C:\Users\brent\AppData\Roaming\cYo\ComicRack\ Scripts\Comic Vine Scraper\issueform.py", line 101, in __init__
I'd never belong to any club that would have someone like me as a member...
The administrator has disabled public write access.
  • Page:
  • 1
  • 2
Time to create page: 1.034 seconds

Who's Online

We have 222 guests and 6 members online