Welcome, Guest
News and Announcements
  • Page:
  • 1
  • 2

TOPIC: Comic Vine Scraper 1.0.26/27

Comic Vine Scraper 1.0.26/27 7 years 2 months ago #9148

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181


Comic Vine Scraper 1.0.27 is now available. This version is identical to version 1.0.26, except that it also includes a fix for issue 123.


Comic Vine Scraper 1.0.26 is now available.

This small release addresses issues 102, 115, and most importantly, issue 116.

Judging by the number of bug reports I've received, a lot of people have encountered issue 116 over the last few weeks. It's a pretty severe bug--the scraper will sometimes freeze when scraping a large series (depending on how busy the ComicVine servers are at the time.) Since this bug was affecting so many people, I felt it was important to try to make a fix available as quickly as possible.

That's the main purpose of this release.

(The root cause of the bug is actually a change on ComicVine's servers, but the ComicVine team is very slow to acknowledge and fix stuff like this, so I had to rewrite part of the scraper to work around it instead. Don't be alarmed if you notice that your "issues" get reloaded the first time you run 1.0.26--it's just because the scraper now retrieves issues in a new way.)


Version 1.0.26 may be a small release, but I did manage to add one interesting new feature. The scraper now populates the new "Community Rating" field that was added in the most recent release of ComicRack.

As always, if you find any bugs please report them in the issue tracker (you can log into it with your google/gmail account). If you prefer, you can also post a description of your problem (or any other feedback) in this forum thread.

Cheers!
Last Edit: 7 years 1 month ago by cbanack. Reason: Added icon
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.26 7 years 2 months ago #9149

  • 600WPMPO
  • 600WPMPO's Avatar
  • Offline
  • Moderator
  • Posts: 3788
  • Thank you received: 557
  • Karma: 232
cbanack wrote:
The scraper now populates the new "Community Rating" field that was added in the most recent release of ComicRack
Can't wait to test the ratings scrape..!!
Thanks cbanack for the release.. :)

Edit: Not liking the comicvine ratings: almost every comic there is rated from 4.8 to 5 :S
Now Playing: The ComicRack Manual (Online)

See my new comics & gadgets on: Tumblr!
Last Edit: 7 years 2 months ago by 600WPMPO.
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.26 7 years 2 months ago #9157

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181
600WPMPO wrote:
Edit: Not liking the comicvine ratings: almost every comic there is rated from 4.8 to 5 :S
Maybe you just have excellent taste in comics, and all the ones in your collection are rated really high? ;)
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.26 7 years 2 months ago #9168

  • 600WPMPO
  • 600WPMPO's Avatar
  • Offline
  • Moderator
  • Posts: 3788
  • Thank you received: 557
  • Karma: 232
cbanack wrote:
600WPMPO wrote:
Edit: Not liking the comicvine ratings: almost every comic there is rated from 4.8 to 5
Maybe you just have excellent taste in comics, and all the ones in your collection are rated really high?
Yes.. it was the latter one..

I scraped the ratings for the most disliked Spider-man "One more day" and they gave it something near a 2. (Just for the record, I didn't dislike One more day that much)

But then again, a miserable one like "fall of the hulks gamma" is a 4.2 on comicvine ? :angry:
Now Playing: The ComicRack Manual (Online)

See my new comics & gadgets on: Tumblr!
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.26 7 years 2 months ago #9169

  • kenjio
  • kenjio's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 597
  • Thank you received: 127
  • Karma: 32
Nice feature, should (hopefully) help me choose which stories to read next (in-between my die hard collections, of course)

As always, excellent work on the script!!
I'm baaaaaaaaaaaaaaack!!
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.26/27 7 years 2 months ago #9228

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181
Hey guys, there was a bug in 1.0.26. It happens quite rarely, but when it does happen, it's pretty annoying. I created version 1.0.27, which includes a fix for this bug.
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.26/27 7 years 2 months ago #9230

  • 600WPMPO
  • 600WPMPO's Avatar
  • Offline
  • Moderator
  • Posts: 3788
  • Thank you received: 557
  • Karma: 232
Thanks cbanack for the new version..!
Now Playing: The ComicRack Manual (Online)

See my new comics & gadgets on: Tumblr!
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.26/27 7 years 1 month ago #9616

  • 600WPMPO
  • 600WPMPO's Avatar
  • Offline
  • Moderator
  • Posts: 3788
  • Thank you received: 557
  • Karma: 232
Here is a formal request for cbanack to please try and make the next version of CVS download thumbnails for fileless entries in ComicRack..

I'll be highly grateful if this ability is added to CVS (if possible, that is..) :)
Now Playing: The ComicRack Manual (Online)

See my new comics & gadgets on: Tumblr!
Last Edit: 7 years 1 month ago by 600WPMPO.
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.26/27 7 years 1 month ago #9618

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181
600WPMPO wrote:
Here is a formal request for cbanack to please try and make the next version of CVS download thumbnails for fileless entries in ComicRack..

I'll be highly grateful if this ability is added to CVS (if possible, that is..) :)
Well it certainly looks like it's possible, and it seems like a great idea for a feature, too.

code.google.com/p/comic-vine-scraper/issues/detail?id=127

I'll investigate more this week, and if it doesn't seem like it will delay things too much, I'll try do something for this in the upcoming 1.0.28 release. But if it's gonna delay that release by too long, it may have to wait for 1.0.29. ;)
The administrator has disabled public write access.

Re:Comic Vine Scraper 1.0.26/27 7 years 1 month ago #9629

  • cYo
  • cYo's Avatar
  • Offline
  • Moderator
  • Posts: 3476
  • Thank you received: 675
  • Karma: 181
It should be rather easy. You're already downloading cover images.
You simply have to call the SetCustomThumbnail method with your Bitmap object. No need for any file handling. ComicRack takes care of all the rest (storing in a secure location, generating properly sized thumbnails, etc.)
The administrator has disabled public write access.
  • Page:
  • 1
  • 2
Time to create page: 0.224 seconds

Who's Online

We have 159 guests and 6 members online