Welcome, Guest
News and Announcements

TOPIC: Comic Vine Scraper

Comic Vine Scraper 10 months 1 week ago #49166

  • Crave
  • Crave's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 5
  • Karma: 0
Any chance one of you knows how to make it scrape user ratings again? It hasn't worked in over a year.
The administrator has disabled public write access.

Comic Vine Scraper 10 months 1 week ago #49167

  • EricS1980
  • EricS1980's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 10
  • Thank you received: 4
  • Karma: 0
Regarding comics that contain the word "Doctor", I've noticed some volumes are listed on ComicVine with the word Doctor while others are listed with the abbreviation Dr. (such as "Doctor Strange" or "Dr. Strange"). I was just curious if there was any way to get the scraper to search for both variations when it comes across either?

Thanks
The administrator has disabled public write access.

Comic Vine Scraper 10 months 1 week ago #49168

  • EricS1980
  • EricS1980's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 10
  • Thank you received: 4
  • Karma: 0
Replying to Crave's question:
Any chance one of you knows how to make it scrape user ratings again? It hasn't worked in over a year.

I was just looking over cbanak's code and came across the comments below. Looks like this was removed due to an issue with ComicVine's acceptable use policy.
   #    the commented code below once scraped additional cover images and 
   #    the community rating from Comic Vine directly. it did this by reading 
   #    in the contents of an html page on the Comic Vine website, rather
   #    than using part of the Comic Vine API.   This is against Comic 
   #    Vine's acceptable use policy (see issue 421, 
   #        https://github.com/cbanack/comic-vine-scraper/issues/421 )
   #
   #    I have removed this code to address this issue, but if Comic Vine
   #    ever gives us the option to access additional cover art or community
   #    ratings directly, the code below could be rewritten to get those details
   #    again, and then the features that rely on it will start using that data
   #    and working as they used to (the features affected are:  scraping
   #    community rating, auto-identification of comic series, and searching
   #    for additional covers for a particular issue.) 
Last Edit: 10 months 1 week ago by EricS1980. Reason: Replying to Crave
The administrator has disabled public write access.

Comic Vine Scraper 10 months 1 week ago #49169

  • Crave
  • Crave's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 5
  • Karma: 0
EricS1980 wrote:
Replying to Crave's question:
Any chance one of you knows how to make it scrape user ratings again? It hasn't worked in over a year.

I was just looking over cbanak's code and came across the comments below. Looks like this was removed due to an issue with ComicVine's acceptable use policy.

Thanks for that. I remember when the additional covers were removed, I didn't realize ratings were taken away in connection with that.
Last Edit: 10 months 1 week ago by Crave.
The administrator has disabled public write access.

Comic Vine Scraper 10 months 5 days ago #49172

  • kino13
  • kino13's Avatar
  • Offline
  • Senior Boarder
  • Posts: 58
  • Thank you received: 6
  • Karma: 0
pweasel wrote:
how was it to force fed to the scrapper the URL of an issue on comicvine?

Look for the comic in comic vine, and paste the ID at the end of the url into the search term of the scrapper.

For example, for VS from Image:
comicvine.gamespot.com/v-s/4050-108546/

Paste the 4050-108546 in the search.

Regards

Edit: tried for other comic and didn't work like that :blink:
with no power comes no responsibility. except that wasn't true
Last Edit: 10 months 5 days ago by kino13.
The administrator has disabled public write access.
The following user(s) said Thank You: pweasel

Comic Vine Scraper 10 months 5 days ago #49175

  • pweasel
  • pweasel's Avatar
  • Offline
  • Expert Boarder
  • Posts: 127
  • Thank you received: 18
  • Karma: 8
LOL!!! that's exactly the issue i'm having issues with :P
CRW 0.9.178 x64 on Win10
CRA 1.80 on Nexus 10
The administrator has disabled public write access.

Comic Vine Scraper 10 months 5 days ago #49177

  • Kiljoy McCoy
  • Kiljoy McCoy's Avatar
  • Offline
  • Expert Boarder
  • Posts: 80
  • Thank you received: 1
  • Karma: 0
yep the only issue I have had trouble scrapping in last week is titles with vs. in it. VS for sure and the tpb for bionic man vs bionic woman I had to remove vs to find it.
The administrator has disabled public write access.

Comic Vine Scraper 10 months 5 days ago #49181

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1368
  • Thank you received: 556
  • Karma: 187
Kiljoy McCoy wrote:
yep the only issue I have had trouble scrapping in last week is titles with vs. in it. VS for sure and the tpb for bionic man vs bionic woman I had to remove vs to find it.

Hmmm, there's a chance that might be a problem with the scraper, not the Comic Vine search API. I'll look into it when I have a chance.
Last Edit: 10 months 5 days ago by cbanack.
The administrator has disabled public write access.

Comic Vine Scraper 10 months 5 days ago #49182

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1368
  • Thank you received: 556
  • Karma: 187
kino13 wrote:
Look for the comic in comic vine, and paste the ID at the end of the url into the search term of the scrapper.

For example, for VS from Image:
comicvine.gamespot.com/v-s/4050-108546/

Paste the 4050-108546 in the search.

Regards

Edit: tried for other comic and didn't work like that :blink:

Are you saying that pasting the series id (like you just described) sometimes doesn't work?
The administrator has disabled public write access.

Comic Vine Scraper 10 months 5 days ago #49183

  • kino13
  • kino13's Avatar
  • Offline
  • Senior Boarder
  • Posts: 58
  • Thank you received: 6
  • Karma: 0
cbanack wrote:

Are you saying that pasting the series id (like you just described) sometimes doesn't work?

Yes, it did not work afterwards for a couple comics more. No idea.
with no power comes no responsibility. except that wasn't true
The administrator has disabled public write access.
Time to create page: 0.815 seconds

Who's Online

We have 167 guests and no members online