Welcome, Guest
Python Scripts for ComicRack

TOPIC: Comicvine Scraper: No longer scraping properly

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38015

I just started experiencing an issue when I use Comicvine scraper. Using "Adventures Of Superman" as an example, it is now returning results where any of the 3 words in the title appear. In addition, it only returned the 1987 volume of Adventures. It could not find 3 Guns or 100 Bullets: Brother Lono. I stopped scraping because each series was returning 100s of results when normally a handful would appear. The last time I scraped comics was 2 weeks ago, so this is a recent issue, most likely associated with ComicVine's API as I have been using v1.64.

I Did update to v1.70 today and tried again. The issue persisted.

Is anyone else having an issue?
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38018

  • deathcry
  • deathcry's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 13
  • Thank you received: 6
  • Karma: 1
Yea as I started scrapping just now, I noticed I was getting a lot of weird results.

Not being entirely knowledgeable of it, but i am guessing it is something with ComicVine.
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38021

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181
Thanks for letting me know about this.

ComicVine has indeed changed the way their servers respond to search queries. Unfortunately, they haven't officially announced any of these changes, so I'm really not sure if any of this is permanent or not.

But for now, I've released a new version of Comic Vine Scraper that should handle the changes properly.

More information here. Let me know if it solves the problem.
Last Edit: 3 years 8 months ago by cbanack.
The administrator has disabled public write access.
The following user(s) said Thank You: James Spaceman

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38022

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181
Oh yeah, I am not able to scrape '3 Guns' or '100 Bullets: Brother Lono' either. This is because those comics haven't been added to ComicVine (yet). If you go to the ComicVine website and try to search for them, they are nowhere to be found.
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38025

  • valefrox
  • valefrox's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 2
  • Karma: 0
Something is really wrong with the ComicVine search, because "3 Guns" and "100 Bullets: Brother Lono" are already in the database:
www.comicvine.com/3-guns/4050-65980/
www.comicvine.com/100-bullets-brother-lono/4050-63681/

If you use the ComicVine search you get nothing, but if you Google it you can still reach it. This is happening with a lot of other comics, too...

Too bad ComicVine Scraper isn't smart enough to use Google on its own. :lol:
Last Edit: 3 years 8 months ago by valefrox.
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38026

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181
You can enter those URLs directly in the search dialog and the scraper will find them.

But yeah, something is clearly wrong with ComicVine's search algorithm.
Last Edit: 3 years 8 months ago by cbanack.
The administrator has disabled public write access.
The following user(s) said Thank You: forkicks, valefrox

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38027

  • valefrox
  • valefrox's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 2
  • Karma: 0
I didn't know that, thanks for thew info!
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38029

  • forkicks
  • forkicks's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 869
  • Thank you received: 108
  • Karma: 37
I didn't knew that url trick, but it's the only way i managed to scrape many of today's 0days. Damian Son of Batman, Legends of Red Sonja, Night of the Living Deadpool, Earth 2 Annual, Forever Evil Argus, many others, didn't scrape, even tho google can find them in comicvine's site.

fK
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38030

  • pomaybo
  • pomaybo's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 3
  • Karma: 0
Just wanted to post that I updated to the stable release of Comic Vine Scraper (version 1.0.71, released January 28, 2014)and it's hit and miss. Some things like Red Lantern scrapped, others like Earth 2 annual didn't. Also the URL trick seems to not work for me unless I'm doing something wrong. Thanks for the great plugin!
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38031

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181
Hey guys.

It looks like ComicVine did a major system update sometime yesterday. There's been a lot of new issues and problems related to that.

One of the problems, which many of you have noticed, is that you cannot find certain comic books (Damian Son of Batman, Earth 2 Annual, etc) with Comic Vine Scraper. But the problem goes deeper than that. You can't even find those comics if you search for them on the ComicVine website!

So clearly this is some kind of new issue with the ComicVine databases. I've reported it to ComicVine on this forum thread. (If you've discovered more comics that can't be found on ComicVine, that's the place to report them.)

In the meantime, all we can do is be patient and give the ComicVine guys a chance to fix the issue. :pinch:
The administrator has disabled public write access.
Time to create page: 0.229 seconds

Who's Online

We have 171 guests and 6 members online