Welcome, Guest
Python Scripts for ComicRack

TOPIC: Comicvine Scraper: No longer scraping properly

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38032

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181
pomaybo wrote:
Also the URL trick seems to not work for me unless I'm doing something wrong.

You need to enter the entire URL for the series into the search field, like so:

http://www.comicvine.com/detective-comics/4050-18058/

Notice how the number at the end starts with "4050"? That's the important part. If it doesn't start with "4050", then you're not using the URL for the series. You've probably got the URL for a specific issue, which will not work.

IMHO, this technique is too much work if you've got a lot of comics to scrape. It's probably a lot easier to just wait until ComicVine sorts their database issues out, and then the scraper should go back to working normally. :dry:
Last Edit: 3 years 8 months ago by cbanack.
The administrator has disabled public write access.
The following user(s) said Thank You: pomaybo

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38035

  • pomaybo
  • pomaybo's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 3
  • Karma: 0
Thanks so much. Light week so its nbd. Thanks again for the script its a life saver.
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38039

  • mcpierce
  • mcpierce's Avatar
  • Offline
  • Senior Boarder
  • Posts: 46
  • Thank you received: 2
  • Karma: 1
Hrm, I just tried this for "The Other Dead" #1:

www.comicvine.com/the-other-dead-1/4000-426904/

I'm in Info for the comic, went to "Comic Vine Scraper" and pasted the above URL into the "Search the comic database for" field. Is this not the place to paste the URL?
Check out The Comic Book Update podcast!
www.comicbookupdate.com/
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38040

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1318
  • Thank you received: 503
  • Karma: 181
Notice how the number at the end starts with "4050"? That's the important part. If it doesn't start with "4050", then you're not using the URL for the series. You've probably got the URL for a specific issue, which will not work.

You're just pasting the wrong URL. Paste the url for the series and it should work.

www.comicvine.com/the-other-dead/4050-67703/
The administrator has disabled public write access.
The following user(s) said Thank You: mcpierce

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38043

  • mcpierce
  • mcpierce's Avatar
  • Offline
  • Senior Boarder
  • Posts: 46
  • Thank you received: 2
  • Karma: 1
How about for scraping annuals? Earth 2 and Worlds' Finest aren't being found properly.
Check out The Comic Book Update podcast!
www.comicbookupdate.com/
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38044

  • mcpierce
  • mcpierce's Avatar
  • Offline
  • Senior Boarder
  • Posts: 46
  • Thank you received: 2
  • Karma: 1
Nevermind, I found that you have to search comicvine for "[title] annual" to get the right URL.
Check out The Comic Book Update podcast!
www.comicbookupdate.com/
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38047

  • squeedps
  • squeedps's Avatar
  • Offline
  • Expert Boarder
  • Posts: 103
  • Thank you received: 4
  • Karma: 0
I've got three from Marvel that I couldn't get scraped. But here are the URLs for anyone who is searching for them yourself. I did the work for you. B)

Inhumanity
www.comicvine.com/inhumanity/4050-69688/

Miracleman
www.comicvine.com/miracleman/4050-70918/

Revolutionary War - Knights of Pendragon
www.comicvine.com/revolutionary-war-knig...endragon/4050-71322/
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38048

  • Couverdude
  • Couverdude's Avatar
  • Offline
  • Junior Boarder
  • Posts: 22
  • Karma: 0
Ironically, before Comicvine's "fix", the plug-in would not find X (Dark horse) [www.comicvine.com/x/4050-57406/], and now it does... but it's choking on a bunch of new 52 titles.

The URL trick works like a charm though, so thank you. :)
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38049

  • James Spaceman
  • James Spaceman's Avatar
  • Offline
  • Gold Boarder
  • Posts: 197
  • Thank you received: 6
  • Karma: 5
Thanks Cory for all of your help with this. For a while I thought it was something on my end. ;)
The administrator has disabled public write access.

Comicvine Scraper: No longer scraping properly 3 years 8 months ago #38074

  • mcpierce
  • mcpierce's Avatar
  • Offline
  • Senior Boarder
  • Posts: 46
  • Thank you received: 2
  • Karma: 1
Still no joy from Comic Vine?
Check out The Comic Book Update podcast!
www.comicbookupdate.com/
The administrator has disabled public write access.
Time to create page: 0.204 seconds

Who's Online

We have 244 guests and 4 members online