Welcome, Guest
News and Announcements

TOPIC: Comic Vine Scraper 1.0.59-64

Re: Comic Vine Scraper 1.0.59-63 6 years 5 months ago #32391

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1372
  • Thank you received: 580
  • Karma: 192
It's true that the new API opened up a lot of opportunities for improving the scraper--but you should count yourself lucky that you were "on hiatus" when the new API went live! It broke all previous versions of the scraper, and even after I fixed those problems, the API itself had a bunch of bugs that people kept finding.

Things weren't really working properly again for at least week or two... :S
Last Edit: 6 years 5 months ago by cbanack.
The topic has been locked.
The following user(s) said Thank You: FreddieP786

Re: Comic Vine Scraper 1.0.59-63 6 years 5 months ago #32392

  • FreddieP786
  • FreddieP786's Avatar
  • Offline
  • Senior Boarder
  • Posts: 42
  • Thank you received: 11
  • Karma: 3
I am gonna take the time to rescrape all my comics this weekend. With the new CVS it is gonna be super quick. Thanks for all your hard work. It has actually motivated me to start contributing to the Comic Vine community again.
The topic has been locked.

Re: Comic Vine Scraper 1.0.59-63 6 years 5 months ago #32393

  • Mammut
  • Mammut's Avatar
  • Offline
  • Gold Boarder
  • Posts: 196
  • Thank you received: 30
  • Karma: 7
"By the way, if you guys ever find that you have a bunch of comics that are all named the same way, but the scraper is not parsing that name properly (i.e. it guesses the wrong series name or issue number), feel free to let me know about it."

The filename is often 2000AD, but it's 2000 AD, so the Scraper doesn't find it at first.
The topic has been locked.

Re: Comic Vine Scraper 1.0.59-63 6 years 5 months ago #32394

  • Kirtai
  • Kirtai's Avatar
  • Offline
  • Senior Boarder
  • Posts: 77
  • Thank you received: 4
  • Karma: 1
FreddieP786 wrote:
It has actually motivated me to start contributing to the Comic Vine community again.
Same here, it got me started on adding missing comics I had to the database.

Incidentally, scanning those comics is much more work than I thought it'd be. :ohmy:
The topic has been locked.

Re: Comic Vine Scraper 1.0.59-63 6 years 5 months ago #32395

  • FreddieP786
  • FreddieP786's Avatar
  • Offline
  • Senior Boarder
  • Posts: 42
  • Thank you received: 11
  • Karma: 3
Kirtai wrote:
FreddieP786 wrote:
It has actually motivated me to start contributing to the Comic Vine community again.
Same here, it got me started on adding missing comics I had to the database.

Incidentally, scanning those comics is much more work than I thought it'd be. :ohmy:

It used to take so long before, now the speed is much better so I am gonna start getting my missing issues sorted as well.
The topic has been locked.

Re: Comic Vine Scraper 1.0.59-63 6 years 5 months ago #32397

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1372
  • Thank you received: 580
  • Karma: 192
Mammut wrote:
"By the way, if you guys ever find that you have a bunch of comics that are all named the same way, but the scraper is not parsing that name properly (i.e. it guesses the wrong series name or issue number), feel free to let me know about it."

The filename is often 2000AD, but it's 2000 AD, so the Scraper doesn't find it at first.
I should be able to make that work better.
The topic has been locked.
The following user(s) said Thank You: Mammut

Re: Comic Vine Scraper 1.0.59-63 6 years 5 months ago #32416

  • consulmac
  • consulmac's Avatar
  • Offline
  • Junior Boarder
  • Posts: 24
  • Thank you received: 2
  • Karma: 0
tip top work. I didn't know you could just paste the url into the scrapers search field! many thanks for this...X was starting to melt my feeble little brain!
The topic has been locked.

Re: Comic Vine Scraper 1.0.59-63 6 years 5 months ago #32446

  • Mammut
  • Mammut's Avatar
  • Offline
  • Gold Boarder
  • Posts: 196
  • Thank you received: 30
  • Karma: 7
Another frequent case: Cyberforce is the filename, and Cyber Force is the Comicvine name.
www.comicvine.com/cyber-force/4050-53102/

There is a 1st issue problem: Curse of the Mumy is the filename, and Curse of the Mummy is the Comicvine name. But as I see it on the cover, the Mumy is the correct name, so it's actually an error on the site.
www.comicvine.com/curse-of-the-mummy/4050-60023/
The topic has been locked.

Re: Comic Vine Scraper 1.0.59-63 6 years 5 months ago #32448

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1372
  • Thank you received: 580
  • Karma: 192
Mammut wrote:
Another frequent case: Cyberforce is the filename, and Cyber Force is the Comicvine name.
www.comicvine.com/cyber-force/4050-53102/

There is a 1st issue problem: Curse of the Mumy is the filename, and Curse of the Mummy is the Comicvine name. But as I see it on the cover, the Mumy is the correct name, so it's actually an error on the site.
www.comicvine.com/curse-of-the-mummy/4050-60023/

More good suggestions, thanks.

Curse of the Mumy was written by Bill Mumy, so the title of that volume/series on Comic Vine is definitely wrong. Should be pretty easy for someone to fix, though.
The topic has been locked.

Re: Comic Vine Scraper 1.0.59-63 6 years 5 months ago #32450

  • Madmatx
  • Madmatx's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 457
  • Thank you received: 70
  • Karma: 19
Mammut wrote:
Another frequent case: Cyberforce is the filename, and Cyber Force is the Comicvine name.
www.comicvine.com/cyber-force/4050-53102/

I just looked at the publisher info on the bottom of page 1 for the first three issues and it is says "Cyber Force® Volume 4"
The topic has been locked.
Time to create page: 0.478 seconds

Who's Online

We have 161 guests and 4 members online