Welcome, Guest
Share your ideas

TOPIC: comicbookdb.com Scraper

comicbookdb.com Scraper 3 years 9 months ago #38024

  • adamf9898
  • adamf9898's Avatar
  • Offline
  • Junior Boarder
  • Posts: 26
  • Thank you received: 1
  • Karma: 0
One of the sites I came across was like comicvine in a way. I was hoping someone would create a comicrack plugin to scrape information from this website. I would do it myself but I do not know how.

Thank you for taking the time to read this!

The Comic Book Database

Does anyone have any thoughts/suggestions/opinions/comments or anything to say about this ? Its been 2 days so far and nothing at all yet.
<--adamf9898-->
Last Edit: 3 years 9 months ago by adamf9898.
The administrator has disabled public write access.

comicbookdb.com Scraper 3 years 4 weeks ago #40928

  • hetchel
  • hetchel's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 9
  • Thank you received: 1
  • Karma: 0
I support this request.
ComicBookDB is a far better database than ComicVine (I don't know if as "scrape friendly" as ComicVine; this my be the reason we don't have an scraper yet?)
If anyone could tackle this, if would be awesome.
Last Edit: 3 years 4 weeks ago by hetchel.
The administrator has disabled public write access.

comicbookdb.com Scraper 3 years 4 weeks ago #40929

  • hetchel
  • hetchel's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 9
  • Thank you received: 1
  • Karma: 0
Double post. Sorry.
(Is there any way to delete a post? If admin read this, please delete)
Last Edit: 3 years 4 weeks ago by hetchel. Reason: Double post.
The administrator has disabled public write access.

comicbookdb.com Scraper 3 years 4 weeks ago #40932

  • sensei6375
  • sensei6375's Avatar
  • Offline
  • Senior Boarder
  • Posts: 46
  • Thank you received: 15
  • Karma: 4
I don't think they have an open API, like ComicVine does, so as far as I know no one can create a scraper script for them.
The administrator has disabled public write access.

comicbookdb.com Scraper 3 years 4 weeks ago #40934

  • hetchel
  • hetchel's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 9
  • Thank you received: 1
  • Karma: 0
That is what a suspected (and feared). I checked in the meantime, and that is unfortunately true.
I'll ask them if they'll consider implementing an open API (not very hopeful, but it's worth trying).
Thanks for your fast response. Greetings.
Last Edit: 3 years 4 weeks ago by hetchel.
The administrator has disabled public write access.

comicbookdb.com Scraper 3 years 4 weeks ago #40935

  • adamf9898
  • adamf9898's Avatar
  • Offline
  • Junior Boarder
  • Posts: 26
  • Thank you received: 1
  • Karma: 0
hetchel wrote:
I'll ask them

yes please do so and also post back here on any further information regarding. thank you
<--adamf9898-->
The administrator has disabled public write access.

comicbookdb.com Scraper 3 years 4 weeks ago #40937

  • Rincewind
  • Rincewind's Avatar
  • Offline
  • Junior Boarder
  • Posts: 39
  • Thank you received: 1
  • Karma: 1
The comicvinescraper was originally made/modified from the original ComicBookDB scraper, because they kept changing things to prevent scraping.
The administrator has disabled public write access.

comicbookdb.com Scraper 3 years 3 weeks ago #40941

  • oraclexview
  • oraclexview's Avatar
  • Offline
  • Moderator
  • aka SoundWave
  • Posts: 906
  • Thank you received: 182
  • Karma: 37
hetchel wrote:
I support this request.
ComicBookDB is a far better database than ComicVine (I don't know if as "scrape friendly" as ComicVine; this my be the reason we don't have an scraper yet?)
If anyone could tackle this, if would be awesome.

ComicVine and comicbookdb both have their pluses and minuses. One feature that comicbookdb has which I really like is how it handles multiple stories within one book. Other than that though, ComicVine contains as much great info, if not better.
I'll admit that I had to get used to how differently ComicVine stores certain data like volumes and character pages, yet once I did, the site has grown on me more and more.
Another great thing about ComicVine is that, if you scrape a book and notice that something is missing or is incorrect, then all you have to do is create an account (if you haven't already) and update the book's page with the missing or correct data. After that, the scraper will pull the proper data for that book. :)
The administrator has disabled public write access.

comicbookdb.com Scraper 3 years 3 weeks ago #40948

  • hetchel
  • hetchel's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 9
  • Thank you received: 1
  • Karma: 0
I've used them not very intensively, but even with little use, it is unfortunately easy to see that ComicVine is quite misguided in some regards (specially, information structure), and lacks some useful info (won't get into details here, to not seem too harsh, and because it is not the main topic of this thread).
Obviously, I prefer a worse open database than a better closed one, but I'd prefer a top AND open database, or even better 2 of them :)
That's why I try to not only criticize but add my two cents to ComicVine, but I'm finding... "obstacles".

On the other side, I reached comicbookDB asking for an open API, but in the meantime I found a very recent ( Sep 02, 2014) forum thread discussing the issue:
comicbookdb.com/forums/viewtopic.php?f=2&t=7991
which literally says "Still no plans on an API.", so I'm afraid we're out of luck :(
Last Edit: 3 years 3 weeks ago by hetchel.
The administrator has disabled public write access.
Time to create page: 0.333 seconds

Who's Online

We have 459 guests and 4 members online