Welcome, Guest
News and Announcements

TOPIC: Comic Vine Scraper

Comic Vine Scraper 6 months 1 week ago #49084

  • Xelloss
  • Xelloss's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 582
  • Thank you received: 146
  • Karma: 29
New patch version with unicode bug "fixed":


File Attachment:

File Name: cvdb-2-3-4...-7-8.zip
File Size:9 KB


As usual, just replace the file and restart
Last Edit: 6 months 1 week ago by Xelloss.
The administrator has disabled public write access.
The following user(s) said Thank You: Kiljoy McCoy

Comic Vine Scraper 6 months 1 week ago #49085

  • Kiljoy McCoy
  • Kiljoy McCoy's Avatar
  • Offline
  • Expert Boarder
  • Posts: 80
  • Thank you received: 1
  • Karma: 0
Thank you, It has made a big difference in Scraping new books, Faster and more accurate.
The administrator has disabled public write access.

Comic Vine Scraper 6 months 1 week ago #49086

  • oraclexview
  • oraclexview's Avatar
  • Offline
  • Moderator
  • aka SoundWave
  • Posts: 919
  • Thank you received: 189
  • Karma: 38
Great work by the way Xelloss! I may have been inspired to take a closer look at your code changes to see if I want to add them to my Scraper script. Thank you buddy!
The administrator has disabled public write access.

Comic Vine Scraper 6 months 1 week ago #49087

  • Xelloss
  • Xelloss's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 582
  • Thank you received: 146
  • Karma: 29
I put a label in the editted lines... so that it can be easily view from the original code...
The administrator has disabled public write access.

Comic Vine Scraper 6 months 1 week ago #49091

  • boshuda
  • boshuda's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 334
  • Thank you received: 86
  • Karma: 10
Xelloss wrote:
I put a label in the editted lines... so that it can be easily view from the original code...

I use winmerge to compare the files and bring over the parts I want. Any diff tool will obviously work.
The administrator has disabled public write access.

Comic Vine Scraper 6 months 1 week ago #49096

  • Xelloss
  • Xelloss's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 582
  • Thank you received: 146
  • Karma: 29
New version with some bugs fixed:

File Attachment:

File Name: cvdb2.1.zip
File Size:9 KB


The more I understand how this script works, the more I see how much work the developer put into it. He just thought about EVERYTHING!

For the list of changes and bug reports, please use the other topic I created for this patch :P
Last Edit: 6 months 1 week ago by Xelloss.
The administrator has disabled public write access.

Comic Vine Scraper 6 months 1 week ago #49108

  • beardyandy
  • beardyandy's Avatar
  • Offline
  • Senior Boarder
  • Posts: 47
  • Thank you received: 5
  • Karma: 0
@cbanack

Out of curiousity, I've only just notices that settings for the scraper (e.g. API code) are set outside the normal path
Scripts\Comic Vine Scraper\resources.py:
profile_dir = Environment.GetFolderPath(
   97           Environment.SpecialFolder.ApplicationData) + \
   98:          r"\Comic Vine Scraper"
   99        
  100        # set the standard locations for settings files

Sure you had a good reason for it - can you remember why? The fun of windows permissions?

Reason I'm asking is I use CR in portable mode and it's the one thing that isn't under the comicrack/data folder for me. Not a bit problem but I might move it.
The administrator has disabled public write access.

Comic Vine Scraper 6 months 1 week ago #49124

  • krandor
  • krandor's Avatar
  • Offline
  • Gold Boarder
  • Posts: 310
  • Thank you received: 32
  • Karma: 5
Heads up. New version of search just dropped with API changes.


#72 Posted by steveeasley (14 posts) - 6 hours, 16 minutes ago
We have a new round of fixes landing today that should resolve the poor alias matching (and a few result title bugs). @pikahyper Not sure why what we had will degrade over time though. Lets see how these new fixes today handle things. There should be a large improvement.

We also improved the API results so they are much less noisy. @cbanack We do plan to do that eventually, its a great suggestion.

#73 Posted by steveeasley (14 posts) - 29 minutes, 32 seconds ago
The above changes are now live.
The administrator has disabled public write access.

Comic Vine Scraper 6 months 1 week ago #49128

  • Xelloss
  • Xelloss's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 582
  • Thank you received: 146
  • Karma: 29
I suggest everybody using my patch to go back to the original script, as it works much similar to before now and my patch just doesn't make sense anymore
The administrator has disabled public write access.

Comic Vine Scraper 6 months 1 week ago #49141

  • kino13
  • kino13's Avatar
  • Offline
  • Senior Boarder
  • Posts: 58
  • Thank you received: 6
  • Karma: 0
Xelloss wrote:
I suggest everybody using my patch to go back to the original script, as it works much similar to before now and my patch just doesn't make sense anymore

For what is worth, I scrapped like 800 comics the other day thanks to you.
Regards
with no power comes no responsibility. except that wasn't true
The administrator has disabled public write access.
The following user(s) said Thank You: Xelloss
Time to create page: 0.542 seconds

Who's Online

We have 226 guests and one member online