Welcome, Guest
Python Scripts for ComicRack

TOPIC: Comic Vine Scraper further Development

Comic Vine Scraper further Development 2 years 1 month ago #43625

  • spynotebook
  • spynotebook's Avatar
  • Offline
  • Expert Boarder
  • Posts: 105
  • Thank you received: 13
  • Karma: 2
i think this is great work. I just caught up on what was going on today. The only way I can really help would be financially or with testing. I run ComicRack on a virtual machine on my Ubuntu server so I can test and revert to a snapshot if something goes wrong.
The administrator has disabled public write access.

Comic Vine Scraper further Development 2 years 1 month ago #43631

  • Jothay
  • Jothay's Avatar
  • Offline
  • Senior Boarder
  • 1
  • Posts: 47
  • Thank you received: 24
  • Karma: 6
Ok a LOT of the solution is up now, it should be almost capable of supporting data put into it via the API. I'm having trouble getting swagger ui to work but you can still use the main metadata pages to read the api documentation.

While I do have full CRUD operations set up, only the Read actions will be visible in the friendly API documentation. The CUD parts will not be necessary as only the Sync program will need to know how to handle them and that will reside inside the server with no commands from the outside.
The administrator has disabled public write access.
The following user(s) said Thank You: romsnesrom, johnson_pw, iohanr

Comic Vine Scraper further Development 2 years 1 month ago #43651

  • iohanr
  • iohanr's Avatar
  • Offline
  • Junior Boarder
  • Posts: 23
  • Thank you received: 17
  • Karma: 8
The server has arrived and I am in the process of configuring it now.

Will let you know when it's ready for the application.
The administrator has disabled public write access.
The following user(s) said Thank You: 600WPMPO, romsnesrom, Jothay, johnson_pw

Comic Vine Scraper further Development 2 years 3 weeks ago #43791

  • iohanr
  • iohanr's Avatar
  • Offline
  • Junior Boarder
  • Posts: 23
  • Thank you received: 17
  • Karma: 8
Hey guys... it's been pretty busy at work, and I ended up buying extra parts to upgrade the server, but it's pretty much good to go now.

Jothay - let me know when you are ready to test your code on this server and if there's anything special we need to do for it to communicate with ComicVine.
The administrator has disabled public write access.
The following user(s) said Thank You: 600WPMPO, khaoohs, Jothay, johnson_pw, Paradoxic, Freylis

Comic Vine Scraper further Development 2 years 2 weeks ago #43930

  • iohanr
  • iohanr's Avatar
  • Offline
  • Junior Boarder
  • Posts: 23
  • Thank you received: 17
  • Karma: 8
Just checking to see if there's anything I can do to help with this. I don't want it to die on the (comic)vine...

It would be great to be able to scrape from a server that doesn't have any arbitrary limits (other than the bandwidth and how fast you can suck in the data). It seems to me that other "DBs" out there like TVDB.com and TheMovieDB.org allow scraping of data from Plex, Kodi, Emby and other media players/managers without ever hitting a wall, and I imagine there are way more users of those apps than there are ComicRack/ComicVine plugin.

Has ComicVine changed their policy about letting us get a full copy of their DB and then running a program to pull regular updates?
The administrator has disabled public write access.

Comic Vine Scraper further Development 2 years 2 weeks ago #43931

  • Jothay
  • Jothay's Avatar
  • Offline
  • Senior Boarder
  • 1
  • Posts: 47
  • Thank you received: 24
  • Karma: 6
I can make time to get the next push on Sunday. I found out that part of the pattern I implemented won't work but I can recode it to a way that does.
The administrator has disabled public write access.
The following user(s) said Thank You: 600WPMPO, spynotebook, jkthemac, johnson_pw, iohanr, Freylis

Comic Vine Scraper further Development 2 years 1 week ago #44071

  • pweasel
  • pweasel's Avatar
  • Offline
  • Expert Boarder
  • Posts: 123
  • Thank you received: 18
  • Karma: 8
If you need beta testers, just let me know. I'm a good guinea pig.
CRW 0.9.178 x64 on Win10
CRA 1.80 on Nexus 10
The administrator has disabled public write access.

Comic Vine Scraper further Development 2 years 6 days ago #44094

  • Jothay
  • Jothay's Avatar
  • Offline
  • Senior Boarder
  • 1
  • Posts: 47
  • Thank you received: 24
  • Karma: 6
I'm sorry about not moving forward on this guys. I got a promotion and part of it means working 70 hours a week for the first month to catch up a bunch of work. We're working to backfill my previous position so I can offload a ton of tasks and get my load back under control. As soon as I have some free time where I'm not dead to the world, I will make the updates needed to push this thing out the door.
The administrator has disabled public write access.
The following user(s) said Thank You: iohanr, Freylis

Comic Vine Scraper further Development 2 years 6 days ago #44096

  • Silentgray
  • Silentgray's Avatar
  • Offline
  • Senior Boarder
  • Posts: 41
  • Thank you received: 5
  • Karma: 0
Thanks for the update. We all know life gets in the way of fun. I for one really appreciate the effort and am looking forward to this. I can sure help test as well if needed.
The administrator has disabled public write access.

Comic Vine Scraper further Development 2 years 6 days ago #44097

  • iohanr
  • iohanr's Avatar
  • Offline
  • Junior Boarder
  • Posts: 23
  • Thank you received: 17
  • Karma: 8
Hey Jothay, first of all, CONGRATS on the promotion! I'm sure it is well deserved!

Second, whenever things settle down and you are back in a rhythm, just let us know on this thread and we'll be here!
The administrator has disabled public write access.
Time to create page: 0.198 seconds

Who's Online

We have 201 guests and 4 members online