Welcome, Guest
News and Announcements

TOPIC: Comic Vine Scraper 1.0.44-47

Re: Comic Vine Scraper 1.0.44-47 5 years 8 months ago #21212

  • Samael69
  • Samael69's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 381
  • Thank you received: 47
  • Karma: 21
cbanack wrote:
Another regular expression subsitution on "sname" (i.e. after the first line of the function), similar to what you've already done would probably do the trick; I'm not at home right now so I can't try it out to be absolutely sure.

This worked great. It's now ignoring leading numbers, as required. Thanks again!!
The topic has been locked.

Re: Comic Vine Scraper 1.0.44-47 5 years 8 months ago #21245

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1327
  • Thank you received: 508
  • Karma: 182
Samael69 wrote:
015 The Mighty Thor v1 411
029 The Mighty Thor v1 412
035 The Mighty Thor v1 413
Is this a fairly standard way that you guys name files with reading order/crossover numbers? I could probably modify the upcoming new release of the scraper so that it automatically ignores any numbers on the front of the filename, if this format (or something like it) is common...?

I don't use extra numbers on my filenames, so I'm not sure if that would be helpful.
Last Edit: 5 years 8 months ago by cbanack.
The topic has been locked.

Re: Comic Vine Scraper 1.0.44-47 5 years 8 months ago #21246

  • cYo
  • cYo's Avatar
  • Offline
  • Moderator
  • Posts: 3476
  • Thank you received: 676
  • Karma: 181
Ignoring front numbers does not always work (I walked that path :)).

"28 Days later 01.cbz"
The topic has been locked.

Re: Comic Vine Scraper 1.0.44-47 5 years 8 months ago #21247

  • Samael69
  • Samael69's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 381
  • Thank you received: 47
  • Karma: 21
For me, I don't do it in practice, but I sometimes come across packs numbered like this. It's much easier to import and create the list while they're numbered. After the list is created, the numbering is of little importance, but to get them scraped to create the list is the trick.

I don't know that having it do this by default would be a good choice, but having the option to do it would be nice.
The topic has been locked.

Re: Comic Vine Scraper 1.0.44-47 5 years 8 months ago #21248

  • cYo
  • cYo's Avatar
  • Offline
  • Moderator
  • Posts: 3476
  • Thank you received: 676
  • Karma: 181
Or if you working with lists try to find the pattern that changes (like only the front number). But stuff like this is always easier said than coded :)
The topic has been locked.

Re: Comic Vine Scraper 1.0.44-47 5 years 8 months ago #21249

  • sykoone
  • sykoone's Avatar
  • Offline
  • Expert Boarder
  • Posts: 153
  • Thank you received: 16
  • Karma: 5
For cases like this, I uses the "Tag from filename" script to apply the leading numbers to the alternate number field and properly name the file in the database. After that, scraping works fine, plus I have the files autonumbered for list building purposes. As cYo pointed out, it doesn't work well with titles headed by numbers, but that's a small price to pay.
The topic has been locked.

Re: Comic Vine Scraper 1.0.44-47 5 years 8 months ago #21253

  • cbanack
  • cbanack's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 1327
  • Thank you received: 508
  • Karma: 182
Yeah, I ran into similar problems trying to parse story arcs.

I was thinking I could make it ignore numbers that end with a period or a dash or a colon, like:

2. 28 days later
2 - 28 days later
2: 28 days later

That's a little less likely to run into false matches.

But then again, it sounds like this isn't really that common a problem, so maybe it's not worth the potential trouble.
The topic has been locked.

Re: Comic Vine Scraper 1.0.44-47 5 years 8 months ago #21254

  • Samael69
  • Samael69's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 381
  • Thank you received: 47
  • Karma: 21
But still could be issues as in,

10.GN.(BOOM.Studios.2005).(AnEvilScan)

As you say, it doesn't appear to be a common thing, so, if I'm among a very small minority, it's probably not worth the hassle. I can always change it myself again, if the need arises.
The topic has been locked.

Re: Comic Vine Scraper 1.0.44-47 5 years 8 months ago #21466

  • DrWorm
  • DrWorm's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 13
  • Thank you received: 1
  • Karma: 0
Big news announced that could have an effect on the scraper. Comic Vine (along with sister site Giant Bomb) have been sold to CBS Interactive (CNET, Gamespot). More details are forthcoming, but it sounds like the wiki will still be around. Hopefully it doesn't have a big effect.
The topic has been locked.

Re: Comic Vine Scraper 1.0.44-47 5 years 8 months ago #21472

  • cYo
  • cYo's Avatar
  • Offline
  • Moderator
  • Posts: 3476
  • Thank you received: 676
  • Karma: 181
Let's hope for the best.
Usually when something like this happens I hear some accountant mumble "let us monetize all this user generated content".
The topic has been locked.
Time to create page: 0.204 seconds

Who's Online

We have 238 guests and 3 members online