Welcome, Guest
General discussion about ComicRack

TOPIC: Sick Beard for Comics – Now that would be cool…

Re: Sick Beard for Comics – Now that would be cool… 5 years 8 months ago #21189

  • jinkira
  • jinkira's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 2
  • Karma: 0
Just like you 404
I came across this forum and created an account myself

the perfect source for everything is comicRack itself
I have been trying to create my own little auto-downloader of comics like sickbeard
Now I know there is someone else out there who wants to do the same thing like me

Primetime34 speaks of the ComicVine scraper which works perfectly with ComicRack
(some reverse engineering required / or source files for scraping)

if you need help let me know I got almost all the theory worked out just need help on the technical aspect
The topic has been locked.

Re: Sick Beard for Comics – Now that would be cool… 5 years 8 months ago #21190

  • 404notfound
  • 404notfound's Avatar
  • Offline
  • Senior Boarder
  • Posts: 43
  • Thank you received: 11
  • Karma: 13
startreksteve wrote:
I've got an Easynews account if you need a beta tester.
Steve

Thanks for reminding me. I'm so used to an unlimited account that I wasn't thinking about a fixed account like Easynews. The script runs for several hours downloading headers and I hate to cut into someones available gigs. Turns out Easynews doen't count headers. Anybody else have any fixed accounts like Easynews let me know. I'd be curious if any of them count headers towards your quota.
ahroun wrote:
-> github.com/saivenkat/omniverse

[Darth Vader's voice ON] NOOOOOOOOOOO !!!!!! [Darth Vader's voice OFF]


Just when i fell in love with omniverse... but anyway, whatis and wahtsnot already been used anywhere around these days?

Haha. Yep, thats right everything has been done. That project consists of a README file submitted four months ago. I don't think there will be too much conflict :) I can't create a new project named omniverse but what I can do is fork that one and remove that one README file.
jinkira wrote:
if you need help let me know I got almost all the theory worked out just need help on the technical aspect

Welcome! I'm still working on the technical aspect too :) When the script runs for 6 hours downloading headers and there is a hiccup deep in the bowels of the socket library then debug and rerun for another 6 hours. Fun stuff :)
Omniverse is now available for download at github.com/four-o-four/omniverse
The topic has been locked.

Re: Sick Beard for Comics – Now that would be cool… 5 years 8 months ago #21192

  • Brennok
  • Brennok's Avatar
  • Offline
  • Senior Boarder
  • Posts: 60
  • Thank you received: 2
  • Karma: 0
I believe blocknews does count headers but at a discount.
The topic has been locked.

Re: Sick Beard for Comics – Now that would be cool… 5 years 8 months ago #21436

  • Hexaphim
  • Hexaphim's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 12
  • Karma: 0
This sounds like a fantastic idea! I'd be very interested in beta testing it if you need more people for that. :)
The topic has been locked.

Re: Sick Beard for Comics – Now that would be cool… 5 years 8 months ago #21441

  • 404notfound
  • 404notfound's Avatar
  • Offline
  • Senior Boarder
  • Posts: 43
  • Thank you received: 11
  • Karma: 13
Hey everyone! Hope you didn't tired of waiting. :) Spent the last week getting familiar with git and how to use github. I made a repository here: http://github.com/four-o-four/omniverse. Anybody who wants to take a look at it feel free to either clip the ZIP button to download a copy or pull down a copy using Git.

Some things to be aware of:

* This isn't a user-friendly version or even a useful version. This release is for me to get familiar with working with git and lets people test if the header download portion is working with different usenet providers.

* Requires Python. I'm using Python 2.7. It may be compatible with an earlier version but I have not tested it. I doubt its compatible with Python 3.0. I may migrate at a later date but for now I'm sticking with 2.7.

* To run the program, use python to run omniverse.py. The first time it runs, it will save a file called config.ini in the directory then quit. Edit the config.ini file with your nntp server information. Should be self explanatory. Username, password, a 0 or a 1 for SSL, host, and port. Also there are places for what usenet newsgroups to scan. Two newsgroups are provided but you can add more. Make sure any newsgroups added following the numbering of the others in the example (0 for the first one, 1 for the second, etc).

* Run again to start the server.

* Once the server gets started, you should see logging information about what headers are being downloaded. IMPORTANT: The subject lines may be NSFW or NSFL for that matter. The same goes for the web interface and the produced log file. As I'm sure we all know, there's plenty of spam on usenet. One my goals is to write a better spam/porn filter and then those messages should go away.

* To access the web interface, browse to http://localhost:8085. The web interface should be improved soon.

* To quit the server and shut everything down use CTRL+C. It should quit cleanly and return to the command-line. If after a couple of minutes it doesn't, use process explorer to kill.

* If you see anything wrong or have trouble with your particular flavor of usenet provider please submit an issue through github (see the tab marked Issues on the omniverse main page of github).

* Also, if you use a block account this project works by downloading headers so depending on your provider this program may impact your monthly or block quota. I don't have exact numbers yet but I don't think its a large amount.

* Another thing to make sure of is to take a connection away from Sabnzb+. For example, if you provider gives you 20 connections, you'll want to change the connections to 19 in Sabnzb+ so there is no conflict.

Phew. I don't think I left out anything. Thanks for everyone's encouragement. I should have more up later in the week. I'll also setup a twitter account soon so you can send me any comments, rants, raves, or suggestions.

Thanks again everyone!
404
Omniverse is now available for download at github.com/four-o-four/omniverse
Last Edit: 5 years 8 months ago by 404notfound.
The topic has been locked.
The following user(s) said Thank You: JBenjimin

Re: Sick Beard for Comics – Now that would be cool… 5 years 8 months ago #21446

  • jinkira
  • jinkira's Avatar
  • Offline
  • Fresh Boarder
  • Posts: 2
  • Karma: 0
DUDE!!
You are a legend, a frikin LEGEND i tell you.....
so you got the SABNZBD thing working
Will provide comments etc once downloaded and tested

:thumbsup:
Last Edit: 5 years 8 months ago by jinkira.
The topic has been locked.

Re: Sick Beard for Comics – Now that would be cool… 5 years 8 months ago #21448

  • {Oo}
  • {Oo}'s Avatar
  • Offline
  • Platinum Boarder
  • The Chewie is a lie !
  • Posts: 672
  • Thank you received: 41
  • Karma: 15
Well, that's a "little" pet project that has taken form rather quickly!

Will be interesting to see how not long it takes for further development/improvement. ;)

I have been reading this thread with some interest for a few weeks now and was waiting for something real to come out of it to post so here I am.

And, of course, good idea and good job 404 :)
Working on re-uploading the FR manuals.
The topic has been locked.

Re: Sick Beard for Comics – Now that would be cool… 5 years 8 months ago #21449

There's a sickbeard branch that works with torrents as search providers. How hard would it be to implement that as well?


Awesome work
The topic has been locked.

Re: Sick Beard for Comics – Now that would be cool… 5 years 8 months ago #21450

  • startreksteve
  • startreksteve's Avatar
  • Offline
  • Platinum Boarder
  • Posts: 402
  • Thank you received: 28
  • Karma: 7
Not Much happening here, Ubuntu Lucid, python 2.6 on Easynews SSL. This is the most interesting part of the logfile:

(INFO): Creating a new connection.
(INFO): Article processor has nothing to do. Sleeping.
/home/steve/Omni/nntplib_ssl.py:55: DeprecationWarning: socket.ssl() is deprecated. Use ssl.wrap_socket() instead.
else: self.sslobj = socket.ssl(self.sock, self.keyfile, self.certfile)
(INFO): (secure.news.easynews.com:443,SSL): 200 Welcome to Easyn.
(INFO): Selecting group alt.binaries.comics
(INFO): alt.binaries.comics has 430603 articles, 4521656 - 4952258
Exception in thread Thread-6:
Traceback (most recent call last):
File "/usr/lib/python2.6/threading.py", line 532, in __bootstrap_inner
self.run()
File "omniverse.py", line 315, in run
low = int(low)
ValueError: invalid literal for int() with base 10: ''

(INFO): Finished processing articles. Quitting.

Thanks for all your hard work!!
Steve
Last Edit: 5 years 8 months ago by startreksteve.
The topic has been locked.

Re: Sick Beard for Comics – Now that would be cool… 5 years 8 months ago #21451

  • 404notfound
  • 404notfound's Avatar
  • Offline
  • Senior Boarder
  • Posts: 43
  • Thank you received: 11
  • Karma: 13
startreksteve: I think I know whats going on and I'll take a look at it tonight.

zetsubou.shin: Yes, I do think that will be a possible down the road. AceOfKnaves does a really good job of repacking DCP releases and so it would be a great source for recent comics.

Setup a twitter account: https://twitter.com/#!/omniverse2
Thanks everyone!
404
Omniverse is now available for download at github.com/four-o-four/omniverse
Last Edit: 5 years 8 months ago by 404notfound.
The topic has been locked.
The following user(s) said Thank You: zetsubou.shin, startreksteve
Time to create page: 0.409 seconds

Who's Online

We have 177 guests and 4 members online