Latest Announcemnent
New thread

SharpLeech 2.0.0 ALPHA

Status
Not open for further replies.
Hyperz said:
I'm not your slave am I? Analyzing problems that people have with the SL alpha is the last thing on my mind right now. But if you're willing to pay $10/hour I'd be happy to consider giving you personal assistance 8-).

Alternatively you could download a good C# book, learn it, and spend a month or 2-3 creating your own flawless leecher. Or try one of the slow webbrowser implementations such as iLeech or TRF (which comes with a free Winnie The Pooh skin!).

Good day.
Click to expand...


+10
BTW could you make an toy story skin for SL? :))
 
I love this app but in the new version I can't really figure out what to put in the "base URL" field. I use a custom phpBB 3.x.x script. Any advice is appreciated
 
Funny, that after a year you still have to explain the url :p. Noticed that quite some times on c-p aswell :p.
Anyway, still a nice rocking piece of coding :).
 
Hyperz: I tried that but it doesn't work, probably because I've modded my phpBB too much. What (files) needs to be in the base dir for it to work?
 
I think you're using wrong settings. It could be a problem with the sites mods like you say but that doesn't happen too often. Stock files are good enough. Upload your errors log to pastebin.com if you can. You can find it in your sharpleech folder.

Webhouse said:
Funny, that after a year you still have to explain the url :p. Noticed that quite some times on c-p aswell :p.
Anyway, still a nice rocking piece of coding :).
Click to expand...

Yeh, it's the circle of doom. I thought I was gonna solve that by switching to 1 simple url instead of 2 confusing ones. Guess not... ^^
 
Essentially what it does is it'll copy and paste posts from another forum and post it to yours, it's a quick way of buffering your post count, however you may also move spam/deadlinks over from site you're copying from.
 
Copies (leeches) topics from one site to another in a safe and automated way.

Edit: too late ^^
Edit2: There are easier ways to bump your post count. This tool is primarily aimed at webmasters that need content on their site and don't want to upload themselves or copy/paste manually.
 
Fixed: http://pastebin.com/v1uBptkt

Tested and working over here. Firstly, when you go to the site you land at http://tehparadox.com/forum but in the plugin you had http://www.tehparadox.com/forum as base url. This can make a difference, also in terms of speed (less redirects).

Secondly you had:
Code: 
        <!-- Set to true if the site uses SEO urls, otherwise false. -->
        <AllowRedirects>true</AllowRedirects>
        <UseFriendlyLinks>true</UseFriendlyLinks>
UseFriendlyLinks only works with VBSeo for vB. They use some other system so UseFriendlyLinks had to be set to false. Keeping AllowRedirects set to true will automatically take care of the *unknown* SEO plugin.

Edit:
People have been reporting issues with wbb. I can confirm that something is wrong. After leeching a few topics the site starts throwing 403 (forbidden) errors. I THINK they are trying to block leechers. I'll look into the problem when I get some time. For now if you use wbb I recommend setting the pause value to 5000. That might help.

Edit2:
SL2 Alpha -> 1.100 downloads and counting (excluding other mirrors). 8)

Edit3:
Don't PM me with SL problems please, thanks. Post them here instead. You might not always get an answer but I do take note of issues for future versions.
 
Bumpety bump. I've been looking at the wbb problem and it seems they are analyzing what topics you (read: SharpLeech) view. When they detect a pattern in that they will block you based on your session ID. Or at least that is what it looks like to me.

I've done some testing and it seems like there is an easy solution. Replace the contents of Warez_BB.xml with this:

Code: 
<?xml version="1.0" encoding="utf-8" ?>

<!-- SharpLeech 2.x.x SiteReader Plugin -->

<!-- Version MUST be in x.x.x.x format! -->
<SiteReader pluginVersion="2.0.0.0" pluginAuthor="Hyperz">
    <Settings>
        <SiteName>Warez-BB</SiteName>
        <BaseUrl>http://www.warez-bb.org</BaseUrl>
        <TopicsPerPage>50</TopicsPerPage>
        
        <!-- Supported type values are: IP.Board 3.x.x, IP.Board 2.x.x,
             vBulletin 4.x.x, vBulletin 3.x.x, phpBB 3.x.x, phpBB 2.x.x -->
        <Type>phpBB 2.x.x</Type>
        
        <!-- If unsure choose ISO-8859-1. Except for phpBB 3 boards, they use UTF-8 by default. -->
        <DefaultEncoding>ISO-8859-1</DefaultEncoding>
        
        <!-- Set to true if the site uses SEO urls, otherwise false. -->
        <AllowRedirects>false</AllowRedirects>
        <UseFriendlyLinks>false</UseFriendlyLinks>
    </Settings>

    <Sections>
        <Section title="Apps" id="3" />
        <Section title="All-In-One (AIO)" id="47" />
        <Section title="Freewares and Betas" id="9" />
        <Section title="Games" id="5" />
        <Section title="Console Games" id="28" />
        <Section title="Movies" id="4" />
        <Section title="TV Shows" id="57" />
        <Section title="Anime" id="88" />
        <Section title="Music" id="6" />
        <Section title="Music Videos" id="38" />
        <Section title="Templates and Scripts" id="7" />
        <Section title="Template Rips" id="29" />
        <Section title="eBooks" id="8" />
        <Section title="Tutorials" id="83" />
        <Section title="Audio" id="91" />
        <Section title="Mac and Other OSes" id="20" />

        <!-- If you have an account with VIP access you can un-comment this (:
        <Section title="VIPs &amp; Donators" id="35" />
        -->
    </Sections>
    
    <!-- Edit this when the site requires custom parsing -->
    <Code>
        <![CDATA[
        
        protected override void Init()
        {
            base.Init();
        }

        public override void LoginUser(string username, string password)
        {
            base.LoginUser(username, password);
        }

        public override void LogoutUser()
        {
            base.LogoutUser();
        }

        public override string[] GetTopicUrls(string html)
        {
            return base.GetTopicUrls(html);
        }

        public override SiteTopic GetTopic(string url)
        {
            if (Http.SessionCookies["phpBB_WBB_t"] != null)
            {
                Http.SessionCookies["phpBB_WBB_t"].Value = String.Empty;
            }
            
            return base.GetTopic(url);
        }

        public override SiteTopic GetTopic(int topicId)
        {
            return base.GetTopic(topicId);
        }
        
        public override HttpWebRequest GetPage(int sectionId, int page, int siteTopicsPerPage)
        {
            return base.GetPage(sectionId, page, siteTopicsPerPage);
        }

        public override void MakeReady(int sectionId)
        {
            base.MakeReady(sectionId);
        }
        
        ]]>
    </Code>
</SiteReader>

Before you start leeching from wbb with the modified plugin set the pause value to 1 so that it leeches in sync mode. I've leeched 8 pages with this method without errors.
 
Status
Not open for further replies.
Back
Top