+- ScrapeBox Forum (https://www.scrapeboxforum.com)
+-- Forum: ScrapeBox Main Discussion (https://www.scrapeboxforum.com/Forum-scrapebox-main-discussion)
+--- Forum: General ScrapeBox Talk (https://www.scrapeboxforum.com/Forum-general-scrapebox-talk)
+--- Thread: Scrapebox Linkcheck is taking forever, do you use private proxies? (/Thread-scrapebox-linkcheck-is-taking-forever-do-you-use-private-proxies)
Scrapebox Linkcheck is taking forever, do you use private proxies? - etojoy - 10-13-2011
Hi there,
I shouldn't be asking such simple questions but it's taking forever
So I'm trying to do a linkcheck to see how many links are live on 200,000+ blogs I posted to.
But it takes hours just to go through 7,000 posts.
I'm using 10 private proxies, do you use proxies?
I also have maximum connections set to 80, but still taking much longer time than posting does.
HEEELP the admin LOL
RE: Scrapebox Linkcheck is taking forever, do you use private proxies? - ThomasB - 10-13-2011
Hi!
You should try with 10 connections
Tom.
RE: Scrapebox Linkcheck is taking forever, do you use private proxies? - etojoy - 10-13-2011
ok thanks trying now, I don't think it'll work but well see I'll be back with my progress in a few hours
RE: Scrapebox Linkcheck is taking forever, do you use private proxies? - etojoy - 10-13-2011
It's now been 6 hours and only about 6,000 links checked.
This is taking FOREVER!
Any help please, I need to check many links fast.
RE: Scrapebox Linkcheck is taking forever, do you use private proxies? - s4nt0s - 10-13-2011
Make sure and have proxies off when checking links .. you never need proxies when using the link checker. The only thing you can really do is increase your thread count but if you bandwidth can't handle it, you'll notice the link checker will start to have brief pauses which will just slow you down more.
Link checking takes quite a while for everyone.
RE: Scrapebox Linkcheck is taking forever, do you use private proxies? - etojoy - 10-13-2011
(10-13-2011, 07:31 PM)s4nt0s Wrote: Make sure and have proxies off when checking links .. you never need proxies when using the link checker. The only thing you can really do is increase your thread count but if you bandwidth can't handle it, you'll notice the link checker will start to have brief pauses which will just slow you down more.
Link checking takes quite a while for everyone.
Thanks!
So I'm on a 100mbit connection through cable, how many threads do you suggest? And will running too many 200,000+ at once make it slower?
I did some searching in the forum and found a thread recommending http://www.scrapebox.com/free-link-checker to check links, it was mentioned this was faster than the inbuilt link checker on scrapebox. ideas?
RE: Scrapebox Linkcheck is taking forever, do you use private proxies? - s4nt0s - 10-13-2011
I've never used that link checker but I'd definitely give it a try because the built in link checker takes soooooo long. I don't know exactly how many threads to run. Start with 10 and if it seems to be running smoothly with that, increase by 5 and keep going until you find your sweet spot.
Give that free link checker a try though, it might work better. I might have to give that a try myself.
RE: Scrapebox Linkcheck is taking forever, do you use private proxies? - etojoy - 10-13-2011
(10-13-2011, 07:45 PM)s4nt0s Wrote: I've never used that link checker but I'd definitely give it a try because the built in link checker takes soooooo long. I don't know exactly how many threads to run. Start with 10 and if it seems to be running smoothly with that, increase by 5 and keep going until you find your sweet spot.
Give that free link checker a try though, it might work better. I might have to give that a try myself.
http://www.www.scrapeboxforum.com/Thread-SB-Difference-between-Backlink-checker-and-Link-extractor-addons?highlight=link+checker found it here
RE: Scrapebox Linkcheck is taking forever, do you use private proxies? - scrapebrokers - 10-16-2011
(10-13-2011, 07:34 PM)etojoy Wrote: I did some searching in the forum and found a thread recommending http://www.scrapebox.com/free-link-checker to check links, it was mentioned this was faster than the inbuilt link checker on scrapebox. ideas?
I use Free link checker standalone program when Im checking links and not the built in link checker. The only downside is that the free link checker doesn't have the option to save SERVER Error blogs. I usually give another test of the server error list as on the second run I find many of the links are actually working
In conclusion Free link checker is way faster and consumes less resources than the internal one. I recommend you.
Oh and another thing..if the list is really huge better SPLIT it in more lists .the link checker will handle smaller files better and faster. With big lists you may run out of the memory quite fast