What is Reddit's opinion of Screaming Frog SEO Spider?

From 3.5 billion Reddit comments

TBH for what Raventools, Ahref, WooRank, and Moz are able to automate, they are well worth their cost. There are some free SEO tools out there

http://tools.seobook.com/ https://moz.com/researchtools/ose/ http://www.screamingfrog.co.uk/seo-spider/

But does he really just want to pay you to do busy work?

You could run screaming frog and give them the results. It will give you on page errors that you can fix for them. It's actually a good idea to run this anytime you build a site to see if you are making on-site errors that will affect their SEO.

Protip for charity: run the site through screaming frog and it tells you the server code for every uri on the site. Sort them high to low, and all the 4xx and 5xx errors will be your bad links and jacked resources.

I use the Moz tool crawl test: https://moz.com/researchtools/crawl-test, but you have to have a pro account.

You can also try the "screaming frog" crawling tool: http://www.screamingfrog.co.uk/seo-spider/

hope this helps :)

here's a link to a whole bunch of free stock photos

https://blog.slideshare.net/2015/09/28/7-sites-for-free-and-beautiful-stock-photos/?utm_source=slideshare&utm_medium=ssemail&utm_campaign=newsletter

http://www.gratisography.com/

http://www.screamingfrog.co.uk/seo-spider/ Crawl your site and make a super comprehensive audit. I've used this baby to run SEO audits that I charged hundreds for

Online option

http://www.brokenlinkcheck.com/broken-links.php

Any domains that shows up as "bad host" are worth checking to see if they are expired domains.

Download option (Windows, OS X, Linux):

http://www.screamingfrog.co.uk/seo-spider/

Start the spidering and sort by "Status Code". This will show Status Code of 0 and Status of "DNS lookup failed" at the top. Those are possibly expired domains.

Note: neither of thee two tools show expired domain availability unfortunately. Nor can they do multiple sites to scan in succession AFAIK

At IMN we have crazy amounts of internal tools that the public doesn't have access to...But we do have a good deal of amazing free tools at: http://www.internetmarketingninjas.com/tools/

Also as far as other tools, I use ScreamingFrog quite a bit: http://www.screamingfrog.co.uk/seo-spider/

Do you mean viewing the directory listing? First two responses here might help: http://stackoverflow.com/questions/124492/c-sharp-httpwebrequest-command-to-get-directory-listing

You could also run your own spider on the site: http://www.screamingfrog.co.uk/seo-spider/

I see an increase. If you're talking about the little dip at the top, that's normal - nothing to worry about. Every site has crap pages that Google doesn't need to include/count and it'll correct over time. You'll see it even out (or continue climbing if you're still building).

If you see a drastic drop, double check your Robots.txt and verify nothing had a noindex tag added. You can do this pretty quickly with a copy of ScreamingFrog - it'll run a full site crawl and let you know what the index status of pages is.

http://www.screamingfrog.co.uk/seo-spider/

You need historical data, Google analytics and Webmaster tools on every site and you want a few months of data at the very least.

The go here, http://www.screamingfrog.co.uk/seo-spider/, if the sites are smallish you can get by with the free version. This is the best one stop look at the basics.

Screaming Frog only has access to 512mb by default, which is why you run out of memory. There's a settings file buried somewhere where you can allocate more.

http://www.screamingfrog.co.uk/seo-spider/user-guide/general/

This pretty much sums it up: http://www.seerinteractive.com/blog/screaming-frog-to-verify-google-analytics/

That article doesn't talk about XPath which you might need to use depending on your GA implementation so this will come in useful also: http://www.screamingfrog.co.uk/seo-spider/user-guide/configuration/#extraction

p.s. I'm not at all associated with Screaming Frog, I just use it everyday and find it super useful.

If you haven't already, you should at least download and run the website through Screaming Frog. There's plenty of tutorials out there to teach you how to use it, so I won't mention anything here. But it will pull the titles, meta descriptions, H1s, H2s, etc. You can organize accordingly.

Here: http://www.screamingfrog.co.uk/seo-spider/#download

The free version should be good enough for you for this project.

If you suggested changing the titles and descriptions that are currently on the website such as "PRINCE2 & MSP - Project & Programme Management Training Courses - HiLogic -", (which is the homepage title), and if you were scolded for making the suggestion to change a title like that, then they are wrong. They need to be fixed for SEO.

Many times, Google will rewrite long keyword stuffed titles like that to fit their pixel length by taking phrases from the page and displaying what Google thinks should be the best title, which makes having long keyword titles completely useless. So it's best to be more concise, be in control, and tell searchers what the page is about. And not be spammy/keyword stuffed.

I use a remote tool called Screaming Frog SEO Spider. You enter a URL and it returns all links with the statuses. You can then easily filter/sort the results. The free version works fine for this.

If you are going to have the same exact url structure then do the blanket 301 for the whole site.

If you dont have many pages or are changing your url structure at all do an individual 301s for each and every page you moved. Watch your GWT over the next few weeks for crawl errors. 301 redirect those as they come through.

If you are planning on looking through yoursite to clean up 301 redirects and 404s I suggest using Screaming Frog SEO Spider tool http://www.screamingfrog.co.uk/seo-spider/

Screaming Frog SEO Spider will do this for you (Grab all URLs on the site).

>Surely this isn't as simple as dropping the client's domain into one of those free XML sitemap generators, is it?

Actually, yes. Did you even consider trying that before asking us?

Hey, both meta descriptions and titles are now counted by Google in pixels rather than characters, which is a bit of a pain. A good tool that I use to make sure meta data doesn't get truncated is Screaming Frog: http://www.screamingfrog.co.uk/seo-spider/ - you'll only ever need the free version if meta data is all you're using it for. Here's a blog from Screaming Frog on the topic too: http://www.screamingfrog.co.uk/page-title-meta-description-lengths-by-pixel-width/. Another good tool is www.seomofo.com which lets you preview meta title and description. Hopefully these help.

As others have mentioned here, that tool is quite outdated and from my experience, so are all the other SEO audit tools you'll find.

They are helpful if you know which factors to ignore (e.g. bolding your keywords will NOT help your rankings EVER yet it is a factor considered by so many audit utilities).

Modern SEO is too complex for any automated tool to give you a definitive grade so you really need to know what you're looking at/for if these tools are going to help you.

Personally I prefer to use the Screaming Frog SEO Spider, it gives me all the info in one tool and I can revise it manually and make my own decision as to what needs changing.

If you're looking for an SEO audit tool, I really recommend Screaming Frog/Beam Us Up (a more capable free version) in tandem with SEORCH.eu.

Run a screaming frog scan and have a look at the page titles. They may even have stuck some target keywords in the meta keywords too, although that's probably a sign that they haven't actually got a specialist to do their SEO in the first place...see visualseostudio's comment...