SEOmoz

SEOmoz, a Seattle-based search engine optimization company, serves as a hub for search marketers worldwide, providing education, tools, resources and paid services.

Posted by adamf

First, let me make a quick introduction. Normally, I spend my time focused on new products at SEOmoz, working with a great team of people that design and build our new tools and features. Today I am excited to use my first blog post to announce our new SEO toolbar for Firefox, and tell you about some of the powerful features we have added.

Download the SEO Toolbar

As a quick reminder, all of these new features are free, and will be available to anyone who downloads the Firefox SEO Toolbar!  However, we still reserve advanced link data for PRO members.

So, on to the features. To add a little color to my descriptions, I've also asked some SEO experts you may recognize to preview the toolbar and talk about how they use the new features.

1. New SERP Overlay

This new Search Engine Results Page overlay was designed to offer the most relevant link data without getting in the way. You can now use our toolbar to see which search results are getting the most links, and click Explore to run a full analysis in Open Site Explorer. To turn on this overlay, click the settings button on the toolbar, and select SERP Overlay.


 SERP Overlay
 

willcritchlow "I get the best 'feel' for abstract metrics by seeing them in familiar places. I find it easiest to understand the new metrics by seeing them on search results I'm familiar with; as an added bonus, this is one of the most helpful analyses you can do when looking at a new SERP for the first time." --Will Critchlow

2. Page Authority and Domain Authority

Page Authority and Domain Authority have taken their place as the primary metrics in the toolbar. These two predictive metrics will give you the best indication of how authoritative pages and domains are. If you miss having mozRank and mozTrust available at a glance, don't despair!  You can add these back into the toolbar by selecting them from the settings menu.

Toolbar Metrics

3. Surf Like a Search Engine

We have added new settings that allow you to hide images, turn off JavaScript, and even set your user agent. This will help you see pages like the search engines do, and identify potential bad page behaviors. And just to help out, we’ve added a handy little overlay to keep you aware of when any of these features are set. Just click the link in the overlay and all of your settings will return to normal.


set user agent

richardbaxterseo "The new user agent switching means I’ve removed another plug-in from Firefox. I love my SEO plugins but I also think there’s such a thing as having too many. Go for simplicity is what I always say. Special love goes out to disable JavaScript, too – I actually caught a nice bit of hidden link spam with this last week! Disable images is a sure fire way to check out the image alt attributes on a web page too. Nice." --Richard Baxter
willcritchlow "I don't want to take credit for an awesome feature. OK. I want to take credit for an awesome feature. After constantly forgetting I was surfing as googlebot and getting chucked out of Google calendar etc I asked for this feature and it's just as awesome as I hoped it would be. " 

4. New Data in the Analyze Page Overlay

Our analyze page overlay has also been enhanced with a number of new, useful data points, including

  • Page Download Time – this becomes more important with Google’s announcement that speed matters.
  • Text to Code Ratio – Is there more code on your page than content? Don’t make the search engines sift through too much code to find the relevant content.
  • HTTP status codes – Find out the status code of the current page, and learn which redirects were involved in getting you there.

Status Code
Overlay
 

randfish "The overlay is still the most valuable thing for me. I must use it 5+ times every day to get quick info about how many links are on a page, whether it's using rel="canonical" or whether the keywords are properly included in the right page elements. I hate using 'view source' and searching through code; overlay FTW!" --Rand Fishkin
RobOusbey "The http status codes feature is my favourite new addition to the tool. There's not more reloading and hunting through LiveHTTPHeaders reports - this lets me very easily see the redirect route taken in getting to the current page." --Rob Ousbey

5. Quick Access to Tools from SEOmoz and Third Parties

The tools dropdown has been expanded to include fast access to the latest SEOmoz tools as well as a wealth of other helpful resources, including traffic data, Twitter tools, and domain info.
 

tools menu

I hope you enjoy the new toolbar. Please give it a try, and be sure to send feedback so we can keep making it better. You can easily send feedback by clicking on the light bulb icon on the toolbar.

Download the SEO Toolbar

 


Do you like this post? Yes No


Posted by randfish

Late last week, Eric Enge of Stone Temple (and a co-author of mine on The Art of SEO) published a fascinating interview with Google's head of Webspam, Matt Cutts. I think the whole of the SEO community can agree that Matt taking time for these types of interviews is phenomenal and I can only hope he does more of them in the future. Understanding more about Google's positions, their technology and their goals will benefit website creators and marketers dramatically.

The interview itself is certainly worth a read, but as one mozzer noted to me during the email string on the subject "I'm embarassed to say I couldn't make it all the way through." Fair enough; and that's why I'm presenting Matt's primary points in graphical, cartoon format. I've also included some adlibbing, interpretation and fun into these. Only the bits surrounded by quotes were actually taken directly from Matt's words, so please do keep in mind that this is my opinion of what Matt means (along with the occassional editorial).

#1 - There is No Hard Indexation Cap; But Indexation Has Limits

#2 - Duplicate Content Might Hurt Your Indexation

#3 - Lots of Qualifiers on Whether Affiliate Links Count

#4 - 301 Redirects Pass Some, But Not All of a Page's Link Juice

#5 - Low Quality, Non-Unique Pages Might Drop Your Indexation

#6 - Faceted Navigation and PageRank Sculpting are Thorny Issues

Personally, I liked how much Eric pushed Matt with scenarios that would require some advanced methods of showing faceted navigation to users but not search engines. However, I also understand that Matt needs to take a position that's right for 95% of site owners 95% of the time or risk creating a new "PR sculpting" issue.

One other item that really stood out and got me excited was this response:

Matt Cutts: (with regard to links in ads) Our stance has not changed on that, and in fact we might put out a call for people to report more about link spam in the coming months. We have some new tools and technology coming online with ways to tackle that. We might put out a call for some feedback on different types of link spam sometime down the road.

That sounds really good - a huge frustration for the SEO world has been the fact that so many SEOs perceive their competitors to be outranking them with black/gray hat linking techniques and feel they must engage as well is order to stay competitive. Shutting this down or making SEOs feel that Google is taking consistent action when obvious manipulation is reported would go a long way to quelling this thorny problem.

My last recommendation is that you check out Eric's 29 Tidbits from my Interview with Matt Cutts; a post that summarizes a lot of the critical information and takeaways quite neatly.

To end, I thought I'd add the four questions I wish Eric would have asked Matt (maybe next time!):

  1. With Google's new recognition of internal anchor links and listings of those URLs in the search results, is it still safe to link to internal anchors on pages and trust that the link juice will flow to the page as a whole, or are content blocks inside individual pages now being treated as unique entities?
  2. With the handling of nofollow changing and Google crawling/executing Javascript, what's the best way to link to a document on the web so human visitors can access it but search engines cannot WITHOUT wasting link juice/PageRank (robots.txt, for example, couldn't do this) or cloaking?
  3. Does Google now (or will you in the future) consider the sharing/linking activities happening on Twitter, Facebook, etc. to have any impact on the overall link graph of the web (assuming we're talking only about those links that don't make their way onto standard web documents)?
  4. When people ask the question, "why is my competitor ranking so well with low quality/manipulative links?" you often reply that they should be careful in presuming that Google hasn't already discounted the value of spammy links and the competitor is actually ranking on the basis of quality link sources. This creates an environment where marketers are constantly trying to discern which links pass value and which don't - could you give advice for relatively savvy, experienced SEOs to help them make those determinations so they can pursue the right links and stop paying spammers for the wrong ones?

If you've got thoughts to share, questions outstanding from the interview or my amateur drawings or things you wish Eric had asked Matt, feel free to post them below.


Do you like this post? Yes No


Posted by Errioxa

In the past, I have tried several different ways to skip the first link that Google takes into account for a given URL (nofollowed links, links with 301 redirections, etc). However, all these attempts had little success (301 works but it's very suspect). Recently, I ran a test to see how Google handled the anchor links (links to different sections within the same page, eg: <a rel="nofollow" href="http://example.com/index.php#anything)">example.com/index</a> and was surprised by the results I found. In the setup I tested, Google completely ignored the first standard link and instead credited the second anchor link.

The Test

For my test, I included several links on a page (Page A),

  • the first link is a simple link. (<a href="http://example.com/category/product.php">text</a>)
  • the second and third link are anchor links. (<a href="http://example.com/category/product.php#anchor-example">other text</a>)

Or in graphic form:  4369503882_2d5fe23b65_o.gif

 

Results for Test 1

If you search for the first linked text we can see that we don't get the results of the destination page (Page B) . This link is not an 'anchor link', this link is a link to a 'simple URL' (that´s how I named it) but it is ignored.

SERP for first link: simple link (no # mark) 4368755127_545615973d_o.gif

Instead, Google takes the next two anchor links (this and this) and shows the page they point to in the results. Although the apparent ignoring of the first link is odd, the way the link is displayed is even weirder. As you can see the URL that shows in the SERPs (See red box in image above) does not take to the anchor link, but to the simple link.

SERP for second link: anchor link (#)

4368755069_0cbc16b897_o.gif SERP for third link: anchor link (#)  4369504066_ef854a01ab_o.gif

 

Results for Test 2

SERP for first link: simple link

4369504118_1d5e0bd69e_o.gif

 

SERP for second link: anchor link (#)

 

4369504184_5ee42d306b_o.gif

I ran two more tests to see if the test could be reproduced. Both of the other tests had the same results!

Conclusion

conclusion 

It is interesting to see the impact that link order has on rankings. Keep this in mind going forward and I hope you find this as interesting as I did.

 

Note from Jen: Errioxa had an updated version in the queue that I missed that explains this all a bit better. I have updated this post with the new version. 3/16/10


Do you like this post? Yes No


Posted by Sarah Bird, Esquire

May It Please the Mozzers,

I haven't written on the blog in months, but I simply couldn't let today pass by without acknowledging the courage and perserverance shown by Rhea Drysdale in her pursuit of justice. She's my hero and I want to be just like her--A woman of action and humble fortitude.

Rhea announced victory against Jason Gambert in a trademark dispute lasting more than two years. She fought to prevent "SEO" from becoming trademarked for one mysterious man's private use. She fought on behalf of all of us who work in the SEO industry. Like many of you, I feel sad and ashamed I couldn't do more to support Rhea--but we've had other legal trouble to sort out at SEOmoz that consumes our limited legal resources. :( 

Lawsuits are expensive, stressful, and very time consuming. There is nothing glamorous or certain about them. Even when you're in the right, you have to keep worrying about whether justice will prevail, and whether you'll be broke or demoralized before it finally does.

I'm feeling really jazzed and happy today because Rhea has bolstered my belief in people, the SEO industry, and the justice system. As Joanna Lord said earlier, "Its a good industry-day folks, good industry day :)"  It just feels warm-and-fuzzy to work in a community of people like Rhea who sacrifice a lot without hope of any financial gain. And of people like Aaron Wall, Michael VanDeMar, Barry Schwartz and many others who've publically supported and recognized Rhea for her efforts both today and in the past.

I just wanted everyone out there in blogland to know that we have a big crush on Rhea and a big crush on the SEO industry. It's so great to see everyone coming together to support Rhea and recognize what she's done for all of us.

You can show your support by helping Rhea recoup some of her legal fees. She's updating her blog with the best way to donate to her (without inadvertently giving her some tax grief!) on the OutSpokenMedia blog.

Group Hug!

Sarah Bird

Chief Operations officer and Erstwhile Legal Blogger

SEOmoz, Inc.


Do you like this post? Yes No


Posted by Nick Gerner

I know, I promised a Linkscape update by last week.  And I missed it.  But there's an update today!  Do you forgive me?  No?  Not enough?  Well how about doubling the volume of data available in our free API?  You might have gotten a totally awesome email last week announcing that the free SEOmoz API is now serving up to 1,000 links.  This email was so awesome I just had to share it (nice work Scott!)

 
This is the same free API that's powering tons of internal reporting tools and plenty of tools you might have already seen.  This includes Carter Cole's SEO Site Tools toolbar which went volcanic last month.  And he's not even showing lists of links.  So by some math there's 1000 times more power available!
 
But seriously, there have been comparisons made between what we're doing and what you can do with Yahoo! Site Explorer.  The Yahoo! Site Explorer API offers up to 1,000 links.  And there's no reason we can't do the same.
 
What do you get with the free API?  You get a lot:
  • Up to 1,000 links to a page, subdomain or root domain (sorted by Page Authority of the linking page)
  • Anchor text for those 1,000
  • Aggregate anchor text counts across all links in our index
  • HTTP status code
  • nofollow indicators
  • Plenty of metrics for data junkies

We've got a community submissions page on our wiki, and we love to share neat apps.  So if you build something on our API, send it our way and we'll make sure the community hears about it.

 


Do you like this post? Yes No


Posted by willcritchlow

Rob and Duncan are currently in Seattle, with this week full of interviews of SEO consultants for our US office. Since the announcement in February, we have been working flat out with a bunch of new clients and dealing endlessly with the US immigration service. With people on the ground, I guess we're now officially participating in the American dream, so to celebrate I'm going to spell Visualization with a z throughout this post. I can't guarantee full American spelling for everything I'm afraid - muscle memory is a powerful thing.

Anyone who has heard me speak will know about my love of data. Heck, I've even given talks on Excel ninjas. However, this post isn't so much about the data (and that's the last mention of Excel, I promise). This post is about the visualization.

I expect that everyone in SEO has spent at least some time recently thinking about data visualization techniques. They are great ways for content and data sites to get links and branding benefit and are also loads of fun. Tom's resource for information visualization and infographics is a great place to start if you don't really know what I'm talking about.

Last week, I was approached by the FT to pull together some data for them about the use of the web (and social media in particular) across the UK's political parties as we approach the election. As I started thinking about how I wanted to shape this, I realised that I wanted to produce a visualization for the web as well and that the process I was using might be interesting to you guys. Hence, my top tips for data visualizations with bits and pieces of real world examples:

7 Data Visualization Secrets

1. Gather data (intelligently)

Over the weekend, I had a bit of a think about what kind of data I wanted to be able to visualize. Thinking about Twitter, for example, I wanted to know things like the most influential (and least influential) Twitterers in each party, who was doing things really well and who was making a pig's ear of it, who could I compare unfavourably to some comedy joke accounts and how did the best of them compare to the Prime Minister's wife's pretty impressive performance.

In order to answer any of these questions, I needed data, and lots of it. Obviously, had I been working on this on a weekday, I'd have looked around for the newest recruit in the Distilled office and asked for the data on my desk by the end of the day. Without that option at the weekend, I fired up Mozenda to grab Twittering MPS, their grader ranks, retweetranks, and tweetranks along with follower counts, number of tweets and profile information. It took me about half an hour to gather all this information!

Mozenda console

Gather Grader information using Mozenda

Tip #1: use tools like Mozenda to mash up your own data with multiple sources of public data to get unique insights.

If you haven't played with Mozenda yet, I highly recommend it - with a simple user interface for creating robust crawlers, it's a superb tool for any SEO.

2. Delegate additional research

There are some things that even the best scraping engine in the world can't gather for you. For example, I wanted to cross-reference the data I'd gathered against the cabinet and shadow cabinet. Only a human can do this reliably. For this, I recommend using a virtual assistant service for cheap data gathering (I use timesvr - in the US, you could use mechanical turk for this kind of thing).

I discovered an awesome service the other day - Smartsheet integrates with Google Apps and has an integration with Mechanical Turk that enables you to easily populate tabular spreadsheet data using cheap human resource. Unbelievably useful and powerful.

3. Use great design

I'm not a designer. My design sense is about as well-tuned as my singing. I think this makes me appreciate the importance and value of design even more. Since I'm not the expert here, I'm just going to tell you what works for me when getting other people to make things look pretty:

  • Wireframes are your friend: although I hate paper for almost everything, I used to always sketch ideas on paper. Recently I have been a late convert to the power of drawing wireframes on the computer. I am, however, definitely sold. Choose your weapon of choice - I'm currently liking MockingBird but have also seen cool stuff from (Balsamiq, gliffy, Pencil (a Firefox plugin - thanks Simon Lilly) and Mockflow)..
  • Pay attention to the users of your data: carefully consider the width, colour scheme and any associated links in the embed code to make the most of embedding opportunities
  • Get professionals involved early: don't lock your limited-design-skills-self in a darkened room only to emerge with something that even a pro couldn't make look pretty. When you're at the wireframe / outline stage, show what you have to a designer and get feedback before kicking off the final data collection and design phases
  • Brief as well as possible:  provide a few examples of the style you are looking for and visual elements you particularly like. Include comments about anything you don't like in the examples you provide. Try not to be that guy who says I just don't like it - can't quite put my finger on why...

The example wireframe that follows is for entertainment only. Any relationship to real infographics real or imagined is coincidental:

If you are including graph-based data, choose your charts carefully (tip: pie charts are often bad). I found this neat flow-chart for choosing what style of graph to use the other day - from Advanced Presentations by Design by Andrew Abela:

Advanced Presentations by Design - choosing a chart type

4. Consider interactivity for widgets

Any time you are working with data online, you have opportunities to provide your users with interactivity. Sometimes, static infographics are plenty enough to get links and sometimes you will get significantly more if you are providing a widget that allows people to offer their visitors interesting functionality.

You don't always have to build this yourself. We recently started working with Tableau Software whose business intelligence software has a kick-ass free, public version that is really cool for just dropping in data and creating widgets for embedding. Here's a subset of the UK politicians on Twitter data:

5. Quirky is at least as important as correct

You all read the internet. You know the power of random facts, cute animals, in-jokes and comedy references. It's generally not enough to present just the raw facts - interesting comparisons and strong imagery improve the shareability of any piece. We are all wired to remember (and therefore to repeat) comparisons better than plain numbers.

I'm still working on which elements of my infographic might make for quirky comparisons. For example, did you know that an Oscar is the same height as an adult pygmy marmoset monkey? From a client's recent Oscars infographic:

Everything you wanted to know about the Oscars (infographic)
Source: LocateTV

6. Know who your targets are

Finishing on a couple of strong SEO points, if your goals are improved rankings, you are doing this primarily for links (and if you are doing it for branding purposes, the sharing is critical). So you need to know who your targets are and find a way to reach them. If your target market happens to overlap with Reddit, StumbleUpon etc. then they are obviously going to be great, but don't forget to drop people in your niche a line as well.

Bonus tip: don't forget the infographic fans.

7. Provide the embed code (with a link)

You want to provide the embed code for two reasons:

  1. to make it easy for non-tech-savvy bloggers to share your content
  2. to make sure (as far as possible) that you get a link out of it

If you can style and include the link in a relevant way (especially if it links to more data or more information) you increase the chance that the people embedding your content will embed the link along with it. If you want to go even further, you could provide your graphic under a Creative Commons Attribution license.


Please keep the comments for discussions of techniques and ideas, not for politics. Any political comments included above are for amusement only and may or may not reflect the political views of the author, or anyone else.

Technorati Tags

, , ,

Do you like this post? Yes No


Posted by great scott!

Test, test, test! That's the mantra these days. Conversion Rate Optimization is the buzzword on everybody's lips (and tweets). So why are we telling you NOT to test?  Well, we're not, we're just saying to be smart about it.

People often get a testing platform ready to roll and then start obsessing over just how intricate they can get with multi-variate tests...it's a walk before you crawl scenario. Start with the big picture: A/B tests of major page layouts, even MVTs on major design changes. Those things can yield MAJOR uplifts in conversions and they're the things you need to focus on before you worry about what color font you use in your H1 tag and the 0.0001% lift you get from it.

We're not saying small changes and new recipes from complex MVTs can't yield meaningful results, we're just saying to start with the big picture and work on the details later.




Do you like this post? Yes No


Posted by Glen Allsopp

Despite my love for SEO and my presence in the industry for almost 5 years, I have to admit that I barely followed the latest trends over the last 12 months. 95% of SEO related feeds disappeared from my Google Reader account and I stopped manually checking some of the biggest resources in this niche.

The main reason for this is that I no longer work with clients so new tactics and many advanced SEO methods didn't matter to me that much. I was also at the point where I felt I was getting overloaded with the same information or bad advice, instead of sticking with the basics and going with what I know.

Instead of reading 30+ SEO feeds per day and watching every Matt Cutts video like it was a direct message from God, I shut out all the noise and just started building websites around things I love. In the 12 months since going solo I've had more success than the previous four years and I've gained rankings for a large number of very competitive keyphrases.

I'm not suggesting that you ignore the industry and try everything yourself, as there is a lot of good information out there (especially from the likes of SEOmoz, Aaron, Sebastian, Rishi and David).

What I do suggest is that you go with what works and stick to it consistently, rather than constantly looking for magic-bullets to increase your rankings. Today I want to share four things that have been working very well for me in increasing my own rankings.

1. Get People "Googling" Your Brand

Many people may disagree that this is useful in improving your rankings, but I've seen far too many examples of this tactic working well to dismiss it. I stumbled upon this idea when I released a free eBook which received thousands of downloads, and mentioned a website of mine while mistakenly forgetting to link to it.

Because the site in question was an integral part of the guide, people started "Googling" the phrase. Within the first 30 days of launching the site there had already been 500 people searching for it in Google and landing on the domain.

The reason I say this is because this website ranked 2nd in Google for its main keyphrase very, very quickly, without the link juice to usually grant such a high ranking. The site literally had 5 links compared to the hundreds that competing websites had which were also much older.

Thinking about this logically, it makes sense that Google and other search engines would want to rank a page highly when people are searching for the brand name directly. I believe that because so many people were looking for the site and having to go to page 3 or 4 to find it, the rankings improved because Google want to show the best results to their users.

Google have said that this does play a part in the algorithm, but I was surprised at how big an effect it had. I don't recommend you do this for all sites, but if you release something or mention a product, try just mentioning the name and not linking to the site (not always, of course). Get people searching for your brand / domain directly and see what that does to your rankings.

2. Monitor Repeat Sellers on Flippa.com

I was contemplating whether or not to reveal this as it has given me some ridiculously awesome link ideas, but I try to provide as much value as I can, so here goes. If you head on over to Flippa you can find people buying and selling a lot of successful and high ranking websites.

What I've noticed is that some people are selling a lot of content websites that are ranking for great phrases very quickly and very easily. If you look hard enough you can find sites making $5,000+ per month from rankings they've achieved in just 2-3 months.

Instead of buying these sites in all cases, I've simply looked at where the backlinks are coming from and figured out how the seller is able to duplicate them so easily. I've seen sites ranking with nothing but spammy chinese blog links and other sites ranking with freely available link sources and making a lot of money.

If you have the time to look around, there are some real link gems to be found.

3. Utilise Guest Blogging in Your Niche

In 2009 I wrote more personal development related guest posts than anybody else and in return built a blog with over 6,000 subscribers. I recently sold the site for a mid five-figure fee, but still use this tactic for a number of other sites. (I know Youmoz links are nofollow, so I'm not using this as an example).

Apart from ranking number one in Google for "Guest Blogging" (;)), the tactic allowed me to rank on the first page of Google for two phrases which each get over 30,000 exact searches per month. One of which, was the phrase personal development.

I've wrote a 2,000+ word post on guest blogging over here so I'm not going repeat everything I said there, but utilising this method is very simple:

  • Find the top blogs in your niche and see if they have clear opportunities for guest posting. If not, contact them. If so, contact them.
  • Perform Google searches like niche "guest post" or niche "write for us" to find more sources for your content
  • Once you get an opportunity, write an excellent article and send it off to the editor / site owner. I prefer to send my posts as text files with HTML inside so it's easy for them to paste into Wordpress and keeps your links intact.
  • Put a non-spammy, anchor text link in the bottom of the guest post which will not only be great for rankings but also send traffic to your site
  • You get links and traffic, and the site owner gets excellent, free content for their community

I have noticed a few big name SEO's abusing this already (I won't say who) so I don't know how long this tactic will remain effective, but it's working well for now and is probably hard to algorithmically block in all cases.

4. Dirty Bookmarking Links

I don't know why, but social bookmarking links (even automated ones) are helping some of my sites massively. I don't love using this tactic as it feels kind of dirty but I can't deny that it is working well.

The two instances I find it working best are:

  • 1. On authority sites that have tons of links but need links with more specific anchor text
  • 2. On new sites in small, fairly uncompetitive niches

Trying this for competitive phrases on sites that are either new or don't have many links doesn't seem to be doing much, but for the two examples above I'm amazed at how useful this has been.

I know this won't be for everyone and I would not recommend doing it on a high-profile client site, but definitely test it for yourself. You can buy software that automates the process or you can find people on Digitalpoint who are willing to do it for a small fee.

Now I'm going to spend the next month catching up on the major changes in the SEO industry, so if you have any recommended links, please do share them in the comments.

Glen Allsopp writes for ViperChill which is a blog about viral marketing. He helps people build websites that others naturally want to talk about.


Do you like this post? Yes No


Posted by richardbaxterseo

Technical problems, errors and surprise releases are all regular features in the day to day management of a website when you’re an SEO. There’s no doubt that maintaining a quick, error free and well optimised site can lead to long term traffic success. Here are some of my tips for regular checks you should be doing to stay on top of your website to maximise your search engine performance.

General Error Checking

General errors can crop up continually with any website and left unchecked, their volume could spiral out of control. Working on improving and resolving large numbers of 404 and timeout errors on your site can help search engines minimise the bandwidth used to completely crawl your site. It’s arguable that minimising crawl errors and general accessibility issues can help get new and updated content into search engine indexes more quickly and often, a good thing for SEO!

If you want to get smart with error handling and other crawl issues, start by getting a Google Webmaster Tools account. Take a look at “Crawl errors” found via the “diagnostics” panel after you’ve verified your site:

Webmaster Tools Crawl Errors

Paying particular attention to the “Not found” and “Timed out” reports, it’s wise to test each error with a http header checker online or using a Firefox plug-in such as Live Http Headers or Http Fox. I find that drilling down into the first 100 or so errors, you tend to find a common pattern with many that lead to only a few fixes being required. I like to focus on 404 error pages that have external links first to get maximum SEO value from legacy links.

It’s important to note that sometimes, there’s more to an error report than just the URL listed in the console. I’ve found issues such as multiple redirects ending in a 404 error which is important information to brief your developers, potentially saving them a lot of diagnostics time.

As a side note, be careful how you interpret the “Restricted by robots.txt” reports. Sometimes, those URL’s aren’t directly blocked by robots.txt at all! If you’ve been scratching your head about the URLs in the report, run the http header check. Often, a URL listed in this report is part of a chain of redirects that ends or contains a URL that is blocked by robots.txt.

For extra insight, you should try the IIS SEO Toolkit or running the classic Xenu’s Link Sleuth Crawl both of which can reveal a number of additional problems. Tom wrote a nice article on Xenu and amongst his tips, setting the options to “Treat redirections as errors” is one of my favourites. As well as internal crawl error checking, a site of any size should try to avoid redirects via internal links. From time to time, using Fetch as Googlebot inside Webmaster tools or browsing your site with JavaScript and CSS disabled using Web Developer Toolbar with your user agent set to Googlebot can also reveal hidden problems.

Linking Out to 404 Errors?

Linking out to expired external URLs isn’t great for user experience, and implies perhaps that as a resource, your site is getting out of date. Consider checking your outbound external links for errors by using the “Check external links” setting in Xenu.

Check your outbound external links

Canonicalisation

You spent time and effort specifying rules for canonicalized URLs across your site, but when was the last time you checked the rules you painstakingly devised are still in place? Thanks to the ever evolving nature of our websites, things change. Redirect rules can be left out of updated site releases and your canonicalization is back to square one. You should always be working towards reducing internal duplicate content as a best practice gesture, and without solely relying on the rel=”canonical” attribute.

Checking the following can quickly reveal if you could have a problem:
  • www or non www redirects (choose either, but always use a 301)
  • trailing slash (choose to leave out like SEOmoz, or in, like SEOgadget but don’t allow both)
  • Case redirects – a 301 redirect to all lower case URLs can solve a lot of headaches or title case redirects if you want to capitalise place names like some travel sites do

“Spot checks” of Front End Code, Missing Page Titles and Duplicate Meta

Just every now and again, it’s nice to take another look at your own code. Even if you don’t find a problem that needs fixing, you might find inspiration to make an enhancement, test a new approach or bring your site up to date with SEO best practice.

One quick check I find useful is under “Diagnostics” > “HTML suggestions” in Webmaster tools:

Duplicate title tags in Webmaster tools

Duplicated title tags or meta descriptions or both can reveal problems with your dynamic page templates, missed opportunities or canonicalization issues.

Site Indexation

Site indexation, or the number of pages that receive one visit or more from a search engine in a given period of time, is a powerful metric to quickly assess how many pages on your site are generating traffic.

Aside from the obvious merit in tracking site indexation over time as an SEO KPI, the metric can also reveal unintended indexing issues like leaked tracking or exit URLs on affiliate sites or huge amounts of indexed duplicate content. If the number of pages Google claims to have indexed on your site is vastly different to the site indexation numbers you’re seeing through analytics, you may have found a new problem to solve.

Indexed Development / Staging Servers

Is your staging or development server accessible from outside your office IP range? It might be worth checking that none of your development pages are cached by the major search engines. There’s nothing worse than discovering a ranking development server URL (it does happen!) with dummy products and prices in the database. You just know that customer is going to have a bad time on a development server! If you discover an issue, talk to your development team about restricting access via IP to the staging site or consider redirecting search engine bots to the correct version of your site.

Significant / Recent Changes to Server Performance

Google have put a lot of effort into helping webmasters identify site speed issues and it could make a lot of sense to keep a regular check on your performance if you’re not doing so already. There are a few useful tools out there to help you speed up your site, starting with Google’s “Site performance” reported located under “Labs” in Webmaster tools:

Site speed report in Webmaster tools

It’s good to check out the “Time spent downloading a page (in milliseconds)” report found under “Diagnostics > Crawl stats” in Webmaster tools, too:

Time spent downloading a page

Tackling search engine accessibility issues like errors and canonicalization problems is a really important part of your SEO routine. It’s also a favourite subject of mine! What checks do you carry out regularly to manage the performance of your website? Do you have your own routine? If you manage a large site, or many large sites, what "industrial strength" tools or automated processes do you gain the most insight from?

This is a post by Richard Baxter, Founder and SEO Consultant at SEOgadget.co.uk - a niche UK SEO Agency specialising in helping people and organisations succeed in search. Follow him on Twitter and Google Buzz.

Do you like this post? Yes No