Search Engine Round-up: Subterfuge, Spam & Swings

So we’re only half way through the second month of the year, and already things are heating up in the search engine battle between Bing and Google.

Firstly, Danny Sullivan broke the story that Google was accusing Bing of copying their search results.

For a full, detailed explanation I suggest you read the story here at Search Engine Land, but the basics are this – Google became suspicious that Bing was copying when the top results for some searches were the same even for misspellings and unusual search terms. So they sprang a trap…(!)

Yes, like something out of a Robert Ludlum novel*, Google manipulated their results for nonsense words such as ‘mbzrxpgjys’ and ‘hiybbprqag’, so that a particular honey pot page would show at the top of the search results. When these exact same pages showed up #1 on Bing too, Google had their confirmation.

(*If instead of writing books about kick-ass spies who look like Matt Damon, Ludlum actually wrote about the rather more dull topic of search engine positioning. Which seems unlikely, frankly.)

Once the story broke, Bing explained their side. Yes, the results were the same, they admitted, but because they were watching their users who have the IE toolbar turned on, and that influences the results people see. They were not copying Google.

Instead Bing turned the tables on Google, claiming the whole thing was an attempt to throw up a smokescreen* to avoid the fact that their search results are plagued with spam.

(*See? That’s totally something Jason Bourne would do.)

Which brings us to the second part of this month’s search engine news – Google’s latest attempt to find a way to block spam, particularly from content farms, such as those of Demand Media.

The plan is for a Chrome plugin which will allow users to block certain sites, while sending Google data about those sites so that they can analyze them and use that information to adjust the rankings accordingly.

Will it work? I’m skeptical. The amount of spam out there is tremendous, dwarfing the number of users who will a) use Chrome, b) also have the extension installed and c) use it regularly. However, I couldn’t be happier that at least Google is trying to do something about this mess.

Finally, the latest search engine stats were just released for January and show a 2% point swing from Google to Bing. A blip or a trend? What do you think?

Social Networks and Search – Two Great Tastes that Taste Great Together

As we come to the very cold end of another year, it seems like 2010 could be remembered as the year that the social web and search began to properly work together.
Danny Sullivan of Search Engine Land has a great post with authorative answers from both Bing and Google about how they are integrating social signals from Twitter and Facebook in to their search engine ranking factors.
While you really should read the whole thing, highlights inlcude:
  • Both Bing & Google do use retweets and Facebook posts as a ranking factor
  • They both calculate the authority of the tweeter/poster, and give more/less weight depending
  • Publicly available links on Facebook are tracked by both search engines
This is great stuff, and something we have been anticpating/suspecting for a while now, but it does raise some interesting questions.
For instance, how do they calculate ‘authority’? It’s not likely that it’s simply the sheer number of followers/friends, or the system would be overrun with spammers in no time. More likely it will be a more complex algorithm which takes in to account the ratio of followers to following, the number of times you are mentioned, how active you are, length of time on the network, and so on.
We also don’t know to what extent these social signals affect the rankings. Google has over 200 criteria which go in to ranking a site (PageRank, title tags, alt tags, etc), and these social signals are just one of these many, many different aspects. Don’t expect your site to suddenly jump to #1 because you’ve been retweeted a couple of times.
That said, it is good to have official confirmation of what we have thought for a while, that the social web isn’t in competition with the search side of things, but in fact both should all be considered part of your whole online strategy.

Google Instant – One Month In

I’m sure by now you’ve seen Google Instant, the latest change to the Google search page, which actually updates results as you type in the query, as it has been live for around a month now.

After the initial announcement came the usual flurry of excitement that accompanies every new Google launch. There were the predictable naysayers (from those not involved in SEO) that it meant the death of SEO. Which, by my calculations means SEO has about 42 times as many lives as a cat. The usual suspects, Matt Cutts (of Google) and Danny Sullivan (of Search Engine Land) explain why this is not the case. SEO is still alive and well, much to the chagrin of many a new media expert.

But for me, the bigger change is not so much in the way the search is delivered – Instant is really just an extention of the Search Suggest function – but the increasingly important role of personalization in results.

What this means is that Google is trying to give you more and more the kind of thing they think you will like to see. For instance, John Smith searches for ‘new york hotels’ and clicks on the websites for the Marriott, the Chelsea Hotel, the Hudson Hotel, etc, while Jane Brown searches for ‘new york hotels’ and clicks on the websites for Expedia, Travelocity and Orbitz. So Google learns about what each of them prefers, and tries to tailor the results in future to more closely match what John or Jane like.

Similarly, if you search for ‘zoo’ in San Diego, and you may see San Diego zoo as #1, but travel to Jacksonville and you’ll see it change to Jacksonville zoo. Do a lot of gourmet/food searches, and then search for java and you’ll see coffee sites, but if you search for coding and programming things and search for java you’ll see sites about the Java programming language.

We’ve talked before on here about the incredible wealth of data that Google has. And if you think of Google keeping a record of every search you’ve ever made, and multiply that by the billions of other searches done each month, you can see how the picture they build up of the best search results becomes much clearer.

Of course personalization didn’t begin last month, it’s been an ongoing process for a couple of years now, but it is more and more a factor which needs to be taken in to account. There is no longer a top 10 of search results which should really be considered authorative or definititive. Everyone’s search results will be different, and growing more different as Google tweaks and improves, so we can no longer say you are #3 for this phrase or #1 for for that one.

Instead, we suggest measuring the success of the search engine campaigns by looking more closely at the amount and quality of the search engine traffic. How many visitors came from the search engines? How many pages did they look at? How long did they stay on the site? What was the bounce rate? Did they buy/sign up for the newsletter/request more information? And so on, and so on.

One month in, I have to say we’re very happy comparing the results for our clients against the quality of traffic they were receiving this time last year. In almost every case, the important benchmarks have shown an improvement, which is what we would have thought – because of course the flipside of Google improving the relevancy of their search results is better, more qualified people arriving at the websites.

We have always said that in theory SEO should be win-win-win. If you are looking for a Charleston hotel, Google helps you find that hotel and the hotel gets the business. Everyone is happy. Hopefully this latest update to the process proves to be just another step along that same path.

Google Instant – the Bob Dylan version

Google Now Taking on Facebook

“It is our intention to make this a model for how open a social site should be”

Google is previewing their new Buzz feature as I write this:

And they couldn’t be any more clear that this is a direct challenge to Facebook. With the ability to share photos, geo-tag posts, see who’s near you and more.

It’s no secret that Google would love some of the attention that Facebook is getting on the web. Christmas Day 09 actually saw Facebook pass Google as the most visited site in the world.  And while Google’s own Orkut social site has been a terrible flop (outside of Brazil at least), they have been stealthily building all the blocks of a Facebook competitor piece by piece.

In fact, it’s only the tying together of these various strands which is holding them back. Consider these Google products working in conjunction:
Google Profile
Google Chat
Picasa for photos
Youtube for videos
Reader for articles

and you have the basics of a Facebook-like service already.

And it goes without saying that there are other features which can be tied into these, sharing custom maps, reviewing product pages, the FourSquare-like features of the new Google Buzz, NearMeNow on the iPhone/Droid, etc, etc.

So will it work?

I think it will. Buzz will start rolling out to Gmail users within the hour, and judging by the buzz (sorry) on Twitter, there’s a huge amount of interest already:
http://twitter.com/#search?q=%22Google%20Buzz%22%20OR%20%23Buzz

APIs will be available, and public info will be provided as XML feeds. Anything public will indexed immediately by Google’s real time search. There is a lot of stuff here, even speculation about using Google Voice conversations as part of the Buzz. They have put a lot of thought into spam fighting (and I must say, Gmail spam fighting is great for me). Buzz seems to offer a huge amount of potential, especially if you consider the built in user-base Gmail has.

However, with @replies to tag people, the ability to ‘like’ or comment on posts, photos and updates, many may see this as too close to Facebook to be worthwhile.

So, what do you think? Can Google finally make a success of their social strategy, or is it too similar, too late?



Google Takes on Yelp

Google has never shied away from taking on other companies. Since inception, when Google supplied the search results for Yahoo, and then turned around and beat Yahoo at its own game, through the ‘email wars‘ with Yahoo and Microsoft, to taking on Apple with its own phone(s).

And I think we can now add Yelp to the list.

It was widely reported that last month Yelp wallked away from a Google buy out, an almost done deal worth $550+million. Google seems to have responsed to this snub by stepping up the quality of its own local Place Pages.

I’ve mentioned Google Local pages on here before, but as with all things Google, they never stay still for very long. Besides the existing features, such as photos, maps, coupons and hours, Google has introduced their own ranking system, with rankings based on aggregating comments on sites such as TripAdvisor, Kudzu and Igougo.

For instance, here’s the page for one of our clients in Charleston, Circa 1886 restaurant. Under the heading ‘What people are saying about’ you can read the comments, divided up into categories,  service, meal, staff, atmosphere and wine list, alongside a colored bar similar to the PageRank bar:

(click to enlarge)

and selecting one of the topics will show you more details and comments about that aspect.

More worryingly for Yelp, NextStop and others, Google has also released an iPhone/Android app (with good reviews), Near Me Now, which allows users to see what is nearby, and pulls inthe Place Pages data too.

Of course, Google has had its own notable failures too – Paypal is still a lot more popular than Google Checkout, Orkut has quiet some way to go to dethrone Facebook as King of the Internet, and Craigslist/Ebay are still casting a snooty eye over the upstart that is Google Base.

So what do you think? Has Google made a useful product? Is this it for Yelp? Let us know your thoughts in the comments.

Hubspot Study Suggests Blogs Best Social Media for Leads

A new study from Hubspot, who canvessed 167 small to medium sized business owners and executives,  is both encouraging and confusing.

The percentage of leads from each source was broken down as:

Other (including public relations and print and online display advertising) 25%
SEO 16%
Email Marketing 14%
Pay Per Click 13%
Telemarketing 9%
Blogs+Social Media 8%
Trade Shows 8%
Direct Mail 7%

I find this very encouraging – particularly as we offer services for PR, SEO, email, PPC and Social Media, that’s 76% of the leads right there! – it’s certainly good to know that more and more businesses are trying a variety of methods to generate leads, rather than sticking to whatever they have done in the past. That has certainly been my feeling from talking to clients in all kinds of businesses lately.

However, I’m also slightly skeptical of the accuracy, for a couple of reasons. Firstly, if you’re in are a small or medium sized business yourself, you know the difficulty in pinning down exactly how a lead found you.

If they remember you from a trade show, but Google* you to find your contact info, does that count as SEO or a trade show?

If you send offers via both email and direct mail, as many of our clients do, which one gets the credit for the sale?

And Mike Volpe, Hubspot’s VP of marketing, even goes on to say that there are additional benefits to blogging,

“Not only are you creating a community around blog articles, but all those articles get indexed by search engines, so blogging has elements of search engine optimization (SEO) as well”

So how can we accurately claim that SEO is 16% vs Blogging’s 8%?  I don’t feel that we can. But I also don’t see that as a problem.

One thing we try to stress here at Step Ahead is that your marketing efforts, particularly onlne, will help each other. Being active on Twitter can drive traffic to your blog, which can help with your SEO, which can get people to sign up for your email marketing, which can inform people about your trade show appearances, which, well, you get the idea.

One final thing which jumped out at me from this was this statistic:

Companies with less than 50 employees earmarked more than three times as much of spending on blogging and social media than larger ones, and 36% more on SEO.

On the Internet, there is no reason the small companies can’t compete with the Big Boys. In fact, the lack of barriers to getting things accomplished, which plague many a large corporation, can be to your advantage. If you aren’t already blogging, tweeting, facebook-ing, etc, you can start right now. You don’t need to organize all the different departments, have a bunch of strategy meetings, get the lawyers to overlook things, and waste months of everybody’s time. Just sign up for an account and jump in.

So, what are you waiting for?

*I really don’t like using Google as a verb, but everyone else does it!

Make Google’s Results Your Own

This looks to be pretty major -Starting today, Google is adding a wiki function to the search results,

“Have you ever wanted to mark up Google search results? Maybe you’re an avid hiker and the trail map site you always go to is in the 4th or 5th position and you want to move it to the top. Or perhaps it’s not there at all and you’d like to add it. Or maybe you’d like to add some notes about what you found on that site and why you thought it was useful. Starting today you can do all this and tailor Google search results to best meet your needs.”

As with all things Google related, people are pretty quick to jump in with their opinions. Michael Arrington over at TechCrunch is not a fan,

“Google search wasn’t broken. It’s one of the few things on the Internet that isn’t. I love it, as does 62% of everyone on the Internet. This new stuff is a mess of arrows and troll comments and stuff moving around the page.”

While someone (sorry, I couldn’t find a name on the blog) over at I’ve Said Too Much, has responded to that with a post simply titled ‘Arrington is Wrong’,

“Google seeks to build a massive distributed curated search into which we are all adding intelligence without ever being aware of it. It is, I would contend, the Big Thing At Google For 2009.”

Meanwhile, over at eWeek, they’re a lot more enthusiastic, seeing it as a boon for users, advertisers and, of course, Google,

“That’s Google’s genius stroke; we believe SearchWiki is letting us control our search destiny, but Google gets to keep putting up more search ads in front of us. Google wants us to find what we’re looking for, and now it has provided a way to keep us in Google.com to do so.”

I’m personally not sure right now.

I think it will be clearly used for Google to start collecting yet more information about what people think of the search results – with the positives and negatives that suggests. People will try and game the system, promoting themselves and so on. If, however, enough people use it, then hopefully the ‘wisdom of crowds’ will help to improve things by adding that human element which is often missing from Google.

That said, I can’t help but agree with Arrington that it looks a mess. Remember how clean Google used to be?

When they first launched it was one of the major things that set them apart. All that lovely white space. The sponsored links were completely separate from the natural SERPs. No nasty banner ads. Just good search results.

But now, between the maps, local search, images, addresses and so on – these additional buttons just seem like yet more clutter.

Will it work? I don’t know. If I search for something, I’m used to Google telling me what I need to know. Using their example from above, I would not use Google to revisit a trail map site time after time, I would bookmark it instead, either on my PC or with Delicious.

I can see times when it would be useful to remove particularly bad results, but how often am I going to suggest a site be added?

And the notes I suspect, will be more trolling than useful unfortunately. I’ve tried a few so far, and there’s nothing that enhances my searching at all. A search for Liverpool FC, for instance, just has 3 right now:

Comment by: Searcher, 9:05am – searching: lfc
“great”

Comment by: Mike, 6:41am – searching: liverpool
“Liverpool FC”

Comment by: 360spin, 8:39am – searching: liverpool
“Wow!”

How do they help me at all?

Perhaps Google is threatened by the growth of social networks and feels that is one area search can be improved. I’m not so sure.

What do you think?

Some (Limited) Praise for the Google AdWords Changes

In the latest round of updates at the end of last week, Google announced that they would (finally!) be adding more detail about where your clicks are coming from:

“Previously, these pages divided statistics into two categories: search, which included Google and search partners, and the content network.
Now, we show one set of statistics for Google and another set aggregating search partner performance. Search partners include AOL, Ask.com, and many other search sites around the web. ”

This is a major change, comparable to when Google started showing where exactly your ads where coming from in the Content network.

That was a huge step forward, and one that made sense for Google. Previously advertisers were skeptical about throwing money down a black hole which included some very, um, shady Made For AdSense sites alongside the high quality sites they may have wanted to target.

However, these latest changes don’t go far enough. Yet.

We can now see how Google stacks up against the other search partners, but not how the individual partners (Ask, AOL, etc) are performing individually. Rich, over at Destilled is asking the question, “Have Google Shot Themselves in the Foot?”, and it’s a valid point.

Here’s the data for one of the accounts we manage:

(I removed the campaign names for anonymity for my client)

As you can see, in each case the cost per click for the search partners is higher, up to 25% higher, than it is on Google, but even more importantly, the number of conversions (final column) are way down. So I’m paying more, and getting less. That is why all the Search partner ads are now set to ‘Off’. I’d rather spend where it is working.

So, what happens now?

Well I suspect that that many others will follow suit and shut off the complete search network, for example, see this thread at Webmaster World:

At first glance it looks like 90% of my conversions are from google search only not the network.”

“Wow, just split stats on an account. Bye bye Search Network!”

“We totally disabled Partners in a few campaigns after seeing 100 to 200% higher conversion costs.
No wonder they didn’t show this data for so long.”

And if that happens, I’d have to assume that Google will be forced to show the search network in greater details, if only due to pressure from their partners. If AOL is performing well, for instance, they’re unlikely to be happy about being cut out due to the deficiencies of other sites.

However, for now we have to deal with what we have, and I’m at least glad that I’ve been able to learn this much.

How about you? How do your stats measure up across the different sites?

5 More Products from the Makers of Mail Goggles

Google, always looking out for us, has a new feature available for Gmail. Mail Goggles – love the name! – asks you a series of math problems before sending your email, so that those who have maybe had a little too much to drink won’t send anything they’ll regret later.

A great idea, you’ll no doubt agree.

We gave some thought to 5 more features our Internet Overlords should take a look at, in order to save us from ourselves:

Facebook Heartbreak Timecapsule – When your Relationship Status changes from ‘In a Relationship’ to ‘Single’, Facebook stores all your wall posts, messages, pokes, etc for a period of 9 months, and then allows you to decide whether or not you really want to tell her that she’ll regret it and you’ll never stop loving her.

Ebay ELIZA - turned on automatically after you look at two or more kitsch items costing over $5. The software will nag you with AI intelligence , “Do you really need that? Where will you put it? Shouldn’t we fix the ____ first?” until you finally give up and go to bed.

iTunes Rock Snob – Interrupts your playlists with sarcastic comments about your music choices, “More Air Supply?! Great”, and suggests obscure German bands of the 70s from the iTunes store instead.

MySpace for Dads – let’s you design and play with your page as much as you like, but blocks your kid’s friends from seeing it so they don’t have to live a life of shame at school.

Yahoo Happy News – filters out any news items with mentions of the economy, mortgages, Iraq, or Paris Hilton. Currently a blank page.

Can you think of any more you’d like to see?

Google Adwords – Tweaking All the Way to the Bank

Google announced on Monday that the Quality Score Improvements would be going live this week, with what they claim are tweaks which will benefit both advertisers and search users.

Well, they would, wouldn’t they!?

The changes, removing the ‘Inactive for Search Status’, real time ‘Quality Score’ and new ‘First Page Bid Estimates’ seem to me to be more about generating extra revenue than improving quality.

Even among those SEMs who work with AdWords for a living there is a lot of confusion about what is going on. A lot of the targeting improvements seem, well, arbitrary at best. For instance, here’s one of the search terms from an account I manage (click the image to enlarge):

It’s not ‘Great’, but a fairly solid 7/10 ‘OK’. Even some nice words of encouragement,

What should I do?
Keep it up! Your keyword, ad text, and landing page quality are high.”

So, how is the ad performing? Let’s see:

Hmm, the ad is not showing. Must be the bid then, right?

Well, no:

Estimated bid to show on the first page: $1.25 Based on the quality score below
Your bid: $1.75 Max CPC

I have an keyword that is rated at 7/10, and I’m bidding 40% more than Google estimates I need to to be on the first page, and yet, “No Ad is Showing”.

No wonder people are confused.

If Google is not showing the ads, then they’ll lose money then. Well, I could be wrong, but I don’t think so.

I’ve been watching my keywords pretty closely this week to see what would happen, and Google’s main suggestion seems to be that I raise my bids. Funny that.

How about this one for instance:

That’s an exact match keyword, which fits the site perfectly, has a historically high click-thru rate and used to average less the $1/click. Google now says “Bid is below first page bid estimate of $25.00″. $25! And yet yesterday, it was in the 1.5 average position.

That’s an extreme one, but we’ve seen maybe 30-40% of our keywords being told they should raise the bid according to the first page bid estimate. If that is happening across other peoples’ accounts, and it appears that it is, then we are going to see the average cost of bids being pushed up. Nobody wants to be on the 2nd or, gasp, 3rd page of results.

I’ve been working with Pay Per Click ads for a good number of years now (hence the GoTo swag shown above), and I think we’ve been down this road before. This is why many people switched to Google AdWords from Goto/Overture in the first place, because the constant battle to be in the top spots drove the cost up and up. Google was a breath of fresh air. They really did reward quality instead of who has the deepest pockets. After all, if Ad1 was paying $1, and Ad2 only $0.50 but had 3 times as many clicks, then Google still made more money. Everyone was happy. That is why I’m worried about the potential bidding wars this may lead to.

Particularly if the Yahoo-Google deal is finalized and approved.

Maybe I’m wrong. It’s still very early days and these may just be some kinks which will have to be worked out. But given Google’s near monopoly and unwillingness to listen recently, I can’t say I’m overly optimistic.


Are you an AdWords Advertisers? Let me know what you’re seeing or what you think.