Search Engine Round-up: Subterfuge, Spam & Swings

So we’re only half way through the second month of the year, and already things are heating up in the search engine battle between Bing and Google.

Firstly, Danny Sullivan broke the story that Google was accusing Bing of copying their search results.

For a full, detailed explanation I suggest you read the story here at Search Engine Land, but the basics are this – Google became suspicious that Bing was copying when the top results for some searches were the same even for misspellings and unusual search terms. So they sprang a trap…(!)

Yes, like something out of a Robert Ludlum novel*, Google manipulated their results for nonsense words such as ‘mbzrxpgjys’ and ‘hiybbprqag’, so that a particular honey pot page would show at the top of the search results. When these exact same pages showed up #1 on Bing too, Google had their confirmation.

(*If instead of writing books about kick-ass spies who look like Matt Damon, Ludlum actually wrote about the rather more dull topic of search engine positioning. Which seems unlikely, frankly.)

Once the story broke, Bing explained their side. Yes, the results were the same, they admitted, but because they were watching their users who have the IE toolbar turned on, and that influences the results people see. They were not copying Google.

Instead Bing turned the tables on Google, claiming the whole thing was an attempt to throw up a smokescreen* to avoid the fact that their search results are plagued with spam.

(*See? That’s totally something Jason Bourne would do.)

Which brings us to the second part of this month’s search engine news – Google’s latest attempt to find a way to block spam, particularly from content farms, such as those of Demand Media.

The plan is for a Chrome plugin which will allow users to block certain sites, while sending Google data about those sites so that they can analyze them and use that information to adjust the rankings accordingly.

Will it work? I’m skeptical. The amount of spam out there is tremendous, dwarfing the number of users who will a) use Chrome, b) also have the extension installed and c) use it regularly. However, I couldn’t be happier that at least Google is trying to do something about this mess.

Finally, the latest search engine stats were just released for January and show a 2% point swing from Google to Bing. A blip or a trend? What do you think?

Social Networks and Search – Two Great Tastes that Taste Great Together

As we come to the very cold end of another year, it seems like 2010 could be remembered as the year that the social web and search began to properly work together.
Danny Sullivan of Search Engine Land has a great post with authorative answers from both Bing and Google about how they are integrating social signals from Twitter and Facebook in to their search engine ranking factors.
While you really should read the whole thing, highlights inlcude:
  • Both Bing & Google do use retweets and Facebook posts as a ranking factor
  • They both calculate the authority of the tweeter/poster, and give more/less weight depending
  • Publicly available links on Facebook are tracked by both search engines
This is great stuff, and something we have been anticpating/suspecting for a while now, but it does raise some interesting questions.
For instance, how do they calculate ‘authority’? It’s not likely that it’s simply the sheer number of followers/friends, or the system would be overrun with spammers in no time. More likely it will be a more complex algorithm which takes in to account the ratio of followers to following, the number of times you are mentioned, how active you are, length of time on the network, and so on.
We also don’t know to what extent these social signals affect the rankings. Google has over 200 criteria which go in to ranking a site (PageRank, title tags, alt tags, etc), and these social signals are just one of these many, many different aspects. Don’t expect your site to suddenly jump to #1 because you’ve been retweeted a couple of times.
That said, it is good to have official confirmation of what we have thought for a while, that the social web isn’t in competition with the search side of things, but in fact both should all be considered part of your whole online strategy.

Bing & Facebook, Sitting in a Tree…

Well it’s all been go, go, go with Facebook recently – the ongoing battle with Google over your contact list, copying Gmail / incorporating email (depending on your bias), opening a new $450 million data center in NC – but for me, one of the most intriguing developments is the Bing search integration.
The announcement, over at the Bing blog, covers all the ins and outs, but the main part that will affect the everyday user are the social features such as enhanced profile searches and sharing your Facebook information while searching Bing.
Firstly, in light of all the privacy criticism, it should be pointed out that these new features are all opt-in. This is what the experts term A Good Thing. Secondly, I think this is a potential first step towards greater personalization of search results and a widening of social search.
Bing is trying to improve search results with information from Facebook ‘likes’. Which makes sense. If I do a search for ‘New York hotels’, for instance, Bing should be able to enhance the standard results with the hotels which any of my Facebook friends have liked. And with no disrespect to Microsoft, I’m much more likely to be influenced by what my friends and family suggest than what Bing does.
Of course Google has been trying to incorporate “results from people in your social circle” for a while now, but with Facebook being far and away the biggest social network (at least in the USA), the potential for Bing is that much greater.
So what do you think? Will Bing be able to steal a march here and claw back some search share? Will you be willing to share your Facebook info with Microsoft? Does the whole thing sounds a bit Big Brother-esque to you? Let us know!

Google Now Taking on Facebook

“It is our intention to make this a model for how open a social site should be”

Google is previewing their new Buzz feature as I write this:

And they couldn’t be any more clear that this is a direct challenge to Facebook. With the ability to share photos, geo-tag posts, see who’s near you and more.

It’s no secret that Google would love some of the attention that Facebook is getting on the web. Christmas Day 09 actually saw Facebook pass Google as the most visited site in the world.  And while Google’s own Orkut social site has been a terrible flop (outside of Brazil at least), they have been stealthily building all the blocks of a Facebook competitor piece by piece.

In fact, it’s only the tying together of these various strands which is holding them back. Consider these Google products working in conjunction:
Google Profile
Google Chat
Picasa for photos
Youtube for videos
Reader for articles

and you have the basics of a Facebook-like service already.

And it goes without saying that there are other features which can be tied into these, sharing custom maps, reviewing product pages, the FourSquare-like features of the new Google Buzz, NearMeNow on the iPhone/Droid, etc, etc.

So will it work?

I think it will. Buzz will start rolling out to Gmail users within the hour, and judging by the buzz (sorry) on Twitter, there’s a huge amount of interest already:
http://twitter.com/#search?q=%22Google%20Buzz%22%20OR%20%23Buzz

APIs will be available, and public info will be provided as XML feeds. Anything public will indexed immediately by Google’s real time search. There is a lot of stuff here, even speculation about using Google Voice conversations as part of the Buzz. They have put a lot of thought into spam fighting (and I must say, Gmail spam fighting is great for me). Buzz seems to offer a huge amount of potential, especially if you consider the built in user-base Gmail has.

However, with @replies to tag people, the ability to ‘like’ or comment on posts, photos and updates, many may see this as too close to Facebook to be worthwhile.

So, what do you think? Can Google finally make a success of their social strategy, or is it too similar, too late?



Google Takes on Yelp

Google has never shied away from taking on other companies. Since inception, when Google supplied the search results for Yahoo, and then turned around and beat Yahoo at its own game, through the ‘email wars‘ with Yahoo and Microsoft, to taking on Apple with its own phone(s).

And I think we can now add Yelp to the list.

It was widely reported that last month Yelp wallked away from a Google buy out, an almost done deal worth $550+million. Google seems to have responsed to this snub by stepping up the quality of its own local Place Pages.

I’ve mentioned Google Local pages on here before, but as with all things Google, they never stay still for very long. Besides the existing features, such as photos, maps, coupons and hours, Google has introduced their own ranking system, with rankings based on aggregating comments on sites such as TripAdvisor, Kudzu and Igougo.

For instance, here’s the page for one of our clients in Charleston, Circa 1886 restaurant. Under the heading ‘What people are saying about’ you can read the comments, divided up into categories,  service, meal, staff, atmosphere and wine list, alongside a colored bar similar to the PageRank bar:

(click to enlarge)

and selecting one of the topics will show you more details and comments about that aspect.

More worryingly for Yelp, NextStop and others, Google has also released an iPhone/Android app (with good reviews), Near Me Now, which allows users to see what is nearby, and pulls inthe Place Pages data too.

Of course, Google has had its own notable failures too – Paypal is still a lot more popular than Google Checkout, Orkut has quiet some way to go to dethrone Facebook as King of the Internet, and Craigslist/Ebay are still casting a snooty eye over the upstart that is Google Base.

So what do you think? Has Google made a useful product? Is this it for Yelp? Let us know your thoughts in the comments.

Twitter to Challenge Google for Search (no, really!)

twitterFinally, some big news about Twitter which doesn’t involve the company being bought by Google Microsoft Yahoo Apple whoever this week. Instead, at a Cnet panel last week Santosh Jayaram, Vice President, Business Operations, mentioned that Twitter will begin crawling the links in tweets, and then indexing those pages.

As Techcrunch rightly points out, this isn’t a matter of Twitter trying to beat Google at their main strength, traditional search, it is instead a brand new paradigm, with the promise of human-influenced, real-time search results.

Little is known about the details but there were comments made about weighting links based on influence (a la Google’s Page Rank system), but no word on how that would be done yet.

One thing is certain though, this finally offers Twitter the chance to prove its real worth. All those big companies sniffing around for the past few weeks weren’t doing so as a result of the buzz around Twitter (despite Oprah‘s growing disinterest after an initial flurry of tweets, the number of new users continues to climb), but for the oodles of data Twitter has unprecedented access to. As with Google’s purchase of Urchin a few years ago, seeing how real people behave online is inherently valuable.

How Will It Work?

Short answer: we’ll have to wait and see. Longer answer: I’m not sure, but I’d like to see something like this. A real-time search engine,which would compliment Google rather than replace it, where real people invisibly influence the search results.

For example, a current Twitter search for ‘obama‘ has thousands upon thousands of results with dozens more each few seconds. Great if you want to know what people are saying, not so useful if you want to discover what exactly they are reacting to, as you have to wade through page after page to see all the links.

Or ‘manny ramirez‘ – you’ll see lots of comments about his drug violation, and many of them also have links. The trouble is that with URL shortening, you can see what looks like 10 different links all going to the same article.

Wouldn’t it be great to have this page split into two columns, one with comments and another with the most popular linked-to articles/websites?

Of course, it will also become subject to the scourge of the internet – spammers – but that is where the relative influence of the writer comes in.

It’s easy to forget now, but before Google search engines were filled with spam. Yes, it still appears throughout the search results now,even on Google, but nothing like it was back in 1997/8, and that is largely because of Google’s PageRank system. For a detailed mathematical explanation see here, but basically Google used links to a webpage as a way of measuring its popularity,but with the very important caveat that not all links are equal.

If I run a golf course for example, a link from PGA.com would be far more valuable than a link from your old Geocities page – PGA.com is a popular site, and in a related field. A similar thing could be done for Twitter search, a link from ESPN columnist and professional RedSox fan Bill Simmons to a Manny Ramirez article would be worth more than one from Oprah, even though she has more followers.

And of course, Twitter search wouldn’t have to be limited to websites either. As with Google’s move towards universal search, it could easily incorporate videos, mp3s, photos, and anything else that people are discussing or linking to.

Something like this could be hugely useful, if implemented correctly. Despite Google’s success, the missing piece in their search has always been a human element. In fact they incorporate the Open Directory Project listings into their search algorithm as a way of helping to inject some personal judgment.

A search engine that shows exactly what is happening around the world right now, as discussed by real people? I can’t wait!

So what do you think? Am I missing the point? Is this another potential ‘Google-killer’ that will die on the vine? Please share your thoughts or comments.

Hubspot Study Suggests Blogs Best Social Media for Leads

A new study from Hubspot, who canvessed 167 small to medium sized business owners and executives,  is both encouraging and confusing.

The percentage of leads from each source was broken down as:

Other (including public relations and print and online display advertising) 25%
SEO 16%
Email Marketing 14%
Pay Per Click 13%
Telemarketing 9%
Blogs+Social Media 8%
Trade Shows 8%
Direct Mail 7%

I find this very encouraging – particularly as we offer services for PR, SEO, email, PPC and Social Media, that’s 76% of the leads right there! – it’s certainly good to know that more and more businesses are trying a variety of methods to generate leads, rather than sticking to whatever they have done in the past. That has certainly been my feeling from talking to clients in all kinds of businesses lately.

However, I’m also slightly skeptical of the accuracy, for a couple of reasons. Firstly, if you’re in are a small or medium sized business yourself, you know the difficulty in pinning down exactly how a lead found you.

If they remember you from a trade show, but Google* you to find your contact info, does that count as SEO or a trade show?

If you send offers via both email and direct mail, as many of our clients do, which one gets the credit for the sale?

And Mike Volpe, Hubspot’s VP of marketing, even goes on to say that there are additional benefits to blogging,

“Not only are you creating a community around blog articles, but all those articles get indexed by search engines, so blogging has elements of search engine optimization (SEO) as well”

So how can we accurately claim that SEO is 16% vs Blogging’s 8%?  I don’t feel that we can. But I also don’t see that as a problem.

One thing we try to stress here at Step Ahead is that your marketing efforts, particularly onlne, will help each other. Being active on Twitter can drive traffic to your blog, which can help with your SEO, which can get people to sign up for your email marketing, which can inform people about your trade show appearances, which, well, you get the idea.

One final thing which jumped out at me from this was this statistic:

Companies with less than 50 employees earmarked more than three times as much of spending on blogging and social media than larger ones, and 36% more on SEO.

On the Internet, there is no reason the small companies can’t compete with the Big Boys. In fact, the lack of barriers to getting things accomplished, which plague many a large corporation, can be to your advantage. If you aren’t already blogging, tweeting, facebook-ing, etc, you can start right now. You don’t need to organize all the different departments, have a bunch of strategy meetings, get the lawyers to overlook things, and waste months of everybody’s time. Just sign up for an account and jump in.

So, what are you waiting for?

*I really don’t like using Google as a verb, but everyone else does it!

Hackers target Twitter

What do Barack Obama, Britney Spears, and Bill O’Reillyall have in common? All were among the 33 celebrities who had their Twitter accounts hacked yesterday.

This followed hot on the heels of the weekend’s Twitter phishing attempts, and a number of reports of people being DM’d affiliate links and marketing tools.

What can you do?

  • Treat your Twitter account like your email, don’t give out your password to third party sites.
  • Change your password regularly.
  • If you receive a spammy DM from a friend, check if they really sent it. It could be that their account is compromised without their knowledge.
  • Beware of phishing. Check the URL of the site. Be sensible!

Make Google’s Results Your Own

This looks to be pretty major -Starting today, Google is adding a wiki function to the search results,

“Have you ever wanted to mark up Google search results? Maybe you’re an avid hiker and the trail map site you always go to is in the 4th or 5th position and you want to move it to the top. Or perhaps it’s not there at all and you’d like to add it. Or maybe you’d like to add some notes about what you found on that site and why you thought it was useful. Starting today you can do all this and tailor Google search results to best meet your needs.”

As with all things Google related, people are pretty quick to jump in with their opinions. Michael Arrington over at TechCrunch is not a fan,

“Google search wasn’t broken. It’s one of the few things on the Internet that isn’t. I love it, as does 62% of everyone on the Internet. This new stuff is a mess of arrows and troll comments and stuff moving around the page.”

While someone (sorry, I couldn’t find a name on the blog) over at I’ve Said Too Much, has responded to that with a post simply titled ‘Arrington is Wrong’,

“Google seeks to build a massive distributed curated search into which we are all adding intelligence without ever being aware of it. It is, I would contend, the Big Thing At Google For 2009.”

Meanwhile, over at eWeek, they’re a lot more enthusiastic, seeing it as a boon for users, advertisers and, of course, Google,

“That’s Google’s genius stroke; we believe SearchWiki is letting us control our search destiny, but Google gets to keep putting up more search ads in front of us. Google wants us to find what we’re looking for, and now it has provided a way to keep us in Google.com to do so.”

I’m personally not sure right now.

I think it will be clearly used for Google to start collecting yet more information about what people think of the search results – with the positives and negatives that suggests. People will try and game the system, promoting themselves and so on. If, however, enough people use it, then hopefully the ‘wisdom of crowds’ will help to improve things by adding that human element which is often missing from Google.

That said, I can’t help but agree with Arrington that it looks a mess. Remember how clean Google used to be?

When they first launched it was one of the major things that set them apart. All that lovely white space. The sponsored links were completely separate from the natural SERPs. No nasty banner ads. Just good search results.

But now, between the maps, local search, images, addresses and so on – these additional buttons just seem like yet more clutter.

Will it work? I don’t know. If I search for something, I’m used to Google telling me what I need to know. Using their example from above, I would not use Google to revisit a trail map site time after time, I would bookmark it instead, either on my PC or with Delicious.

I can see times when it would be useful to remove particularly bad results, but how often am I going to suggest a site be added?

And the notes I suspect, will be more trolling than useful unfortunately. I’ve tried a few so far, and there’s nothing that enhances my searching at all. A search for Liverpool FC, for instance, just has 3 right now:

Comment by: Searcher, 9:05am – searching: lfc
“great”

Comment by: Mike, 6:41am – searching: liverpool
“Liverpool FC”

Comment by: 360spin, 8:39am – searching: liverpool
“Wow!”

How do they help me at all?

Perhaps Google is threatened by the growth of social networks and feels that is one area search can be improved. I’m not so sure.

What do you think?

Some (Limited) Praise for the Google AdWords Changes

In the latest round of updates at the end of last week, Google announced that they would (finally!) be adding more detail about where your clicks are coming from:

“Previously, these pages divided statistics into two categories: search, which included Google and search partners, and the content network.
Now, we show one set of statistics for Google and another set aggregating search partner performance. Search partners include AOL, Ask.com, and many other search sites around the web. ”

This is a major change, comparable to when Google started showing where exactly your ads where coming from in the Content network.

That was a huge step forward, and one that made sense for Google. Previously advertisers were skeptical about throwing money down a black hole which included some very, um, shady Made For AdSense sites alongside the high quality sites they may have wanted to target.

However, these latest changes don’t go far enough. Yet.

We can now see how Google stacks up against the other search partners, but not how the individual partners (Ask, AOL, etc) are performing individually. Rich, over at Destilled is asking the question, “Have Google Shot Themselves in the Foot?”, and it’s a valid point.

Here’s the data for one of the accounts we manage:

(I removed the campaign names for anonymity for my client)

As you can see, in each case the cost per click for the search partners is higher, up to 25% higher, than it is on Google, but even more importantly, the number of conversions (final column) are way down. So I’m paying more, and getting less. That is why all the Search partner ads are now set to ‘Off’. I’d rather spend where it is working.

So, what happens now?

Well I suspect that that many others will follow suit and shut off the complete search network, for example, see this thread at Webmaster World:

At first glance it looks like 90% of my conversions are from google search only not the network.”

“Wow, just split stats on an account. Bye bye Search Network!”

“We totally disabled Partners in a few campaigns after seeing 100 to 200% higher conversion costs.
No wonder they didn’t show this data for so long.”

And if that happens, I’d have to assume that Google will be forced to show the search network in greater details, if only due to pressure from their partners. If AOL is performing well, for instance, they’re unlikely to be happy about being cut out due to the deficiencies of other sites.

However, for now we have to deal with what we have, and I’m at least glad that I’ve been able to learn this much.

How about you? How do your stats measure up across the different sites?