New Twitter Search Functionality and Analytics

A couple of notes for the Analytics community regarding Twitter's cool new search interface...

New URL
There's a new search engine referral URL as part of Twitter's new interface. You'll want to update those search engine configurations to be on the lookout for it, and note the additional parameters too. Here's what the referring URL looks like from their new sidebar search:

http://twitter.com/timeline/search?q=searchphrase&source=sidebar&category=search

I see one other category in there for the new "trends" they've added just below the search bar, but in my limited testing, the referring URL didn't always reflect the "trend" selected, which I hope they fix.

I also note that if you've searched for something, that search phrase stays in the URL, even if you go somewhere else on the site (example: I went to my @elbpdx area and clicked on a link in there and the /search?=searchphrase was still present in the referrer...I imagine this is a bug that they'll fix...)

Expect more changes
The URL portends some additional goodies that they must have up their sleeves. What additional "source" items will we be seeing? What else are they going to do with the "category" field? I'm looking forward to seeing more...

Twitter Analytics

It looks like Twitter is starting to get serious with how to monetize all of that amazing information they are collecting. According to Kevin Thau, Twitter's Director of Business Development:

"We can measure the tweets," he says. "We're trying to figure out what are the appropriate metrics around engagement and how to convey those."

Jeremy Owyang was also interviewed for that Forbes article, noting when asked about whether there's any money to be made:

"When it comes to enterprises, absolutely," says Jeremiah Owyang, a social computing analyst with Forrester Research (nasdaq: FORR - news - people ). "I just got off a call with a client that's asking about how to engage on Twitter. There's definitely interest."

I think Twitter rocks, and will continue to change how we communicate and share information. I use it to bookmark information now (so sorry delicious...), as well as staying in touch with the evangelists in the social media industry and the analytics industry. And with this new development of measurement coming from Twitter, I imagine we'll all be watching these industries get closer together as we figure out how best to integrate information.

Perhaps it's just a conspiracy?

Perhaps this is just Google messing with us. I searched on "web analytics" and received the hashed up response above, and obviously others have stumbled on this too. How many individuals in our industry (SEO, Web Analytics, SEM) have spent (wasted?) time figuring this out in the past few days? And their only response thus far has been to point us to a blog post from 2006?

It sure seems like they could be a bit more transparent on this.

Search and Best Results Analytics

Prefetching content is a clever way to speed up your browsing experience. Simply put, given certain conditions, your browser can prefetch web pages, so when you do visit those pages, they are already in your cache, thus speeding the time to display them in your browser.

Google started prefetching content for Firefox users in March of '05. Note that this doesn't work in IE (although StumbleUpon does), nor even in Chrome (although Chrome does prefetch/pre-resolve DNS information). They don't prefetch for all searches...only those where there's one result that has a high likelyhood of being selected...the "best result".

Here's how Google's search prefetching works. You perform a search, say for "apple". You get back something like these results.

Behind the scenes, google has also added an extra tag to one of the links instructing the browser to prefetch the Apple site (again, only Firefox does it) of http://www.apple.com/

For those who want more details, the tag which generates the prefetch includes: link rel="prefetch"

And to tell you maybe even a little more than you want to know (but highlights an important fact), when the browser does prefetch this information, it doesn't fetch any additional objects referenced on the page. Only the HTML content of the link. (yep...if you're using a javascript tagging solution for your analytics, you are not capturing that prefetch visit...)

Now, how does Google determine what link to prefetch? What if I really wanted info on the actual fruit? Google doesn't divulge how they actually determine when to insert a link, I think it's an interesting metric that is worth investigating. I think of it this way. Google is basically saying, "I have a pretty good idea what you're going to do next, so I'm going to make that next site you're going to visit a little faster for you".

We all pay pretty good money to GYM (Google, Yahoo and Microsoft) and others to send search traffic to us. We also spend money on tools to help us better understand what search terms folks use to get to us even when we're not paying GYM and others. And of course, we all track this important information by paying WebTrends and others for excellent tools to make sense of all of our efforts.

However, unless you've made plans to intercept this prefetch information, you are not collecting this important data. Why is it important? Only Google knows how many times your site is returned in search results. You only know:

1. How many times it was returned in paid results
2. How many times a visitor clicked through to your site in search results (paid or organic)

What's missing is how many times your site was returned in organic searching (does anyone know how to get absolute search info from GYM?). And what would also be excellent to know is how many times Google thought that the visitor was going to select your site - based on the best result. Again, here's what I'm thinking:

Google thinks a visitor is interested in your site. This tells you:

1. The visitor searched for something that likely would have led them to you.
2. Google thought it was relevant enough to even prefetch the content for the visitor.
3. The visitor may or may not actually make it to your site (why or why not?).
4. Which search terms were actually deemed relevant enough to make Google think your site was the right destination?

Ok, so how can you capture this information? If you're using web logs, you need to make sure you're capturing request headers so you can pull out a special header that is sent with each request and put it in your logs. The header is: X-Moz: prefetch

If you're using tagging, here's an approach that I put together a couple of years ago so we could watch this traffic over time: intercept the request and generate a request to your Web Analytics vendor data collection environment. I'd be happy to show you how to do this if you're interested.

Now you can track this traffic over time, and per visitor (depending on your WA solution you're using). What are these "best results" that these visitors are searching for? Did they actually select your site? Assuming you want them to visit your site, how might you change things so they do reach you? If they do make it to your site, which paths did they follow? Which scenarios did they fall into?

Questions? Thoughts? Comments?

Google Analytics Event Tracking

Google continues to do a good job of adding additional functionality within their Google Analytics framework. Their Event Tracking is well done (with the usual capacity/scale issues). I do like how well they've laid out the tracking code, and even threw in a couple of extras in there (time tracking and mouseover tracking).

Of course, WebTrends and others have had this functionality for years now, and have much deeper customization options...but I am biased.

A couple of notes on GA's event tracking:

1. Bounce rates will change. They are treating events as additional "requests", so if you have a single-page visit with an event triggered (automatically or through interaction), it's no longer considered a single-page visit.
2. There are limits to how many events they will count. This is a free service afterall, but they note that in addition to the other report limits within GA, there is a limit to the number of requests per visit they will include in the reports. Watch how you implement events!
   

Back at WebTrends...

This past week was my first week back at WebTrends. First, let me say thanks to Alex, Bruce, James, Mike S, Shane, John D, John R, Leo and Barry who all made time for me to bounce ideas around and find the right fit for me. Everyone has made me feel very welcome back.

So, why jump back inside analytics? And why back to WebTrends?

#1: The WebTrends Team
You can't underestimate the power of a strong, smart executive team. I had the privilege of working with an incredibly bright, innovative, forward-thinking management team at Jive, and I can tell you it makes all the difference to have a quality team with whom you can trust, engage, and collaborate.

Alex is building something special here at WebTrends. I had heard it from others, and I can already see it. The team rallies around him, and the exec team isn't wasting any time to make real change within the company.

#2: The Analytics Industry
I like this industry. The technology is dynamic, our customers are creative, and there's a large number of smart people out there solving interesting problems. I see too that the WA blogging world continues to grow, and there's plenty of twittering from a plethora of sources as well. This level of sharing and collaboration is very healthy for us all.

Many thanks to the many voices out there who are keeping us all enlightened, challenged, converted, and otherwise demystified. I'm looking forward to getting ramped back up and connected with you all again.

Focus and Innovate

A colleague turned me on to the quote below from this article...smart stuff from O'Reilly.

We don't know yet how problems in the overall economy will affect our business. But what we can do now are the things we ought to be doing anyway:

• Work on stuff that matters: Assuming that the world does go to hell in a handbasket, what would we still want to be working on? What will people need to know? (Chances are good that they need to know these things in a world where we all continue to muddle along as well.)
• Exert visionary leadership in our markets. In tough times, people look for inspiration and vision. The big ideas we care about will still matter, perhaps even more when people are looking for a way forward. (Remember how Web 2.0 gave hope and a story line to an industry struggling its way out of the dotcom bust.)
• Be prudent in what we spend money on. Get rid of the "nice to do" things, and focus on the "must do" things to accelerate them.

  These are all things we should be doing every day anyway. Sometimes, though, a crisis can provide an unexpected gift, a reminder that nobody promised us tomorrow, so we need to make what we do today count.