Archive for May, 2008

SAN FRANCISCO–When it comes to search quality, Google has a split personality.

Google uses a method called split A/B testing to measure exactly what changes it should make to its main search Web site–both to its famously Spartan search box and to the results it produces. With the approach, Google shows different versions of the pages to users and measures how they respond, said Marissa Mayer, vice president of search products and user experience, in a speech at the Google I/O conference here Thursday.

 For example, Mayer said, the company wanted to find out how many search results to show users–the customary 10, or 20, 25, or 30? When asked directly, users said they’d like more results on a page, but testing showed otherwise.

Specifically, Google found that when the results increased to 30 per page, people searched 20 percent less overall, Mayer said. After much analysis of server logs, the company found it was because it took about twice as long to display the longer results list for the user, and speed matters.

“As Google gets faster, people search more, and as it gets slower, people search less,” she said.

The same effect happened with Google Maps. When the company trimmed the 120KB page size down by about 30 percent, the company started getting about 30 percent more map requests. “It was almost proportional. If you make a product faster, you get that back in terms of increased usage,” she said.

Split A/B testing also led Google to refine exactly how much white space to pad around its logo and other elements on the search results page. And it changed from the industry practice of a pale blue background behind ads to a pale yellow background. People not only clicked on ads more, they also searched more in general, she said.

The subject clearly is close to Mayer’s heart. She’s an engineer who also has an interest in the more aesthetic realm of design.

“On the Web in general, (creating sites) is much more a design than an art,” she said. “You can find small differences and mathematically learn which is right.”

A history of Google’s search page
Google’s search page, with its abundance of empty white space and its almost boastful “I’m feeling lucky” button, looks downright ordinary today. But it wasn’t always the case.

Mayer said that back when Google was a relatively unknown 80-person start-up, the company tested Stanford students on how well they could use Google to find which country won the most gold medals in the 1994 Olympics. The result: students would sit in front of the Google screen for 15 seconds, 30 seconds, 45 seconds, a minute…Google was perplexed.

So Mayer would eventually intervene and ask what was holding up the searchers. “I’m waiting for the rest of it,” they’d say. Clearly they expected more of the flashy ads and busy text of other search pages of the 1990s.

“The very first home page was that misunderstood. People didn’t resonate with it,” Mayer said. One woman even thought the Web site was a fake construction that was part of a psychology experiment.

Marissa Mayer, vice president of search products and user experience at Google, shows three slightly different versions of Google’s search results page that the company tested with users. The top, with the least white space, was more popular as measured by how much users searched.

(Credit: Stephen Shankland/CNET News.com)

As a result, the company put a copyright notice at the bottom of the page. “It’s not there for legal reasons,” Mayer said. “It’s there as punctuation. That’s it. (It tells the searcher) ‘Nothing else is coming; please start searching now.’”

Mayer oversaw much of Google’s design, but the sparse start page wasn’t her doing and wasn’t even part of a plan, she said. Instead, it was the design of co-founder Sergey Brin.

Why so minimalist, she wondered? Sergey’s response: “We didn’t have a Webmaster, and I don’t do HTML.”

Google also decided against presenting newbie and expert versions of its search page, Mayer said. People figure it out quickly, so the company aims its product at the experts.

“The learning curve on search is really fast,” she said. “People go from ‘Where can I get spaghetti and meatballs in Silicon Valley’ to ‘italian food san jose’ really fast,” she said.

The complexity of search
Google tries to look simple from the outside, but its search process is, as no one will be surprised to hear, quite complicated.

A typical search will require actions from between 700 to 1,000 machines today, Mayer said.

That’s grown more complicated as Google moved to what it calls universal search, in which the regular search results are mixed with results from its other search areas such as books, news, blogs, images, and maps.

With those other, narrower search services, Google lost sight of the simplicity users need in its haste to bring the services to market, Mayer said.

“The urgent can drown out the important,” she said. “It’s great we did these urgent, expedient search indices, but what we really need to do is put them on the same page.”

Indeed, in the longer run, she envisions universal search growing far more sophisticated, with a page filled with “images, videos, and graphs–not a list of 10 URLs but as a holistic answer to your query.”

Search also will become more personal, with results tailored for individuals. (Google has begun offering personal results for those who sign up.) One reason personalization is important, she said: a very useful factor Google can weigh in its search results is what a person just tried searching for previously, she said. Knowing that, “We know what you discarded or are refining from,” she said.

“We know 10 years out search will probably be a lot more personalized,” she said. “And there will be a lot more content to index. When we think how to build search, it’s important to think about the 10-year case.”

Jeff Bezos, CEO of Amazon.com, unveiled at this week’s D: All Things Digital conference that Amazon is planning a digital video streaming service. Want details? So do we, but Bezos wasn’t very forthcoming. All we know is that it will be an ‘a la-carte system,’ which we’re assuming means feature films and TV shows meant to compete with Netflix’s “View It Now” feature.

The service is a natural extension of Amazon’s Unbox service, which allows customers to purchase digital copies of major motion pictures. Unbox films are already watchable on your television via TiVo, but you must wait for the movies to finish downloading before actually watching them, which could take anywhere from 30 minutes to 6 hours depending on the speed of your connection.

Subscription? Pay-per-play? Catalog size? Hardware partners? We have no idea, but Amazon has our attention. [Source: USA Today]

What we’re watching tonight:

• ABC (720p) has the season finale of ‘Lost‘ at 9 p.m.
• A&E (720p) brings ‘Crime 360‘ at 10 p.m.
• TNT (1080i) has Game 5 of Spurs/Lakers at 9 p.m.
• ESPN HD (720p) has Women’s College World series action with Arizona State/Alabama at 7 p.m.
• ESPN2 HD (720p) features an MLS matchup with D.C. United/New England Revolution at 7:30 p.m.
• History (1080i) lines up ‘Gangland‘ at 9 p.m. followed by ‘Tougher in Alaska‘

Fans of high-def audio rejoice: The first Blu-ray recording has been released. Fans of anything other than Divertimento, hold your horses: The first release is from Thondheimsolistene, an orchestra from Norway. “Divertimenti”, as it is called, will be released by the 2L label in full HD audio glory along with a SACD track for those not on the Blu-ray bandwagon just yet. Formats include 2.0 LPCM, 5.1 LPCM, 5.1 DTS HD Master Audio, 5.1 Dolby True HD, 5.1 Dolby Digital at 48KHz, and it has been confirmed to work just fine on the PS3.

[Via MiC]

The world’s top five manufacturers play an everlasting game of cat and mouse (and mouse, mouse, and mouse), jockeying for revenue dominance in a world where market share means everything. Nokia’s been eating everyone’s lunch lately — and everyone’s been eating Moto’s lunch — but LG’s pretty proud of itself for recently passing Sony Ericsson to become the world’s number four. Even as it kicks back and enjoys its magnum of bubbly, though, there’s little time to relax. The company’s veep for marketing strategy says that it’s “carefully watching” Espoo to see what tactical moves it makes in the coming months, and will counter with “product portfolio” and “marketing strength.” The paranoia originally stems from rumors that Nokia would be dropping its prices and making a grand re-entrance into the South Korean market later this year, and while that probably doesn’t pose a short-term threat to Samsung and LG’s local dominance, the decision of the top player in the world to suit up and check into the game is always a cause for concern.

[Via mocoNews]