ShopTalk Blog

In addition to working on ShopTalk over the summer, I joined forces with my brother-in-law to build a tree house for my kids (ages 5 and 3).

We were going to build the coolest tree house around. It was going to be 10 feet off the ground at floor level and have 120 square feet of space under roof. It was going to be big enough for even adults to stand up inside. There were going to be skylights, a trap door and a covered porch.

You've probably already guessed that we did not, in fact, build the Minimum Viable Tree House.

Like projects tend to do, the scope crept, the expenses soared and the time line stretched. As the project dragged on for weeks, the stakeholders (my kids) began to grow understandably impatient.

"Papa built our last tree house in a day!", my oldest said.

"Yeah, but that tree house was a couple pallets and a ladder", I replied.

You see, we had been working on it all that time and yet there were no tangible results for the kids. It was too high and unsafe before it had walls. Even after we put up the walls, the railing for the porch had to go up. Then there was the issue of the big hole in the floor where the trap door was going to go.

We did actually finish the tree house a couple weeks later. It's been towering over the backyard for the last few months.

Spiders think it's pretty great.

My kids though? They get more into playing in the brush pile from the tree that we cut down to make way for the tree house.

I'm pretty sure I've noticed the squirrels laughing at me.

One of the many mistakes I think I made was making the tree house too big. It comfortably accommodates adults. It's really high off the ground. Meanwhile, my kids are cramming themselves into cardboard boxes whenever they find one, squeezing themselves under the furniture and tunneling under the brush pile beneath the tree house. Kids like small spaces, and the final product doesn't fit the current clientèle. Further proof of this is their actual favorite part of the tree house - the "cramped" little loft area above the porch.

Another mistake was working for weeks and weeks before having something the kids could use. All of us were pumped up about the project at the start. Kids and adults alike sat around drawing up sketches of what it should look like and talked excitedly about what we'd add to it down the road [0]. After construction started though, it just took too long to get it to a point where they could play in it. The excitement wore off as the weeks wore on.

I still have hope that the kids will enjoy it when they are older. Maybe they'll grow into it.

For now though, when working on ShopTalk and other projects, the tree house is a reminder. A reminder to listen to and build for my audience. A reminder to deliver useful features in short iterations. A reminder that next time I need to build the Minimum Viable Tree House first [1].

[0] Be on the lookout for my next post, "The Minimum Viable Zip Line" ... just kidding!
[1] Hat tip to Eric Ries and my late father-in-law and his "two pallets and a ladder" tree house.

Intuitively, we all know that flipping a fair coin results in heads 50% of the time. But how many times should we expect to flip a coin before the stats converge on that number? I turn to my esteemed statistician friend, Christoffer Perry, with such questions. He says:

In Statistics, everyone seems to think that 95% is a magical number, so let's pretend like we're statisticians (a dubious proposition, at least for myself) and bow down to the mythical sphinxian ninety-five. Conversely, 5% is a pretty good number in the discipline too, so we'll use the fabled feathered five. That is, for those of you not privy to my inner thoughts and schemes, let's say we want the probability of the sum of heads falling within five percent of the average to equal ninety-five percent.

Thanks to R, the Jason (of Rgonaut fame) of Stats, we soon find that you'd have to toss a fair coin about 1,500 times. That is, there's roughly a ninety-five percent chance that the number of heads will be somewhere between 712 and 788, five percent off 750. That's a lot of coin tossing for not a lot of certainty (though you can be certain that rattling off this sort of probability at a party will get you quickly tossed).

To get even more certain, say, 99% probability, you'd need about 2,700 tosses. To be more certain and get a range of one percent, you're looking at somewhere near 66,000 tosses. But hey, at least you got a lot of free drinks at those parties!

A fair coin is a random variable. Your users are not.

At Startup School 2007, Max Levchin advised the attendees to take a course in statistics and realize that a sample size of 30 is too small to produce statistically significant results. That would be true if you were sampling a random variable. Unfortunately, this was his argument against usability studies, which sample human behavior.

In college, I was fortunate enough to study under the wise tutelage of Dr. James D. Hollan. I spent an entire quarter redesigning a pretty unique piece of video viewing/editing software developed at Stanford, called Diver. The first assignment required us to conduct 16 contextual interviews with actual Diver users. Each interview consisted of at least two members of our six-person team sitting and closely observing a Diver user, in their office, for two to three hours. That's a lot of man hours for the first assignment in the course.

The first several interviews were basically shock and awe. All of our expectations about user behavior were shattered. We never could have predicted how these people were using the software. Breakdowns and problem areas in Diver's interface shot out of the screen at us like Captain Eo's lasers. Possible changes and improvements raced through our minds. We had chosen wisely; this software was ripe for a redesign. However, after about eleven interviews we came to a pretty obvious conclusion: all of the users behaved roughly the same. After learning a ton from the first few interviews, we now felt that we weren't learning anything new at all by conducting more of them. We took this observation to Dr. Hollan. His response was that this pattern is entirely typical. He teaches this course every year to hundreds of students, and they all have the same experience. He asks the students to conduct 16 interviews, but that is always more than is necessary. We were allowed to stop at eleven, and we all breathed a sigh of relief.

The lesson learned: human behavior converges on its expected value far more quickly than a random variable does.

Applying this lesson

Reading words on buttons and menus requires a lot of brain power. The image of the words needs to go from the eye to the brain. Then it needs to go to a different section of the brain for language processing. Finally, another section of your brain decides if those words represent what you're currently searching for and whether to signal the hand to click on them. Icons, on the other hand, can be more easily differentiated and can allow users to short-circuit this process. They can notice the icon in their periphery and click on it without putting much thought into it. That means their thoughts can remain on what they're trying to accomplish instead of how to accomplish it. For this reason, the room tabs in the first version of ShopTalk looked like this:

Every single one of the first 5 users was confused by that little tab on the right. Nobody clicked on it. For me, that was already enough data to warrant fixing it. After just 5 tests I already felt close to that 95% certainty that required 1,500 coin flips. I'm willing to bet that you, kind reader, are also confused by it at this very moment. We humans all think alike. Your users, in this sense, are like a gaggle of Lemmings.

Our task as interface designers is to guide those lemmings to safety. You have to put up the proper signs and road blocks so that they think what you want them to think and do what you want them to do. You also have to guide them with such a soft touch that they don't even realize they're being guided. In this case, the fix was rather simple:

Labeling the tab with text and an icon is often a great combination, if you can afford the screen real estate. First time users can read the words to figure out what the icons mean, and more seasoned users can spot that little green plus sign out of the corner of their eye and click on it without even thinking about it. The result: happy users who keep coming back for more and tell all of their friends to check out ShopTalk.