Category Archives: user experience

when research results go rogue

When I interview candidates for user research roles, one of the questions that I am always looking to answer is how the candidate has ensured that their research results were acted upon.  For researchers who work inside a company, I want them to have ownership of their research results and recommendations based on the research.  I don’t want them to just throw the report over the wall and hope that someone on the other side of the wall will do something.  I want them to own those results, to work with teams to ensure that they understand the results and the recommendations, to help brainstorm ideas if the recommendations can’t be contained in this release.  It doesn’t help anyone if a researcher conducts fantastic research if the product doesn’t become better as a result of that research.  The best research is the research that impacts the product.

I recently had a conversation with another researcher who was frustrated.  He had done some great research, and had shared the results and recommendations with the team, and had been working with the team to ensure that they understood everything and would be able to take action on them, and was even tracking bugs o ensure that things were getting into the product.  He was doing everything right.  And then he finds out about a meeting after it was already 90% done, in which someone else was talking about the area that he had researched.  The presenter was sharing the researcher’s results and recommendations, and was discussing next steps.  The research results had gone rogue: they weren’t accompanied by the researcher who had a deep understanding of them, and they were being used by someone else who mostly (but didn’t completely) understand them for a different purpose and with a different audience than originally intended.

The researcher was upset: he had put a lot of work into creating, conducting, and disseminating that research.  It barely got acknowledged that the user insights that the presenter discussed were insights from the researcher, let alone that some of the slides were actually taken from the researcher’s presentation.  The researcher felt like his work wasn’t being acknowledged, and that he was being cut out of discussions about this area where he could continue to contribute.

His feeling was valid.  He should have been acknowledged for the work that he had done, and how his work was forming the basis for what the presenter was discussing as future work to be done.  His frustration is completely understandable.  The presenter should have contacted him to ask permission to re-use his slides, as well as get him involved so that he could help address follow-up questions about his work.

I reminded him that there was something really positive in all of this.  He had done all of the right things.  He had done them so well that his research is now just part of that team’s DNA.  It’s part of what they use to make decisions, and now it’s an important part of what they’re using to go forward.  This is one of the best possible outcomes for user research: not only does the team understand it and are taking action on it, it has a continuing impact as they think about what they should do next.  We talked about strategies to get him involved with the ongoing conversation so that he can contribute other things that he learned in conducting that research, as well as help with additional research as they move forward.

Research results can go rogue.  This can be good, this can be bad.  It’s frustrating either way, but I’m so glad that these rogue results are being used for good, and that there are ways that it can be managed to help rope them back in and grow those research results into an even better understanding of our users, their needs, and the challenges that they face.  He did a great job with the research, so good that his research is something that the team has forgotten was something that they didn’t know and couldn’t make headway on until he did that work.  We often talk about how a good UI should fade into the background.  Maybe that’s true for good research as well: it’s so good, and the results and recommendations are so much a part of what we do and so important to our understanding of our product and our user, that we forget that research happened at all.

Kathy Sierra on presentation skills: “I am just a UI”

Kathy Sierra nails it again in her latest blog post “Presentation Skills Considered Harmful”.  She makes the most awesome point that focusing too much on your presentation skills, and not about why your audience wants to see your presentation, means that you’re focusing on the wrong thing.  Focus on your audience and what they will take away.

It’s hard to pick out one quote, so I’ll go with this paragraph:

When you design for a user experience, you quit focusing on your skills and start focusing on their skills. What experience can you help them have? Can you give them a more powerful perspective? Can you give them a new idea with immediate implementation steps they can’t wait to work on? Can you give them a clear way to finally explain something to others that they’ve been feeling but could not articulate? Can you give them a new tip or trick that has such a high-payoff it feels like a superpower? Can you give them knowledge and insight into a tough topic, so they can have more interesting, high-resolution conversations in the hallway?

You might need to improve your presentation skills or style so that your audience can focus on the important message of the presentation.  She puts it this way: “I am a UI.  Nothing more.  And what’s a key attribute of a good UI?  It disappears.”

I love easter eggs

I love easter eggs.  They’re a great user experience if done right. They make people feel more connected to your product because they know one of its secrets.  Easter eggs remind people that there are real people behind what they’re using.  They let the team show some personality and a sense of humor.

Last year, someone discovered that we’ve shipped a game of Pong.  Last week, someone else discovered that there’s more to Pong than meets the eye.

I’ll leave it as an exercise for the reader to discover other easter eggs …

multitasking impacts both your productivity and mine

There’s already plenty of research out there that says that multi-tasking is a myth, that you’re just context-switching and not actually getting any of your individual tasks done any faster.  New research suggests that it’s actually worse than that: not only does your multi-tasking keep you from getting your stuff done any faster, but it also impedes others from paying attention.

Let’s look at this the context of Anil Dash’s recent strawman-filled diatribe against those who wish people would turn off their mobile devices when they’re at the cinema, in which he says the following:

I hear the arguments the fussy film people are making. They’re all super, uniquely sensitive to light pollution, and the brightness of the screen is incredibly distracting to viewing the screen.

It’s not just people who are “fussy” or who are “super, uniquely sensitive to light pollution”.  It’s distracting, and (as the author of the study I referenced above puts it) disrespectful to your fellow audience members.

I’ve been trying to leave my laptop back in my office when I’m in meetings, unless I’m actively taking notes with the laptop (since I type faster than I write).  This gives me even more reason to do it.

a different test of your product

I mentioned that you could do a quick test of your product by asking your users to describe it to you.  There’s a related but different test of your product that you should do.  Get the senior leaders of your application to describe, in a sentence or two, why people buy your product today.  Make sure they focus on the version of the application that your users are using today, not the version that they’re working on.

Doing this by itself will tell you what your team thinks your app does and why people buy it.  You’ll learn a lot if their answers are similar or disparate.  If their answers are similar,  then you’ve got a great starting point for making design decisions.  If their answers are disparate, then a useful exercise is to understand what the points of commonality are and where the points of disagreement are, and then try to determine how to bring the team into alignment.

If you do this in conjunction with asking the same question of your users, then you can compare the answers of the two groups and make sure that they’re aligned.  If they’re not aligned, then you’ve got the opportunity to help your team better understand what your users actually do, or want to do, with your application.  If they are aligned, then you’re in an awesome position of being able to make an even better product in the future.

This is a very small piece of research that you can conduct, often just in hallway conversations, and is very illuminating.  If I’m working on a product that I’m not familiar with, or with a new team, I’ll often start here to understand the landscape.  It’s quick, it’s easy, and can form the basis of future research efforts.

“your app makes me fat”

Kathy Sierra has returned to the world of blogging after a 6-year hiatus, and her first post on her new blog is stellar.  It’s called “Your app makes me fat”, and it’s a fantastic piece about cognitive load — that is, how much brain power you have to put into completing a task.

She talks about how cognitive load not only impacts how our users interact with our applications, but also how it impacts the lives of our users.  It’s a great reminder that our user experience doesn’t stand by itself.  Instead, our user experience is just a part of the day for our users.  We often talk about “death by a thousand paper cuts”, and I think that we forget that those paper cuts still hurt even when our users leave their desks.  After all, who hasn’t gone home after a bad technology day at the office and been unable to focus on anything else because they were so drained by what they’d experienced that day?

It’s a long post, and there’s a lot in there to think about.  Make sure that you’re ready to settle in, read the post, and think about her points.  I know I’m going to have to re-read it at another time when I’ve got more energy to focus on it.

the user experience of red

Jeff Carlson wrote a post about the battery gauge of his spiffy new MacBook Air.  The newest generation of MacBooks have amazing battery life.  There’s a strange downside to this battery life, though.  Here’s a quote from Jeff:

Working on the new 2013 MacBook Air, I noticed that the battery gauge in the menu bar had slid into red. Typically that means a scramble to find the power adapter, but then I clicked the button […]  17% battery still left—with an estimated 3 hours 23 minutes of battery charge.

A red battery indicator on my Mac used to mean that I needed to get plugged in quickly.  Not drop-everything quickly, but sometime in the next half-hour or so.  The red battery indicator usually meant that I could finish out a meeting if I was careful, but that was about it.  Now, though, I’ve got a retina MacBook Pro.  A red battery indicator usually means that I still have three hours of battery life yet.

Users are trained that a red icon indicates that there is a problem that needs to be addressed soon, and that not addressing it soon means that there will be consequences.  Apple hasn’t considered this in expectation in the current battery indicator.  Red no longer means that I need to fix this soon.  Now that my expectation for what red means is broken, I have found that I stop paying attention to the battery indicator.  I’ve increasingly found myself getting the dialog telling me that my Mac needs to be plugged in very soon or it will have to power itself off.

Apple has made amazing strides in battery technology.  I can easily get more than 8 hours of battery life on my rMBP without paying any attention to conserving the battery.  As a result of this improvement, 20% of battery life remaining is no longer a cause for concern.  Apple needs to reconsider the point at which it warns me that my battery is low.  The warning needs to be early enough that I can complete whatever I’m currently working on, but not so early that I disregard it as something that needs action from me.

job posting: senior UX researcher

My team at VMware has an opening for a senior user experience researcher at our headquarters in Palo Alto, California. We are responsible for user research across VMware’s product portfolio. A senior researcher on the team is responsible for working with teams to understand their needs, creating a research plan to address those needs, conducting the research, analyzing the results of the research, communicating the results of the research, and continuing to evangelize the results of the research. Additionally, the senior researcher will proactively identify research needs and conduct research that will help us address long-term needs of the organization and put us ahead of the curve in understanding our users, how they use our applications, and how we can better meet their needs, desires, and aspirations.

If you are interested in this role, please email me with a cover letter, resume, and (preferred but not required) link to your portfolio.

My team also has openings for senior interaction designers.  You can email me if you’re interested in that role or have any questions about it as well.