KIWI WORKPLACE ENGAGEMENT APP
UX Research + Design • May 2015
PROJECT SUMMARY
This project was born out of a three-week contract with Navicet, a strategic design consultancy based in Kirkland, WA. Navicet (DBA Squawk Metrics) makes a product called Kiwi Dials that facilitates the measurement of team health, with the aim of building awareness of employee engagement.
Employee engagement matters. According to a recent Gallup report, 70% of the U.S. workforce is disengaged, and 20% are actively trying to sabotage their employer's objectives. Gallup reported that organizations with high engagement "consistently outperform their competitors, and they consistently grow and thrive-- even in challenging economic times."
The folks at Navicet believe that the first step toward fixing engagement issues is to begin measuring them, and a good way to start is by baselining your team health using a product like Kiwi Dials. To date, Kiwi Dials have only existed in a physical format that team members can interact with in a co-located workspace. There are several complications with this approach-- it obviously doesn't work well for remote workers, or those who may be shy, introverted, or otherwise reticent to share their feelings in the workplace. Naturally, one isn't able to query the system for historical data, unless someone takes it upon themselves to log the kiwi's movements.
Our team of three (myself, Lindsay Henwood, and Liv Browning) set out to design and prototype the next evolution of Kiwi Dials based on comprehensive user research, and more importantly, empathy for those who feel less than 100% engaged at work. We've all been there.
PROCESS
We laid out an aggressive project plan in order to accomplish the following list of activities, and deliver on our goal of creating a fun, effective, and real-time solution for tracking employee engagement.
RESEARCH
Domain Research
Competitive Analyses
Heuristic Evaluations
User Interviews
Surveys
Concept Maps
Affinity Diagramming
PLANNING
Persona Creation
Task Analyses
User Stories
Scenario Creation
User Journey Maps
User Flows
DESIGN
Sketches
Paper Prototypes
Site Map
Information Architecture
Clickable Prototype
Brand Guidelines
Developer Specifications
TESTING
Test Screener & Script
Participant Recruitment
Usability Testing
Test Results Synthesis
TOOLS USED
Axure, Photoshop, Illustrator, Asana, Sketch, Visio, Keynote, KwikSurveys, Excel
MY ROLE
This was a very fast-paced project, but the three of us played more or less of an equal role throughout the research, planning, and testing phases of the project in the first two weeks. Given my background in math and analytics, I took on the responsibility of designing the reporting and detailed views of team metrics in the app. In the third week, when it came time to polish our deliverables, I took responsibility for the final prototyping and interaction design for the app.
RESEARCH, PLANNING, DESIGN
We wasted no time in getting started with domain research and user interviews, and were able to complete 11 interviews within a few days' time. We interviewed both managers and individual contributors.
Several themes emerged from our affinity diagramming exercise following the interviews; most notably, discovering problems within a team, and difficulties with communication.
The managers we interviewed noted that the indicators of impending trouble are often subtle: unexpected overtime, missing or lacking commitment, the overarching "feeling" in the room being off, conflicts, missed deadlines, and when one team member is overly domineering. One interviewee added:
"By the time we notice someone is unhappy, their performance is already suffering."
Regarding communication in particular, it was interesting to note the divergence between the managers' view vs. that of the individual contributor. When asked about communication in the workplace, managers were more likely to reflect positively on their communication skills, regaling their participative leadership, open door policies, weekly touch-bases, one-on-ones, etc.
Individual contributors, on the other hand, used phrases that illustrated a distrust of management and/or company culture: fear of reprisal, retaliatory environment, afraid of ramifications, lacking recognition, and serious misgivings about workplace surveys that claim to be anonymous. In fact, 72% of the individuals we surveyed reported that they do not trust the "anonymity" of surveys that claim to be anonymous (N=42).
Of course, it's imperative that management has insight into how and what their workers are feeling and thinking, but it's also important that individual contributors feel valued and safe at work. As mentioned above, team health is highly correlated to success, so it was clear that our solution must help leadership identify issues early on, but maintain focus on the end-user and their feelings of security.
We got to work sketching, and tested with paper prototypes early in the second week of the project. We learned quite a bit with each test-- users liked the friendly voice, tone, and playfulness of the Kiwi, but weren't sure whether or not they'd use something like this at work, unless it was a mandate from management. This wasn't what we were going for, so we went back to the drawing board.
At this time, we developed tenets for Kiwi, or principles to guide our design decisions, maintain focus on the end-user, and create a structure for which we believe Kiwi is best used.
The physical manifestation of the Kiwi Dial works best when all team members are engaged in deciding what to measure (e.g. fun, clarity of purpose, autonomy, impact), and Navicet recommends going through an affinity diagramming process to nail down these meaningful aspects of team health. In hopes of creating more engagement with the app, we tried to incorporate a brief card sort-like experience in our second prototype to mimic this exercise. Users found it too burdensome , and we ultimately opted to have a team moderator (likely the person who signs their team up to use Kiwi) decide which aspects of team health to measure.
We developed two personas: One is the more gregarious team lead (who sets the team up on Kiwi), and the other is an individual contributor on the same team. We created a user flow for both personas, but due to time constraints, were only able to fully prototype the individual contributor's workflow.
THE SOLUTIOn
In total, we iterated seven times and administered 14 usability tests. The final version is a strong foundation for future research and exploration, though we feel that there are many more features that should be added for a full-release version.
BRANDING AND DEV SPECS
key findings and next steps
Anonymity vs. Control of Data
One of Kiwi’s distinguishing features from its competitors on the market is the commitment to anonymity: that a user can share their opinion without anyone knowing it was them. Complete anonymity is hard to promise (distinct user actions must be logged in order to provide the structured data we've mocked up in our designs), therefore we suggest that Kiwi markets this feature as giving users control over the visibility of their data.
Providing users the ability to add comments to their check-ins was a feature that we implemented in one of our last iterations, and we recommend giving the user control over whether or not those comments are public (anyone can see them when running reports or looking at daily details), or private (like a memo or diary feature expressly for viewing by the user who wrote them).
selecting aspects of team health
As mentioned above, the value of using Kiwi was not initially apparent to testers who were presented with pre-chosen Aspects of Team Health. Testers indicated a preference for democratic selection and felt there was more value in using Kiwi if they were involved in selecting the Aspects their team was measuring. It provides the user a greater sense of ownership, and we feel that it is a key feature that needs further exploration.
THE CHECK-IN PROCESS
It may be appropriate to add a seventh tenet to our list above: Kiwi is not a survey. Check-in processes can teeter on the edge of feeling like surveys, which we want to avoid. Users dislike and distrust surveys in the workplace: they're not fun, often don't provide useful data, and unfortunately can be used to single out individuals despite their claims to be anonymous.
Our very first prototype featured a check-in process, and our stakeholders challenged us to think differently about this aspect of our design. We came up with several alternatives, none of which tested well with users. We also tested several iterations of “check-ins” before arriving at a Likert-type scale for users to select from. The use of kiwi images, coupled with color and simple phrases were to easy for users to understand, quick to use, and maintain a greater degree of accessibility for color-challenged users.
In our usability tests, users indicated a preference for checking in on Kiwi on a regular basis, either daily or several times a week, and would be more likely to use it if they were reminded to do so, either by their teammates, manager, or with a notification sent from the app. We recommend a reminder setting to be controlled either by the user or team moderator to set notification frequency.
for future consideration
Aside from the recommendations listed above, we suggest running a longitudinal study with a team that can test out a functional Kiwi prototype, to grok whether or not users remain engaged with Kiwi over a greater period of time, and how the design might need to be modified for this purpose.
UPDATE: KIWI DIALS HAS LAUNCHED!
After almost a year in development, Kiwi Dials launched in February 2016. I have been fortunate enough to keep in touch with the fine folks at Squawk Metrics, and I was invited to beta test the app and provide feedback before its launch to the public.
Now that the app is live (for iOS, Android, and Windows Phone), I recently took a few key screen grabs of the current state of the app (version 3.4, as of June 2016) on my iPhone 6, and included a short critique of the live app, below.
WHAT I LOVE
Aesthetics
Probably most obviously, the aesthetic of the released version of Kiwi Dials is pretty different than the visuals we developed in early 2015, but the intent remains the same. More on that below. What I am pleased to see is the decision to go with the Material Design spec-- it's very well-defined and far easier to develop against compared to the custom, flat design direction we delivered in 2015.
While the color palette we delivered in 2015 may have gone too far in the pastel, feminine direction, I do appreciate that Kiwi Dials appears to be going forward using some pinks, purples, and rich blues, providing a little bit of a feminine feel. This did seem to resonate with users when we did our user testing-- it instilled some feeling of levity while still maintaining the trust factor. I've included a few more thoughts about color in the "Opportunities" section, below.
Interaction
I appreciate that there are several sources of immediate feedback after you vote on an aspect of team health: the color and number display I the circle, the "toast" popup at the bottom that lets you know that your vote has been recorded (with the added bonus of letting me undo!), and the ability to look at trendlines, just one tap away.
The slide-to-vote feature is a pattern that I hadn't considered and it is kind of fun to play around with. I wonder about its efficacy, but more on that below.
Aspect Selection
This was one of the biggest challenges for my design team-- trying to figure out how a team could determine, collectively, which aspects of team health they would want to measure. After trying many options, we left the onus on the Team Lead or Manager-- whomever was setting up and moderating the Kiwi Dials.
The Squawk Metrics team ultimately decided to provide a predetermined list of many aspects of team health, essentially letting the individual decide what they wanted to weigh in on. Very smart, and very simple (though, I think the list could be shorter… it's a bit overwhelming as is, with 25 list items).
Focus on the Individual
This came through loud and clear throughout our research and iterations through design-- if the app didn't work for the average daily user (namely, the individual contributor), and moreover, if the app didn't provide value to the individual contributor, it would fall flat on its face. Nobody would use it.
I think Squawk Metrics firmly grasped this concept in their implementation, as well as their pricing strategy: Kiwi Dials is free to use-- for anyone-- forever. There are paid plans, with which you get additional reporting functionality and insights, but I can (and have) used Kiwi Dials to monitor my own progress and moods relating to my daily project work without inviting anyone to vote along with me, nor to view my votes. This is a big win, in my book.
WHERE THERE IS STILL OPPORTUNITY
Aesthetics and polish
While I am pleased with the move toward the bold and simple application of the Material Design spec, I think that the current version could afford a bit more polish, especially in regard to color choices. I am concerned primarily about contrast and accessibility, but moreover, intentional use of color, iconography, and data visualizations throughout, which feel a little lacking to me, at the moment. The pinks, purples, and blues feel very close in terms of value and saturation.
Also-- the kiwi! Obviously, the kiwi bird took a front-and-center role in our design delivery in 2015. The kiwi bird has existed on the Kiwi Dial since its inception as a laminated piece of paper. The kiwi bird feels playful and provides some personality to a process that can be very dry and transactional. I would like to see the kiwi bird used more in the Kiwi Dials app (it's currently just on the splash page and app icon, as far as I can tell).
Too many menus, and too many voting options
There are two primary menus, the first of which is the hamburger menu on the left-hand side of the top rail that exposes your personal settings like name and notification preferences, as well as your team membership. The second can be found on the right-hand side of the top rail under the vertical ellipsis icon, where you can find help, legal stuff, and sign out.
I believe these menus can and should be combined, likely into the left hamburger menu. The only content that seems distinct enough that it might warrant its own special spot or functionality is the team roster information, which currently lives in the left-hand hamburger menu. If I were to discover from users that this piece of functionality was something they used frequently, I might recommend moving it into the top rail, perhaps where the vertical ellipsis menu is now (but change the iconography to represent the content-- maybe a small group of figure heads or something similar). This content also highly correlates with whichever team's dials you're viewing, and this is another reason I support bringing it out of the left-hand menu, and closer to the team switcher (center dropdown in the top rail).
As shown in the core functionality screens, there are two ways to vote: sliding your finger to the right over any aspect of team health, or tapping the circle in order to pop the same colorful, numbered scale in the area below the aspect that you're voting on. While I enjoy the interactivity of the sliding function, it's not at all obvious to me that it is an option (though it is explained in the product onboarding tour). There needs to be more of an affordance to slide-vote, if this option remains in the app. That being said, I would advocate for only one way to vote-- these two, very similar options just feel like someone couldn't make up their mind, and almost feels like these two options are being tested against one another, live in the app.
Insights
Though I know that we didn't completely knock it out of the park with our treatment of team insights in our preliminary designs in 2015, the Insights section in the current incarnation of Kiwi Dials really leaves something to be desired.
Visually, it's a very basic and plain section, the typefaces are maybe a little too large, and the trendlines aren't actionable (maybe this is something you get to see more into with the paid plan, but it might be nice to have some kind of a call to action here to monetize, if that really is the case).
The small gray sparklines don't give me any kind of scale to understand the peaks and valleys, nor to make comparisons between the individual aspects.
I also think alphabetical sorting here is an interesting choice, and maybe could be improved. This may be a good place to give the user some control over the sort order (worst-to-best rated or vice versa, most voted upon aspects, etc.).
And though I'm very familiar with the fact that the intent of this app is to measure team engagement, and that all of the aspects feed into Engagement, it didn't immediately occur to me that the Engagement line that is slightly larger and full-width above the other aspects is a summary of all of the measures below. This could use some rethinking, as well.