Digital Workplace Logo

News

You are here: Home » News & Events » Intranet usability: 4 data analysis steps for card sorting exercises
Intranet card sorting analysis

See a real-world analysis of card sorting results, based on an honest look at DWG’s own website. This key usability technique should be an important part of all intranet programmes.

In my blog post on tree testing task analysis we found a couple of problems with our website navigation structure.

  • 15% of people failed to find “My Beautiful Intranet” under “News & Events”
  • 91% failed to find “Benchmarking evaluations” under Membership.

I also had a sneaking suspicion that “News & Events” wasn’t a logical home for our “Expert blog”. I wonder how many of you find these posts through our fabulous email alerts rather than intuitively being able to find it in our navigation menu.

Well, our card sorting results are in!

Thanks to all those who participated, and with over 40 fully completed responses, I’ve been able to conduct a quick assessment and see where users logically group these items.

  1. The Participant-Centric Analysis

    I usually start with this as it quickly tells me the three most commonly accepted ways in which users grouped and named content.

    Intranet card sorting analysis 1 categories

    You can see from this screenshot that many users placed “Benchmarking evaluations” under a new category called “Services”.

    This is a great insight: we’ve arranged our navigation according to what we do, separating “Membership” and “Consulting”, but our audience doesn’t differentiate.

    Interestingly, for “My Beautiful Intranet”, these groupings showed that users either placed it on its own with the same label or grouped it with “Digital Workplace Live” – but not under “News & Events”.

    Intranet card sorting analysis 2  categories

    This view allows me to quickly see where users placed these items and how they labelled them.

  2. The similarity matrix

    The similarity matrix shows the percentage of participants who agree with each card pairing. It clusters similar cards down the right edge, so you can see which cards relate most strongly to each other.

    You can also look for the highest percentage of participant groupings for particular pairings.

    For example; here you can see that my theory about the “Expert blog” might be correct in that it was most frequently paired with “Peer learning”, a label from another section entirely.

    Intranet card sorting analysis 3 - similarity matrix

    I use this grid to validate that users agree with my groupings, frequently pairing the same content together. The good news is that the blog content was also frequently paired with its siblings under “News & Events”.

    It also allows you to quickly see where there are no strong correlations and pairings are scattered, such as with “Benchmarking evaluations”.

    It’s worth keeping in mind that these are just pairings and what you miss here is the overall categorization that the Participant-Centric Analysis is so good at showing.

  3. The dreaded dendrogram

    This view often makes my head hurt and is used to illustrate data clusters. It tells you the percentage of participants that agree with a grouping.

    The vertical blue lines represent agreements between participants, while the vertical grey line that moves along the axis shows you the percentage of participants that agree.

    It shows me here that just 20% of participants agreed that “My Beautiful Intranet” sits well with “News releases”.

    Intranet card sorting analysis 4 dendrogram
  4. User categories

    I love this view. You have to spend time grouping and naming the categories at first as it duplicates them. But what I love about it is that, once you’ve cleaned it up, you can easily see additional category names and the cards within them suggested by your audience.

    This helps me tune in to the language of the user and I often find real gems and great ideas for new category names here that I can take forwards and test.

    It showed that many users created a “Research” based label. Here I can group similar labels (shown on the right) and then view which cards users placed on the left.

    Intranet card sorting analysis  5 - user categories

    And this view is also really useful for grouping all the categories called “Don’t know” or “Other”, where users clearly grouped all the stuff they couldn’t categorize and gave it a generic title.

    This shows me the trouble cards that users had difficulty placing.

    Intranet card sorting analysis 6 - user-categories

    And bingo! A few of our question items are here, such as the “Expert blog”, “Benchmarking evaluations” and “My Beautiful Intranet”.

So what’s the next step?

It’s important to note that you need to take all of this with a pinch of salt: labels are presented out of context of the site hierarchy, which can help give meaning to labels. Some cards often sound odd without their parent category in situ.

And, more importantly in any online study, it doesn’t tell you why in the way that speaking to a real person can. So, always supplement it with in-person card sorting.

And as for our website?

Who knows? I’ll need to speak to the marketing team—with limited navigation space, just as for everyone else, we need to compromise.

We may well need to consider grouping together what we do under a label like “Services” and then grouping all our insights, research and best practice, rather than separating it out across different areas.

And as for “My Beautiful Intranet”? — well, we don’t suffer from a lack of excellent entries and the contest gets a good share of promotion and homepage real estate when it’s on, so does it really need it’s own section? Probably not!


Related research

User-centred design (UCD) for intranet navigations

User Centered Information Architecture - coverLarge corporate intranets serve diverse audiences and support multiple goals, but often they have evolved with little control, reaching mammoth proportions.

In this paper we set out the steps to developing an intranet information architecture (IA) using user-centred design (UCD) techniques, starting with why it is so hard to find an intuitive IA, and key success factors.

Free executive summary »


See Also

About the author

Louise Kennedy, User Experience Consultant for the Digital Workplace Group (DWG)Louise is a lead consultant and lead usability evaluator, having benchmarked many member intranets and corporate internet sites.

A web usability specialist, Louise has conducted benchmarking, requirements-gathering, user surveys and testing for a range of international clients and managed the roll-out of large web projects.

She has also written DWG briefing papers on findability topics. Her past clients include the BBC, Syngenta, PUMA and 3M.

Louise loves the mountains and has been known to take conference calls whilst tied to the rock face. She can often be found on a new indoor climbing wall installed at her office in Somerset, England, where she keeps fit in between scheduling benchmark evaluations and writing emails.

Leave a comment

You must be logged in to post a comment.

Are you ready for the digital workplace?
Learn and explore the new digital world of work.
Your information will never be shared with any third party.
Are you ready to connect with DWG?
Learn and explore the new digital world of work.
Your information will never be shared with any third party.
I hereby acknowledge that the Digital Workplace 24 Video Library is designated for my professional use alone and may not be shared with any other parties, in whole or in part, without express written permission from the Digital Workplace Group.