Survey analysis

Netflix survey
Features 13
Responses 2
Status Active
Started Sat 21st May 2022, 8:37pm (UTC)

Standard Kano categorisation

Whichever category has the most votes is the primary category for that feature, highlighted in yellow. Multiple categories may have the same count, or a category might win only by a very small margin. We apply Fong's test [1] to see if the primary category is a statisically significant winner (90% confidence level), indicated with an asterisk *.

[1] Fong, D. (1996). Using the self-stated importance questionnaire to interpret Kano questionnaire results.The Center for Quality Management Journal, 5, 21 – 24.

  Must-havePerformanceDelighterIndifferentReverseUnknown
1
Profiles
1 1 0 0 0 0
2
Notifications
0 0 2 *0 0 0
3
Watch anywhere
2 *0 0 0 0 0
4
Hide stuff
0 0 2 *0 0 0
5
Download / offline viewing
0 0 1 1 0 0
6
Blockbuster movies
0 1 0 0 1 0
7
Homepage recommendations
0 0 1 1 0 0
8
Channels
0 0 0 0 2 *0
9
Top 10 in your location
0 0 0 1 1 0
10
Search filters
1 0 1 0 0 0
11
My List
1 0 1 0 0 0
12
Shared accounts between friends
0 0 1 1 0 0
13
Children's accounts
0 0 1 0 1 0

Distribution between categories

To improve on the basic Kano categorisation, we show the spread of responses between the different categories as a radar chart, and compute a less strict statistical significance test using a Z-Score [2] to a level of 1.5 standard deviations. Categories meeting this threshold have a tick, otherwise they appear with a confidence % level.

[2] Z-Score on Wikipedia.

1
Profiles

Secondary: Performance (94%)
Secondary: Must-have (94%)

2
Notifications

Primary: Delighter ✅

3
Watch anywhere

Primary: Must-have ✅

4
Hide stuff

Primary: Delighter ✅

5
Download / offline viewing

Secondary: Delighter (94%)
Secondary: Indifferent (94%)

6
Blockbuster movies

Secondary: Performance (94%)
Secondary: Reverse (94%)

7
Homepage recommendations

Secondary: Delighter (94%)
Secondary: Indifferent (94%)

8
Channels

Primary: Reverse ✅

9
Top 10 in your location

Secondary: Indifferent (94%)
Secondary: Reverse (94%)

10
Search filters

Secondary: Delighter (94%)
Secondary: Must-have (94%)

11
My List

Secondary: Delighter (94%)
Secondary: Must-have (94%)

12
Shared accounts between friends

Secondary: Delighter (94%)
Secondary: Indifferent (94%)

13
Children's accounts

Secondary: Delighter (94%)
Secondary: Reverse (94%)

Continuous matrix analysis

This analysis plots features on a grid to show the nuance within the categorisation, a method proposed by DuMouchel [3]. You may get slightly different answers compared to other approaches - the others are 'lossy' (we lose information by reducing responses to a single category), whereas this is more sensitive and allows for the strength of each expression (eg. tolerate vs dislike vs expect) within a category.

[3] William DuMouchel, “Thoughts on Graphical and Continuous Analysis”, Center for Quality of Management Journal, Fall 1993

Positive
U
D
D
P
R
I
I
M
R
I
I
M
R
R
R
U
1
2
3
4
5
6
7
8
9
10
11
12
13
Negative
1

Profiles

2

Notifications

3

Watch anywhere

4

Hide stuff

5

Download / offline viewing

6

Blockbuster movies

7

Homepage recommendations

8

Channels

9

Top 10 in your location

10

Search filters

11

My List

12

Shared accounts between friends

13

Children's accounts

Customer satisfaction coefficients

This chart condenses all the information about each feature down to a single relative measure of how customer satisfaction could change if the feature were absent or present [4]. Red / negative numbers show the dissatisfaction if the feature was absent, green / positive numbers show satisfaction if it was present.

[4] Mike Timko, “An Experiment in Continuous Analysis”, Center for Quality of Management Journal, Fall 1993

Sort by

Prioritisation

This sequence of features will maximise overall positive impact on customer satisfaction, based on the analysis of primary categories and satisfaction coefficients. Note: where features have multiple primary categories you may see them repeated in the list. You can choose which primary category you wish to go with.

Statistical significance:
1
Build these first Must-have features
  • Profiles (Performance)

  • Watch anywhere (Must-have)

  • Search filters (Delighter)

  • My List (Delighter)

2
Then build in order Performance & Delighter features, ordered by overall satisfaction gain
  1. Blockbuster movies (Performance)

  2. Profiles (Performance)

  3. Notifications (Delighter)

  4. Hide stuff (Delighter)

  5. Search filters (Delighter)

  6. My List (Delighter)

  7. Children's accounts (Delighter)

  8. Download / offline viewing (Delighter)

  9. Homepage recommendations (Delighter)

  10. Shared accounts between friends (Delighter)

✕
Don't build Indifferent & Reverse features
  • Download / offline viewing (Delighter)

  • Blockbuster movies (Performance)

  • Homepage recommendations (Delighter)

  • Channels (Reverse)

  • Top 10 in your location (Indifferent)

  • Shared accounts between friends (Delighter)

  • Children's accounts (Delighter)

?
Do more research Inconclusive / Unknown features
  • None