Feed on
Posts
Comments

As promised from yesterday’s blog post, we’re sharing all the answers to the open-ended questions we asked in the survey about the Mozilla Summit 2008.  Hope you find these interesting.  Please send us your comments.  And, thanks again if you took the survey.

What people liked most

  • Meeting other members of the community and putting face to names, getting to know people outside of IRC/Bugzilla.
  • Getting to known the Localizers and hear their stories.
  • Hearing about new projects like Ubiquity
  • Staying together in 1 hotel, eating meals together
  • Moz Café- gave an intimate feel to a large event
  • Hallway conversations
  • The social interactions
  • “It doesn’t matter what you do for Mozilla, you can talk to everyone and no one needs a tie.”

What People Liked Least

  • Too many sessions, couldn’t do everything, not inviting more people.
  • More recording and video for those who couldn’t attend
  • Bus Ride- Sorry shit happens
  • The pacing felt a little too rushed
  • More Down time
  • Communication barriers, felt they weren’t fluent/comfortable enough in English to speak up in discussions
  • Printed schedules
  • Not “the summit” persay, but I was frustrated by the lack of forum for participants to chat in before the summit. I understood the need for the mailing list to be pretty low traffic, but having a separate, opt-in mailing list, webforum, or other method for participants to chat in would’ve been very helpful and probably have reduced the amount of questions sent to the mailing list and Dan directly.
  • Well, besides the travel mess at the end, which was handled brilliantly but still was quite messy… For all the talk about getting some agreed goals for the next 2 years at the beginning of the summit, there seemed to be no follow-through or actual project goals set, or evey really discussed after the first day. That felt weird. The XULRunner breakout was a complete bitch-fest and made me feel quite awful… I had to leave
  • Understand the audience- non-native English speakers
  • There were 2 groups of contributors: “The Real Developers” and “localizers”. Unfortunately this is common behavior of developers directed to localizers, not Mozilla specific.
  • The icebreaker didn’t work for me, since there was only one other person who had the same sticker as me, and that happened to be another Mozilla employee. Kind of defeated the point of having an icebreaker. The other icebreaker we did was an exact copy of one done at an earlier Summit and I did not find it that engaging.
  • I was disappointed that some of the sessions that were initially advertised never materialized and in some cases were replaced by sessions that were more about “status” and less about the future of Mozilla.
  • There was no time to enjoy the activities around Whistler unless you came early or stay late, which I could not do. It would have been better to leave some free time on one of the days so we could have actually been outside.
  • I needed dinner on Monday night after a day of travel, and found that others shared my opinion - they were still hungry after the reception.

Improvements

  • Have a 1 hour lightning talk session in the morning, for all attendees (i.e. no conflicting sessions), where every presenter for that day gets exactly 3 minutes to plug and summarize their presentation. No slides. It would make it more likely that people went to the right thing, and give people at least a taste of what’s going on across the project even if they are e.g. stuck in the Thunderbird room because that’s their main focus.
  • Badges with names on both sides.
  • Speed ear-bending: an hour session where Mitchell, John, Mark, Frank, Brendan, Shaver, Mike etc. sit at tables, and people queue up to get 3 minutes to bend their ear about a particular pet topic. Exhausting for them, perhaps! But maybe good for openness and getting issues raised.
  • A location with more than one sub-seven-hour route to the airport? :-) Seriously, well done to everyone concerned - a triumph of organization. (What is a “Breakout Session” in the question above?)
  • more free time. The icebreaker the first day sucked, and didnt do anything for me.
  • The wifi was splotchy in the conference rooms.
  • The location was amazing though, and i wanted more time to explore.
  • MozCafe was a great idea, and we need more fun things in there next time. (maybe two rockbands).
  • i didnt understand the lightshow and why we spent so much money getting that setup and imported there. Dont need it next time.
  • Overall, i loved it, and enjoyed meeting new people, especially the localizers.
  • Maybe a designated block, once per day, where there are no sessions, no lunch - just deliberately-idle time? It’s hard to have to trade off meet-ups with interesting people against eating lunch or attending a session - explicit downtime gives introverts a chance to recharge on their own, and social butterflies a chance to flit around without feeling like they’re missing things
  • a giant photo session for all? some paparazzis specifically assigned to put the people photos into mozilla digital memory bank? :)

Suggestions

  • Community Directory

The following is a summary of the information gathered about Mozilla’s 2008 Summit in Vancouver.  We polled all participants to get a sense of the conference content and organization.  Here are some results and charts summarizing our findings.

Summit Data

  • Location:  90.3% responded that it was 4 to 5 (scale:  1 - bad, 5 - great)
  • Communication:  82.3% rated communication about the summit at 4-5; 14.2% rated it as 3  (scale: 1-poor, 5-excellent)
  • Conference facilities:  91.4% rated the conference facilities 4 to 5 (scale:  1 - bad, 5 - great)
  • Break out Sessions: 67.5% felt it was about right
  • Summit Length: 42.9% about right 44.9% though it was too short
  • Session attendance: 66% responded that they went to 5-12 66%; 24.4% went to 12-15 sessions
  • Attend again?  97.5%

Here are some charts to review as well that help illustrate some answers to the questions.

We also have all the “fill-in-the-blank” style answers to the open-ended questions.  We can post those in another entry, but we decided to keep them out of this post to help keep the length appropriate.  We’ll post that information later.

Today we’re closing the series about the SUMO survey with a post about the last question of the survey:

What resources make or would make the user-to-user support in your language more effective?

We already saw the average responses to this question in one of our previous post in the series. Here there are again:

As you can see, resources based on text were ranked higher than any others. On the other hand, Instant Messaging or Tutorial videos were ranked much lower, ending slightly above ‘Neutral’. It might be interesting to see what impact on these results had the profile of the survey takers. Thanks to the demographic variable that we discussed previously, we were able to learn how each profile responded to the question.

The above chart shows how many respondents of each profile took the survey. 19% of the survey takers were end-users and 32% were community members actively contributing to the project. Is it possible that the responses given by advanced users (who were more numerous) outweigh those of end-users in this question? What preferences do the end-users have and, consequently, what is the best way to improve their support experience?

In order to compare the average responses between the user profiles, we reduced the number of analyzed variables from 10 to 3, by means of factor analysis. The new extracted variables were:

  • Textual support, representing:

Tutorials/How-to’s
Troubleshooting articles
Forums

  • Visual support, representing:

Screenshots
Screencasts/videos

  • Interactive support, representing:

Live Chat
IM
VoIP

Average values of these new variables are visualized in the following chart.

We clearly notice that the end-users are much less enthusiastic towards textual support, and in the same time they prefer interactive help slightly more than other users. The visual support has been similarly rated across all user profiles (the differences weren’t statistically significant—hence the grey color in the chart).

In summary, thanks to the factor analysis, it was possible to make the comparison of preferences between user profiles easier. It turned out that even though the interactive resources, such as Instant Messaging and LiveChat, were ranked lowest by all respondents, there were significant differences between user profiles in the responses. We learned that the end-users favor textual support much less than other groups and show a slight preference of the interactive support.

Good support is an essential part of the product experience in its holistic approach. It is even more important for end-users who may be even using the product for the first time. This is why it was important for us to see what this particular group though about Mozilla support experience. Our study may serve to confirm that indeed the introduction of LiveChat on support.mozilla.com was a valuable addition which will help users looking for support.

* * *

This is our last post in the series about the SUMO survey. The series included:

  • the first post, in which we presented the objectives of the survey and the questions,
  • the second post, in which we discussed who the survey takers where and what languages they spoke,
  • the third post, in which we analyzed the overall average responses and dove into the differences between the user profiles,
  • the fourth post, in which we focused on the differences between locales,
  • and this post, the fifth one, in which we looked closer at the responses to the last questions of the survey.

We hope you liked the series and found the data as fascinating as we did. We encourage you to post your thoughts in the comments or join us on #surveys on irc.mozilla.org.

This is a post about SUMO, the survey we conducted before our most recent survey.  Although we just wrote about the Mozilla Newsletter, we are still wrapping up our analysis of the SUMO survey.

In our series about the support experience survey, we already discussed who the survey takers were, as well as their average responses to all the questions (and the differences between user profiles). Today, it’s time to look into the differences between locales.

Question 1: Support experience rating

As we have often mentioned previously, doing an analysis of the differences between locales can be tricky. There are some cultural factors that can play significant role in how people from each locale respond to a question. We will not, however, explore these factors now. We will stick to the data we have from the survey, but keep in mind that some differences may be cultural ones.

This is how John Williams, who offered his help with the analyses we’re doing, explains this using the example of the first question of the support survey (”How would you rate the support that community provides for Mozilla products in your language?”):

The table below shows how many times each locale rated a product the lowest, and how many time each rated a product the highest. Note that because of the overlapping feature of multiple comparisons some the counts do not sum to the number of products.

Locale Low Count High Count
de 5 1
fr 5 1
hu 3 5
ru 4 5
pl 2 5
it 2 5

It seems clear from this summary that German and French respondents generally rate the products lower than do respondents from other locales; conversely Polish and Italian respondents rate the products higher.

Let’s take a look at the average responses to this question:

You can certainly see that Firefox support has been rated the highest. There are two observation to be made here:

  • Firefox is the main Mozilla product, so its support resources are the most developed
  • Firefox is also the most known Mozilla product, and as such, many users are familiar with its support resources. There were very little missing values (’I don’t know’ responses) among the responses to the Firefox rating question

We also notice (just as John predicted) that the average responses to all three questions were generally lower for such locales as French and German, and higher for Hungarian, Italian and Polish.

The average responses to this question continue in the next chart.

Generally, the responses to these products were lower than to Firefox and Thunderbird. It is still interesting to see that the support for add-ons has been rated well (slightly below 4 for all locales), similar to Mozilla overall and Thunderbird from the first chart. And even if Calendar and SeaMonkey support are rated lowest in the chart, it’s important to remember that in general, all products have been rated on the positive side of neutral (above 3).

In this chart we’re showing the average responses for a product for each locale. You may remember that we also asked about Camino, which is not shown in the chart. This is because Camino had a lot of missing values (almost 75% of all responses) and the differences in responses for it between locales are not significant.  If you’re interested in the overall average across all locales, see our previous post about the SUMO survey.

Question 2: Characterizing support

Nine statements in our survey asked survey takers to characterize the support experience, which translated into nine variables. With nine different locales to compare, this gives us 81 figures to analyze, which was too many!  In order to make comparisons easier, we first looked at two variables covering quality of localization and then, we reduced the others to one variable that covered quality of content.

Localization of the support resources

We asked two questions related to the quality and sufficiency of localized support resources:

  • Most of the relevant information can be found in my language
  • Support in English is sufficient

The average responses to these two questions are show in the chart below:

Although statistically different, the average responses are very similar for all locales: in general, the survey takers agreed that most of the relevant information can be found in their language, as well as disagreed that support in English is sufficient (in the chart, value 2 means ‘Disagree’).

Support experience assessment

6 variables related to the quality of content were strongly correlated which allowed us to replace them with a single variable using the factor analysis. These six variables were:

  • Most of the relevant information can be found in my locale
  • Navigation on the support sites is easy
  • The support sites are up-to-date
  • Most common issues are covered well
  • The support sites load quickly
  • New issues are quickly addressed

We extracted one new factor (one new variable summarizing all six others) with similar loadings from all 6 variables. Consequently, we named it “support experience assessment” and used it to easily compare the support experience between locales.

Again, we see differences between locales that are most probably due to cultural factors. It is still interesting, however, to see that Italian and Russian locales score highest, whereas Polish, Portuguese and German score lower than other analyzed locales. We should also notice that in the beginning of the post, we included the Polish locale to the group of the ‘eager’ ones, so probably its low score in the last chart should be investigated in more detail.

What’s next?

In the next and last post about the SUMO survey, we will take a closer look at the last question, in which we asked what resources would make the user-to-user support more effective.

Today, we are starting our next series of posts in which we will present the results and our findings from the 3rd community survey. In May, we worked together with Deb on creating a survey about the about:mozilla newsletter. After 6 months of publishing the newsletter, Deb decided it was a good moment to survey the readers about what they thought about the idea. Over the first six months, Deb sent out 21 issues of the newsletter, so indeed it was sufficient for the readers to get familiar with the style and form of the newsletter over this period.

In this post, we will focus who took the survey and what languages they spoke. We will also take a rather unusual look into the way in which the respondents accessed the survey, i.e. we will look at the referrer information recorded in our logs and try to extend our analysis with this data.

Background info

The newsletter has been published each week for the past 6 months. It’s written in English and distributed through various channels, such as plain text e-mail, HTML e-mail, RSS feeds and Mozilla DevNews site among others.

When we started drafting the newsletter survey, we asked Deb to create objectives for the survey, as well as the example questions. The three objectives for this survey were:

1. Figure out who is reading the newsletter and how (what channels they use)
2. Understand the value of the newsletter
3. Learn how to make it better

For the first objective, we used following four questions.

1. How do you read the about:mozilla newsletter?
2  What other sources of news about the project do they use?
3. How did you first hear about the about:mozilla newsletter?
4. Demographic question (”I am…”)

After some thought, we determined that the second and third objectives were closely related.  We wanted to find a way to merge these into one smart question.  That new smart question would encompass the value that the newsletter provided (objective 2) and the suggestions for improvement (objective 3).

We used following statements for this question:

The newsletter:
…repeats too much content that I’ve already seen in other places.
… topics are a good summary of activity on planet.mozilla.org
…content is generally useful and interesting to me every week.
…should contain more news about Mozilla projects other than Firefox.
…should contain more news about third-party projects using Mozilla technology.
…should focus more on technical and software development-related topics.
…should contain more general project news, such as governance and organizational issues.
…is published frequently enough.
…should be localized.
…is the appropriate length
…should contain more community content and human-interest stories.

To learn more about the topic the newsletter’s readers find interesting, we featured the following open question:

“I would like to see the newsletter contain more content about… [ specify ]. “

We created this question because we figured that there was no way to predict all possible choices and present them in a list of a finite length.

The survey

The survey was open for 14 days during which a total of 317 responses were submitted. We distributed it by the newsletter itself (it spanned three issues), as well as through posts on Deb’s blog, and our blog. If you look at the responses submitted over time, you will certainly notice the bumps due to the mention in the consecutive newsletter issues.

Among 317 respondents, a vast majority were English speakers. On the chart below we can see which language versions of browsers the respondent were using.

246 out of 317 used an English version of their browser. Because the newsletter is published in English only, such a result was to be expected. This fact, however, has also a second meaning. It shows us that only a small fraction of respondents were using different locales, which most likely suggests that the newsletter as a whole is mostly popular among English speakers.

Here are some demographics:

It turns out that 87% of the respondents described themselves as the end-users of Mozilla products. More over, 73% (201 respondents) of them didn’t select any other answer related to contributing in the project. If we group answers in two categories: “observes” and “contributes”, we’ll see that only 31% of the respondents contribute to the Mozilla project.

See how the percentages don’t add to 100%? It’s because respondents were able to select multiple answers in this question, so that some of them landed in both categories. And how many didn’t? 31 percent in the “contributes” category means that, in general, 69% of the respondents described themselves as observers not actively participating in the project. This means that the newsletter has a wide audience of end-users and observers. It will be interesting to see in our next posts what this group thinks about the newsletter, as well as if they use it as their only source of information about happenings in Mozilla.

In over 75% of cases, we were also able to detect where the respondents came from to take the survey (where they read about it). It turned out that almost one third of the respondent came to take the survey from the MDC DevNews site (blog-like site where the newsletter is published). 13% read about the survey in their RSS readers. The referral data is presented in the chart below:

This was just an introduction to the series about the about:mozilla newsletter survey. In our next posts, we will focus on the responses to the main questions of the survey.

Due to the fantastic work of Marcio Galli, we are happy to announce that the Community Surveys website at surveys.mozilla-europe.org is now available in Brazilian Portuguese (pt-BR). We are excited to be able to reach to yet another community in their native language.

Localization is an important part of the Community Surveys project.  Currently, surveys.mozilla-europe.org is localized into 18 languages:

  • Albanian
  • Catalan
  • English
  • Finnish
  • French
  • German
  • Hungarian
  • Italian
  • Norwegian
  • Polish
  • Portuguese
  • Portuguese (Brazil)
  • Romanian
  • Russian
  • Spanish
  • Swedish
  • Turkish
  • Ukrainian

Many thanks to all the localizers for their hard work. These foks have been occupied with everything that goes into the upcoming launch of Firefox 3.  Yet, they have still found time to help localize our surveys.  We really appreciate the help.

A friendly reminder, if you read the about:mozilla newsletter, please remember to fill out the reader survey.  You can find the survey here.  It will also be listed again in the next edition of the newsletter due out May 27, 2008.

Mean responses and the missing values

In the last two posts about survey 2, we learned the purpose of the survey and who took it.

For this post, we will start looking into the responses to our questions. Remember that we asked the following:

  1. Please rate the overall quality of the support for each product;
  2. How much does the user agree or disagree with a list of statements describing the support experience;
  3. Please rate the usefulness of particular content types (tutorials, screencasts, chats, etc.).

We can start by summarizing the means to each answer, typically the easiest statistic to interpret and visualize.  But, as a forewarning, the chart below is pretty long!

mean-responses-and-missing-values.png

Darker bars are the mean responses and the thin vertical grey lines represent the levels of the scale for each question:

  • ‘Lowest quality’ to ‘Highest quality’ for the first question
  • ‘Strongly Disagree’, ‘Disagree’, ‘Neutral’, ‘Agree’ and ‘Strongly Agree’ for the remaining two questions

Perhaps it’s not surprising, but Firefox’s support was rated highest (our guess: because of its depth and completeness), whereas products like SeaMonkey, Calendar and Camino had a very high ratio of missing values (the ‘I don’t know’ responses).  As the support rating lowers for each product, the percentage of the missing values increases, which also constitutes an important piece of information.  60-70% of the survey takers didn’t know how to rate the quality of support for SeaMonkey or Calendar—probably because they hadn’t used support or the application itself.  For Firefox, we can say that its support was rated between 4 and 5, where 5 was “highest quality”.  NB, only about 6% of the survey takers didn’t know how to rate Firefox support.   Please keep in mind that every respondent was thinking about support in their language, so in our next post we will calculate the mean responses to this question for every locale.

For the next two questions, we should interpret the bars differently.  Each of the thin vertical grey lines corresponds to a level starting with ‘Strongly Disagree’ on the left, through ‘Disagree’, ‘Neutral’, ‘Agree’ and, for the rightmost line, ‘Strongly Agree’.  The length of the darker bar for the first statement means that, again on average, the respondents tended to agree that “the support sites loaded quickly.” As for the brighter bar, we interpret it in the same way as above: about 10% of the survey takers didn’t know how to react to this statement.

When you look at the average responses to the second question, you’ll see some interesting findings:

  1. “Support in English is sufficient” scores lowest (between ‘disagree’ and ‘neutral’), and at the same time, it has very few missing values.  So, people certainly had an opinion on this one since there were not many “Don’t Know” responses.
  2. Two to three other statements have neutral response means (the corresponding dark bars end close to the middle of the chart)
  3. Six statements show that the survey takers well above the midpoint and reflecting agreement.

Is this helpful data if we see mostly “Agrees”, “Neutrals” and one “Disagree”?

Keep in mind that every person who responded to these two questions reflected on their unique support experience and then submitted their response. Also, remember that support of the Mozilla products

  • can be accessed in different languages (and the quality of the support depends on quality of the localization),
  • is often decentralized (each local community has its own discussion board),
  • and aims to satisfy each users distinct needs.

If the cumulative responses were “Agree”, the means may still differ across certain groups of people. We can see that the “Most of the relevant support can be found in my language” statement scores high (respondents tended to agree with it), which is a good first step toward understanding how the local communities are doing in terms of the user-to-user support.  One interesting thing to note is the “The support sites make use of video” statement.  It scores low, but also has an outstanding ratio of missing values.  Could you argue that an “I don’t know” answer is close to “Disagree”?  If someone hadn’t ever seen a video on a support site, but was careful in their judgments and supposed that there might be other support sites where videocasts were available, they were probably more likely to answer “I don’t know” instead of “Disagree”.  In this survey, we assumed that an “I don’t know” answer equaled “I haven’t ever seen any of them”.  Therefore, we decided that the survey takers who described themselves as end-users were more likely to give an “I don’t know” answer to this statement.

Mean responses by user profile

Thanks to the user profile variable, we were ablt to split the cases and plot new charts for 3 different user profiles. These were community members (49% of respondents), active community members (localizing, coding, etc.; 32%) and end-users (19% of the survey takers).

user-profile.png

We observe the biggest discrepancies between two extreme profiles: end-users and active contributors. The community member profile seems to be in the middle for most of the questions.   For example, end-users rate the quality of the support for each product poorer than the contributors (green bars are longer than the yellow ones). More visible differences can also be observed in the “Most of the relevant support can be found in my language” statement. It seems that active contributors are more enthusiastic here.   Why is this the case?  Perhaps, it’s due to prior knowledge about the products (and computers in general), greater familiarity with the technology, and a better command of English.  What do you think?

Two other statements bring forward even bigger differences in the way the end-users and the active contributors responded.

  • “The support sites make use of video”

Why do end-users agree more than active contributors that there are support sites using video?  This is probably a result of what we have discussed above: respondents might have preferred the “I don’t know” answer to this question over “Strongly disagree” or “Disagree”, even if these ones would have been more accurate. We can see that there were nearly 50% of end-users answering “I don’t know” to this statement, and only half as many of the active contributors. Some end-users did agree on this topic, but some didn’t and we can assume that some of them selected the “I don’t know” answers instead of “Disagree”. Using this theory, we can understand why end-users scored this higher: there were not enough “disagree” responses to counterbalance the “agree” ones.

  • “Users rarely ask the same question more than once”

It seems understandable that active contributors are more likely to disagree. After all, they’d probably seen lots of duplicated questions in the forums and Bugzilla. :)

In the third question we see that end-users tend to favor direct communication (IM, VoIP) over text-based communication, compared to other user profiles. We also notice that forums turned out to be one of the most favorite channels of communication for active contributors—and much less so for the other profiles.

Finally, here is the graph of the missing values across different user profiles.

missing-values-user-profiles.png

* * *
In the next posts we will reduce the number of variables by means of the factor analysis. This will allow us to better synthesize the analysis without loosing much of the information enclosed in the original set of variables.

Thanks for reading this to the end!!

Today, we launched our third community survey, focusing on the about:mozilla newsletter.  It was announced in the newsletter this morning and will be open over the next couple weeks for you to take.  Please take a moment to complete the survey because we’d like to hear from you!

If you’d like to learn more about the newsletter, check out this wiki siteDeb Richardson is the editor-in-chief of the newsletter and she puts so much work into it from week to week.  about:mozilla is written so readers can get a good summary of the key goings-on inside the organization and community.  But, we can make it better and this survey will help us to learn how.  Please take an extra 2 minutes to complete the survey to let us know what you think.  We promise it only takes that long…or less!  :)

Thanks everyone!

How many people took the second survey and who were they?

Over the course of three weeks, 1,558 people took the second community survey.  We published the survey in 16 languages, thanks to the work of the localizers from mozilla-europe.org.   This step was critical for the survey because we wanted to see how the user-to-user support was doing in each local community and to what extent English resources were useful to each community.

Below is the frequency of survey takers across the various languages in which we offered the survey.

picture-1.png

For five of the languages (English, German, French, Portuguese and Spanish) we asked the survey takers to indicate their country of origin, since those languages are spoken in multiple countries. Here’s that breakdown:

picture-1a.png

Some initial comments:

  • As you can see, 60% of the people who took the survey in English came from non-English speaking countries. We’ve done a pretty good job localizing this survey, but there are obviously people from other countries who speak other languages who are interested interested in the project.
  • More than a half of surveys taken in Spanish were taken in the Latin and South America.
  • France and the Germany dominated their locales.
  • Look at the global participation!  We want to extend these surveys to Southeast Asia, Japan, and China…working with Gen and Mozilla China to do that this summer.

(Originally, the Community Survey project was targeted the European communities (as Staś’s internship project at Mozilla Europe). We quickly shifted to a more global scope, and we were thrilled to see so many people from other parts of the world expressing their interest in the project and the survey. Thanks for your support!)

Here is another interesting question:  how many surveys were taken each day when the survey was open?  See the graph below:

picture-3.png

As you can see, the peak happened two days after the launch of the survey. Quickly afterwards the number of surveys taken daily stabilized at around 50-60, but you can still see the Christmas and the New Year’s eve when we got the least responses. We hit a second burst two days before the end of the survey due to a friendly reminder posted on our blogs.

Demographics

This survey was the first one to feature a demographic question, a lesson learned from last time. Below is an illustration of the frequency of various responses to our question, “Who are you?”:

picture-2.png

As you can see, we presented seven answers to the demographic question and allowed for multiple responses. To avoid difficulties in the analysis, we then aggregated this data into three separate variables:

  • End-users — those who responded that they were users of Mozilla products, but didn’t select any other answer
  • Community members — those who responded that they used Mozilla products and followed the news on the Mozilla project
  • Active community members — those who respond that they were localizers, developers, users helping other users, and authors of the support articles for Mozilla products.

Keep in mind that creating these groups was an arbitrary decision we made to help with analysis. We assumed that people who selected “I follow the news on Mozilla” were part of what we call the “Mozilla community” or considered themselves members of this community.  What do you think? Should we simply ask another question “Do you consider yourself a member of the Mozilla community”? And, what about all those people who follow the news Mozilla just because they follow IT-related or Internet-related news in general? These are the kind of questions we face every time when working on our surveys. Feel free to join the discussion.

Below is a look at the number of survey takers in each of these new buckets that we created.

picture-2a.png

19% of the survey takers selected the ‘I am a user of a Mozilla product’ option as their only answer (the end-user profile), and 49% additionally responded that they followed the news on the project (the community member profile). Therefore, 68% of the survey takers (19% + 49%) don’t localize, don’t develop, don’t write documentation and don’t consider themselves actively participating in the forums. In fact, we reached a very wide group of people who feel connected somehow to the Mozilla project and were able to learn their opinions on support.

Finally, let’s take a look at the structure of the user profiles among the survey takers for each locale.

1___@___picture-1.png

And the composition of locales by percentage…

1___@___picture-2.png

The important next step, which we will start to discuss in the next post, is to look at how each question was answered by these profiles.  It should be pretty interesting to see how end-users, community members, and active community members are answering support-related questions across locales.

Thanks for your comments and reading this.  More to come on the second survey soon.

Next »