Comments on: Survey Suggestions http://blog.mozilla.com/metrics/2008/09/09/survey-suggestions/ When in doubt, sample it out... Thu, 19 Nov 2009 12:52:11 -0800 http://wordpress.org/?v=2.8.6 hourly 1 By: kkovash http://blog.mozilla.com/metrics/2008/09/09/survey-suggestions/comment-page-1/#comment-77570 kkovash Fri, 02 Jan 2009 16:33:50 +0000 http://blog.mozilla.com/metrics/?p=159#comment-77570 Hi Aman, that's another great question. we haven't yet come across a good solution for analyzing text feedback. with the soon-to-be-replaced version of our uninstall survey, we have been reading some comments by hand. fortunately, the new uninstall survey (pictured above), or anything we do in the future with Kampyle, should have a limited amount of text to analyze. If you have any advice for us, we're all ears :) Ken Hi Aman,

that’s another great question. we haven’t yet come across a good solution for analyzing text feedback. with the soon-to-be-replaced version of our uninstall survey, we have been reading some comments by hand. fortunately, the new uninstall survey (pictured above), or anything we do in the future with Kampyle, should have a limited amount of text to analyze.

If you have any advice for us, we’re all ears :)

Ken

]]> By: Aman http://blog.mozilla.com/metrics/2008/09/09/survey-suggestions/comment-page-1/#comment-77395 Aman Thu, 01 Jan 2009 20:00:58 +0000 http://blog.mozilla.com/metrics/?p=159#comment-77395 How are you guys planning to analyze the text feedback received, once it grows in volume. Will someone actually read through all the comments!? How are you guys planning to analyze the text feedback received, once it grows in volume. Will someone actually read through all the comments!?

]]> By: kkovash http://blog.mozilla.com/metrics/2008/09/09/survey-suggestions/comment-page-1/#comment-76908 kkovash Tue, 30 Dec 2008 18:07:02 +0000 http://blog.mozilla.com/metrics/?p=159#comment-76908 Hi Aman -- thanks for the comments. We've been in touch with 4Q and Kampyle about integrating their feedback mechanisms into areas of the Firefox experience (e.g., the installation process). We should have some info to share/discuss shortly. Ken Hi Aman — thanks for the comments. We’ve been in touch with 4Q and Kampyle about integrating their feedback mechanisms into areas of the Firefox experience (e.g., the installation process). We should have some info to share/discuss shortly.

Ken

]]> By: Aman http://blog.mozilla.com/metrics/2008/09/09/survey-suggestions/comment-page-1/#comment-76886 Aman Tue, 30 Dec 2008 13:41:36 +0000 http://blog.mozilla.com/metrics/?p=159#comment-76886 4Q.Iperceptions.com and the conversation around the 4Q concept is exacly that. KISS(Keep it simple Stupid). Also check out kampyle. 4Q.Iperceptions.com and the conversation around the 4Q concept is exacly that. KISS(Keep it simple Stupid). Also check out kampyle.

]]> By: MissLissy http://blog.mozilla.com/metrics/2008/09/09/survey-suggestions/comment-page-1/#comment-57332 MissLissy Wed, 15 Oct 2008 17:48:27 +0000 http://blog.mozilla.com/metrics/?p=159#comment-57332 I'm going to have to agree with most everyone else here. I think 6 questions is too much. I think two questions at the very most would be okay, that is people might take the time to fill the questions out during the uninstall process. The two questions I find to be most important out of the ones you had listed are "Why did you uninstall Firefox?" and "Which browser(s) do you plan on using in the future?" Those two questions alone can tell us a lot of things about the user. I’m going to have to agree with most everyone else here. I think 6 questions is too much. I think two questions at the very most would be okay, that is people might take the time to fill the questions out during the uninstall process. The two questions I find to be most important out of the ones you had listed are “Why did you uninstall Firefox?” and “Which browser(s) do you plan on using in the future?” Those two questions alone can tell us a lot of things about the user.

]]> By: karen http://blog.mozilla.com/metrics/2008/09/09/survey-suggestions/comment-page-1/#comment-57284 karen Wed, 15 Oct 2008 12:00:03 +0000 http://blog.mozilla.com/metrics/?p=159#comment-57284 is there a survey on why people instal rather than why they uninstal? is there a survey on why people instal rather than why they uninstal?

]]> By: Harry http://blog.mozilla.com/metrics/2008/09/09/survey-suggestions/comment-page-1/#comment-55831 Harry Tue, 07 Oct 2008 06:24:33 +0000 http://blog.mozilla.com/metrics/?p=159#comment-55831 Looks like your reasons for leaving are all sticks and no carrots. People might uninstall because they have something more desirable to switch to. I can't imagine what, though! Looks like your reasons for leaving are all sticks and no carrots. People might uninstall because they have something more desirable to switch to. I can’t imagine what, though!

]]> By: Tom Page http://blog.mozilla.com/metrics/2008/09/09/survey-suggestions/comment-page-1/#comment-52673 Tom Page Wed, 10 Sep 2008 19:18:12 +0000 http://blog.mozilla.com/metrics/?p=159#comment-52673 When uninstalling software I often skip these questions (they are becoming more common - e.g. Songbird). If it's one question then fine. If it's several then many people are likely to just close the window. Remember many people are not technical, and may not know their IE version, or has been said above what support.mozilla.com refers to (or Jesse, what IRC refers to, but maybe that's okay) When uninstalling software I often skip these questions (they are becoming more common – e.g. Songbird). If it’s one question then fine. If it’s several then many people are likely to just close the window.

Remember many people are not technical, and may not know their IE version, or has been said above what support.mozilla.com refers to (or Jesse, what IRC refers to, but maybe that’s okay)

]]> By: deb http://blog.mozilla.com/metrics/2008/09/09/survey-suggestions/comment-page-1/#comment-52650 deb Wed, 10 Sep 2008 12:16:50 +0000 http://blog.mozilla.com/metrics/?p=159#comment-52650 I think six questions may be too long -- I found myself skimming by the end, and if I were just trying to uninstall my browser I doubt I would take the time to read through, answer, and submit a survey that long. Is there any way to just show three of the six questions randomly to each person? I'm not sure if that would make sense or work statistically, but while all six questions are interesting, I think three questions would increase the number of responses you get. I'm pretty sure we can avoid rolling our own survey system again...Stas's tool did a great job for the about:mozilla survey, although I'm not sure it currently has the sort of reporting tools you might want (as David mentions). I think six questions may be too long — I found myself skimming by the end, and if I were just trying to uninstall my browser I doubt I would take the time to read through, answer, and submit a survey that long.

Is there any way to just show three of the six questions randomly to each person? I’m not sure if that would make sense or work statistically, but while all six questions are interesting, I think three questions would increase the number of responses you get.

I’m pretty sure we can avoid rolling our own survey system again…Stas’s tool did a great job for the about:mozilla survey, although I’m not sure it currently has the sort of reporting tools you might want (as David mentions).

]]> By: David Rolnitzky http://blog.mozilla.com/metrics/2008/09/09/survey-suggestions/comment-page-1/#comment-52554 David Rolnitzky Tue, 09 Sep 2008 22:28:47 +0000 http://blog.mozilla.com/metrics/?p=159#comment-52554 I really like the 3 new additional questions -- will be really interesting to get that data. One option for implementing the survey would be to use Stas's tool (which we are planning on using for the first-run survey) instead of a third party. The upside is that it's already developed. The only real downside is that he hasn't yet incorporated reporting tools that are as sophisticated as some of the 3rd party solutions out there. I really like the 3 new additional questions — will be really interesting to get that data.

One option for implementing the survey would be to use Stas’s tool (which we are planning on using for the first-run survey) instead of a third party. The upside is that it’s already developed. The only real downside is that he hasn’t yet incorporated reporting tools that are as sophisticated as some of the 3rd party solutions out there.

]]>