Archive for March, 2009

Weekly SUMO meeting 2009-03-30

Tuesday, March 31st, 2009

Sumo

  • Weekly metrics
  • Last week’s weekly support issues
    • Cww to investigate general slowness on Mac and report back to team asap
    • We do have a separate page for the problem with the “Firefox was recently updated” tab opening on every start (because prefs.js is locked/damaged).
      • We need to optimize the search so it’s easier to find, as this is a common issue

Knowledge Base

  • The parent options window articles will start to be purged.
  • Searching for ways to make article comment triage community based.
    • cilias to start discussion in Contributor Forum
  • Couple of blog posts coming: Writing concise docs, and monitoring a category
  • It looks like April 7 is the date for updating KB from 3.1 to 3.5

Forum

  • About 600 users registering to ask a question in the forum
    • Need to streamline the process of getting help in the forum so people don’t create accounts since it’s not helping them
  • About 100 duplicate posts last week because of server problems: getting timeout errors when posting

Live Chat

  • Metrics update: 15 active helpers (1 new)
  • Crashes (Flash, sqlite), corrupt sqlite files, and ‘chrome registration failed’ remain top complaints
    • Flash tracking in Omniture was recently enabled — does it work with SUMO? djst to check with the president
  • New blog post about Live Chat web client PRD

Roundtable

The road to SUMO 1.0, in retrospect

Monday, March 30th, 2009

Tomorrow night (pacific time), SUMO will reach that magical version number 1.0. Although we already have a grand roadmap leading up to 2.0, today we’ll be looking back at all the work that took us where we are today. There is one particular achievement we’ve made that I would really like to emphasize on; I’ll get to it shortly, but first, some background.

How it all began

After Firefox 1.0 was released, the user base rapidly expanded — not just in the sheer number of users, but in types of users as well. Firefox quickly went from an early-adopters’ browser for the tech savvy (not because Firefox was hard to use, but because early adopters tend to have an affinity with technology) to a mainstream browser used by everyone. Meanwhile, some people in our naturally very tech savvy support community started to realize that we were struggling to keep up with the load. Both in terms of number of the volume of users that needed support, and the different kinds of users. Also, the web server itself was noticeably struggling with the increased web traffic.

After exploring different options and discussing within the community what we should do to improve the situation, it became clear that the new situation demanded a support platform that was better suited to our needs. One that would allow us to gauge the frequency of the most common support issues our users were having with Firefox. One that would allow the support documentation to be available to those other 50% of Firefox users that are not speaking English. One that would allow us to hack and improve upon the platform. One that could scale to meet the demand of over one hundred million users (at the time; today, that number has more than doubled). Most importantly of all, one that would enable the Mozilla community to contribute how it wanted to.

As a result, the SUMO project started.

What followed was a bunch of decisions that had to be made. What platform would we use to build this support website? Would we take something tried and true, like phpBB and MediaWiki? After careful examination of our options, we decided to pick something untried and new: TikiWiki. It had a wiki (our Knowledge Base) and forums integrated in one package, it had a nice plugin system that would allow us to extend the functionality to make the package more user support oriented. Also, the TikiWiki community was eager to collaborate to help us build SUMO faster.

In retrospect, choosing that path took us more work, and we still haven’t delivered on all things we want to improve with the platform. However, we are certainly getting there and SUMO 1.0 feels like a great achievement and a solid foundation for our ever-improving open source support platform.

Aside from choosing the technical platform, we also had to make tough decisions on things like the scope of our support documentation (what exactly do we support?), what kind of support experience we would like to present to our users, how localization should work, how common support issues would be reported to the development and QA teams, and so on.

Where we are today

SUMO deserves the 1.0 version number today because we are finally in a state where the platform can scale to meet the demand of our massive user base. We have a solution in place that can give us insights about which problems users are most frequently having with Firefox. We provide step-by-step solutions to over 200 known problems, and for any problems we don’t have the answer to already, we offer both e-mail support via our forum, and a way to get personal help via Live Chat.

Weekly unique visitors of support.mozilla.com

Weekly unique visitors of SUMO since Firefox 3 was launched.

Every month, support.mozilla.com sees over 12,000,000 unique visitors. Every week, about 2,000 people get their problem solved in our support forum and Live Chat. Every day, over 1,000 people actively tell us that their Firefox problem was solved by an article in the Knowledge Base — note that that’s likely a small number in comparison with all the people that are getting help without letting us know!

Our biggest achievement

Part of the Mozilla community. Photo by Tristan Nitot.

Decisions, theory, and technology aside, our biggest achievement with SUMO is without hesitation our community. It’s really the amazing people in our community that made all this possible. Without them, we wouldn’t have a Knowledge Base with over 200 articles for common Firefox support issues. We wouldn’t have a support forum where users can have their problems solved. We wouldn’t have anything to offer for users who want to get in direct touch with a Firefox expert. We wouldn’t have anything to offer for users who don’t speak English.

Simply put, our community is what makes the Firefox Support website help thousands of users every day. I think that is the most important lesson learned in our road to 1.0 and something for everyone in our community to be truly proud about.

Designing a Live Chat web client

Friday, March 27th, 2009

Over the past few weeks we’ve been working to collect ideas and feedback for the SUMO Live Chat web client. Contributors currently use the open source Spark client to help in Live Chat, but we’re working on a web-based client to allow everyone to participate from any standards-compliant web browser. This web-based client will allow Live Chat to be tightly integrated with the SUMO Knowledge Base and Forum, streamlining the chat process for both users and contributors.

Spark has a lot of neat features that we will want in our web client, and we’re planning a number of improvements based on feedback from the community. To guide development, we’ve focused on some of the best ideas we’ve received to create mock-ups of the new Live Chat interface.

Live Chat web client mock-up

Much of the new functionality is intended to decrease the length of chat sessions, increasing user satisfaction while allowing contributors to help more people in less time. Communication following a chat session will be streamlined, and transferring chats between helpers will become more efficient. We will also be able to integrate with the new SUMO search engine, allowing helpers to find solutions to most issues without needing to open another window.

More details and implementation requirements for the Live Chat web client are on the project requirements page. We’d love to get feedback on these concepts or on implementation ideas — the best place to get in touch is the SUMO Contributors forum. (If you’re a Java developer and are interested in helping with this project, you can find the SUMO development team in #sumodev on irc.mozilla.org.)

Live Chat, the most social way to help with Firefox Support, allows contributors to chat with Firefox users and with each other to help people use Firefox. To see more ways to get involved with SUMO, check out our guide to getting started.

Minutes of SUMO meeting 2009-03-23

Monday, March 23rd, 2009

Sumo

  • Weekly metrics
    • Start page bounce rate is now based on support.mozilla.com/en-US/kb/ instead of support.mozilla.com/en-US/kb/Firefox+Support+Home+Page. The latter is not nearly as trafficked as the former (by a factor of 10) so this will give us much more reliable data.
      • The traffic that still goes to Firefox+Support+Home+Page are locales that do exist at mozilla.com but not yet on SUMO
    • What do we base “New Contributors” on?
      • The subset of “Active contributors” that registered last week
  • Last week’s weekly support issues
  • Slight changes in SUMO milestone version numbers: rather than releasing SUMO 1.0 and then immediately releasing 1.1 the following week, we decided to renumber the releases to give the psychologically more powerful 1.0 version number more focus (and making it remain the current release for longer than just one week). As a result:
    • SUMO 0.9.5 (formerly 1.0) will be released tomorrow, which will include the backend of the localization dashboard — however, the full functionality will not be included until SUMO 1.0 is released.
    • SUMO 1.0 (formerly 1.1) will be released next week, giving us a lot of usability fixes and polish based on the UX audit.

Knowledge Base

Forum

  • Timeouts on the forums led to lots of dupes this week. So numbers are possibly all screwy. (And related, it’s time consuming to lock them all so many of them are marked “proposed solution” so stats next week will be screwy too.) This is bug 484753.
  • Also traffic is down but so is participation but may be related to the above.

Live Chat

  • Metrics update: 28 new helper accounts, 4 new helpers taking chats, 18 active helpers
  • Asking for feedback from the community in the Contributors forum

Roundtable

  • If you see cases of malware based on downloading Firefox from a third-party site, Mozilla has a page to report the site. [3] (Already added to our article on malware.) – cilias

Making use of article feedback

Thursday, March 19th, 2009

At the bottom of each knowledge base article, users have the option of submitting article feedback.

article-feedback

Feedback is great, but pointless if we don’t act on it. Every week, we take useful article comments, and post them in the Contributors Forum, so the support community can address that feedback in the wiki powered knowledge base.

For example, a user commented on the Clearing Private Data article, asking

“After you hit the clear , what happen next, Do I look for something to show it has been completed.”

We added a sentence to the article, stating that private data would cleared, and all that is left is to close the Clear Private data window.

As contributors, it is that type of feedback that often does not cross our minds; and so it is important to channel feedback from average users and take advantage of it. By listening to user feedback, we can improve the knowledge base in key ways that help the majority of Firefox users. It is also helpful to people wanting to contribute to the knowledge base, but don’t know what edits to make.

The weekly post usually happens on Wednesdays, and is titled “Useful article comments…” You can view this week’s digest now. If you are logged in, you can also see article comments at the bottom of each knowledge base article; and if you see a comment that you can address in the article, just edit the article!

Minutes of SUMO meeting 2009-03-16

Monday, March 16th, 2009

Sumo

  • Weekly metrics
    • What happened on Feb 24th (re: start page bounce rate)? djst to talk to Ken.
  • Last week’s weekly support issues
  • Push SFD back to end of May?
    • Since the original idea was to host the event in close relation to the 3.1 release, it makes sense to move this.
    • Let’s move it to late May!

Knowledge Base

  • 3.1 to 3.5 SUMO meta bug 481465
  • Best Practices doc change: be less chatty
    • This was one of the points raised in the UX audit: our documentation needs to be more concise
    • cilias to update the Best Practices and then blog
  • Useful article comments tracking page [1]
    • Some doubts about the usefulness of this separate page vs just posting in the contributor forum. At the end of each week, we could revisit the week’s list and ensure that any critical changes are taken care of.

Forum

Live Chat

  • Live Chat community is growing steadily! Weekly contributors has quadrupled since the start of 2009
  • Two threads about live chat abuse in Contributors forum, but still very rare.
  • More people crashing due to corrupt sqlite.
    • Cheng to talk to Stephen to figure out how we can best help them get more info about this bug 462476
  • Collin1000, a longtime contributor of Live Chat, is now a room monitor! :)
  • Metrics update: 4 new helpers taking chats, 16 total active helpers
  • zzxc to solicit more feedback from Live Chat contributors in the contributor forum.

Roundtable

  • New How to Contribute documents with improved layout and content going live today
    • Some CSS embedded on the page to make it look better; will move out to the CSS files once the design has been finalized
  • Can we enable the RSS feed functionality for forums now?
    • djst to talk to laura

Minutes of SUMO Meeting 2009-03-09

Monday, March 16th, 2009

Open Format

  • Attendees: djst, Cww, zzxc, cilias, OzFox1, Tobbi, TMZ.
  • Followup on last meeting.
    • SUMO is dedicated to contributors so please give ideas for making things easier for contributors
    • Some suggestions:
      • Fix places where http:// links log you out. This is now bug 482360.
  • Firefox 3.1 KB roundup
    • Firefox 3.1 release info: beta 3 will release this week.
    • Subsequent releases will be named Firefox 3.5
    • bug 481465 tracks all the changes as a results of this rename.
  • Support Firefox Day 5
    • Topic is Firefox 3.5
    • What kinds of questions about 3.5 do you want answered/are you most interested in?
    • Cww to start Contributors forum discussion to get feedback.
  • Forum participation
    • New Helping with Forum Support Page
    • Feedback from doing 10 minutes a day:
      • Helping is an addiction… you can’t just do 10 minutes. This is great! It’s an easy way to getting into helping regularly.
      • Distinction between Proposed solution/Request for more information is not clearcut — will clarify.
      • Let contributors know if users have marked their threads as solved. This is bug 482363.

Reminder: Open-format meeting in one hour

Monday, March 9th, 2009

Just a reminder; today’s weekly SUMO meeting will be open-format. If you’re a SUMO contributor, or interested in getting involved, call in to the meeting to discuss any issues you want to talk about. The meeting starts in one hour. Here are the details:
Today 10 AM PDT/1 PM EDT/5 PM GMT:

  • California: 650-903-0800 then extension 92, conference number 280#
  • Toronto: 416-848-3114 then extension 92, conference number 280#
  • Toll-free (US): 800-707-2533 then password 369, conference number 280#
  • Skype (free worldwide): +18007072533 then password 369, conference number 280#

The backchannel (where we post links and share text) is #sumo on irc.mozilla.org and our agenda and notes is on the Mozilla wiki.

Minutes of SUMO meeting 2009-03-02

Monday, March 2nd, 2009

Sumo

  • djst has serious connection problems today so this meeting was done in irc.mozilla.org, channel #sumo.
  • Weekly metrics
    • Number of new forum posts has gone down, but the responses are up, much thanks to our heroes cor-el and Quarantine
    • Bounce rate on start page is up from 53% to 60%. Last week the most popular support articles list was updated. Is that the reason? Need to figure this out before we launch the first start page optimization test.
  • Last week’s weekly support issues (Actually delayed due to snow… will have by this afternoon)

Knowledge Base

  • Cannot uninstall an add-on article is finally updated for MS .NET add-on issue. bug 476661
    • Bo did much of the heavy lifting — big thanks for that!
  • Going to add additional categories for Windows, Mac, and Linux. bug 480566 (part of upcoming “This article applies to” feature)
  • Creating Articles translated into German by Thomas Lendo, who posted proposal for added clarity in English article.

Forum

  • Number of contributors not up much since my blog post but hopefully will keep an eye on it.
    • djst, zzxc, cww, cilias, and OzFox1 to start their days with 10 minutes of forum helping!

Live Chat

  • Dump of top 25 issues from last week, crashes and sqlite corruption still major issues
  • 12 new helper accounts last week, 3 answered at least one chat
  • Orcadas is now a room monitor
  • OzFox1 has some ideas for the future web based Live Chat client. zzxc and OzFox1 to talk about requirements to make sure all ideas are considered.

Roundtable

  • SUMO Community Map created. If you’re a SUMO contributor, get yourself added to the map!
  • Reminder that next week’s meeting will be our second SUMO community meeting. Everyone is invited! Great opportunity to provide direct feedback or ask any questions about SUMO, help planning the upcoming Support Firefox Day, and much more.

Minutes of SUMO meeting 2009-02-23

Monday, March 2nd, 2009

Sumo

Knowledge Base

Forum

  • Contributor participation down (the top 3) two weeks in a row. This is mostly because one contributor isn’t helping as much.
  • Brainstorming about how to attract more contributors. Jason Barnabe had a great idea about a blog post that was drafted but disappeared. Cww to pick it up and re-write it.

Live Chat

  • Chat issue guide updates
  • New chat query script on tools server allows viewing all chats by issue, to track the frequency of each issue from week-to-week
  • Tobbi is now a Room Monitor. Congrats and welcome, Tobbi!
  • 13 new accounts (12 inactive, 1 joining Contributors, 0 taking chats)

Roundtable

  • Next open format meeting?
    • March 9th!
    • cww to post list of suggested topics for further discussion