Add-ons Review Update – Week of 2011/06/08

I post these updates every 2 weeks to inform add-on developers about the status of the review queues and any other important stuff going on in the add-ons world.

Summary

  • Nominations for full review at the moment are being processed slower than usual. The new review system required hundreds of add-on developers to renominate their add-ons, which has placed a large workload on the editor team. Nominations are currently taking several weeks (~5) to review.
  • Most updates are being reviewed within a week.
  • Most preliminary reviews are being reviewed within 2 weeks.
  • We posted a call for new reviewers on our blog recently and many new reviewers have already joined our team and helped us cut down review times. If you’re interested, please read on how to apply.

The Review Queues

  • These stats are taken from the last queue report.
  • 100 new nominations that week. 378 nominations in the queue awaiting review.
  • 83 new updates that week. 85 updates in the queue awaiting review.
  • 102 new preliminary review submissions that week. 223 in the queue awaiting review.

Firefox 5 and 6

I just posted a thorough look at breaking changes in Firefox 5 and 6. If there’s anything missing there, please let us know.

Performance

On the add-on performance front, the Talos team has been doing a lot of progress fixing bugs in the automated testing framework. Our Performance page is now much more accurate because of this. For a more detailed view of the test results, Wladimir Palant (the creator of AdBlock Plus) has an excellent overview dashboard that points out failed tests as well as abnormal results.

One of the bugs filed for the this initiative requested documentation for add-on developers on how to set up a similar testing system as the one we are currently using. I’ve completed this document and you can find it here: Measuring Add-on Startup Performance. I encourage you to give it a try and let me know if there’s anything missing or incorrect in the document.