Mozilla Webdev

Socorro Delays

• By Mike Morgan

Over the last week, we’ve encountered some problems in our monitor and processor caused by a large number of pending jobs:

• main monitor thread takes > 1 hr to complete a full scan of pending jobs on disk
• priority job processing depends on this thread

In order to fix these delays, we have made priority job monitoring a separate thread from the main queue thread, but we are working to reduce the delay back to 1-2 minutes (which is what we’re used to!).

Currently, we are blocked by issues with this new method related to filesystem scanning.  This is blocking the archiving and data re-import mentioned in our last set up updates.  See the related code.

We are working to fix this asap, and will provide updates this evening.

{

About Mike Morgan

Mike Morgan is the Director of Web Development for the Mozilla Corporation. Mike joined the Mozilla community as a volunteer in 2003 and has worked on Mozilla's mirror management software, update system and addons.mozilla.org. These days he spends most of his time on strategy, recruiting and helping his team embrace their inner nerd.

This entry was posted on Monday, July 7th, 2008 at 11:16 am and is filed under Breakpad. You can follow any responses to this entry through the RSS 2.0 feed. Both comments and pings are currently closed.