Justin’s Blog
Mozilla IT/Operations…in brief
Network outage report - 3/18/08, 8:01pm PDT - 9:25 pm PDT
March 20th, 2008 by justin
We had a network outage at our San Jose datacenter tonight from 8:01 pm PDT until 9:25 pm PDT on March 18. From initial investigation, it appears that one of the switches in a blade server chassis had a software issue, causing a network-wide broadcast storm. Overall effect was that the switching fabric […]
Call out for Mirrors
February 19th, 2008 by justin
One Mozilla’s biggest assets is our mirror network. It allows us to update over 100 million users in under 48 hours with security updates, host and push extensions, and much more - all with donated server space and bandwidth, giving us the ability to focus our efforts on supporting the development community and making all […]
Open source for the OpenVPN win
October 13th, 2007 by justin
I was reminded of the power of open source software yet again this weekend. A little background:
We here at Mozilla are big fans of OpenVPN. When we rebuilt our datacenter, we did a large search for the right VPN solution. Mozilla’s requirements were somewhat specific:
* Had to work with all three […]
go go gadget funnelcake
October 4th, 2007 by justin
We recently ran an experiment, code named funnelcake (see polvi’s blog post for more details) - this was an interesting project from IT’s perspective for a few reasons.
First a little background - for one 24 hour period, we would need to serve *all* en-US and de downloads which originate from our website - […]
Yes sir, may I have another (update)?
June 29th, 2007 by justin
As many of you may know, we released a major update to offer 1.5.0.12 -> 2.0.0.4. This is significant to the infrastructure for a few reasons. First off, all of these updates will be *full* updates, i.e. full browser downloads - no 300k mar file. That puts a large load on our […]
So I need Parallels to run VMWare? What?
July 11th, 2006 by justin
Here at Mozilla, we have been pretty happy VMWare customers (aside from some of the p2v migration hell). We are moving quite a bit of our infrastructure to VMs and it seems to be working out well.
Enter VMWare 3.0.
You might ask “why would you want to use the first rev a such […]