06.16.08 - 06:52am
This is a very technical and detailed debrief. For those who want the short version – it’s fixed Other people, read on.
–
As many of you already know – we had some pretty serious issues over the past weeks with the storage system that supports the build/unit test environment. We have [...]
03.20.08 - 04:39pm
We had a network outage at our San Jose datacenter tonight from 8:01 pm PDT until 9:25 pm PDT on March 18. From initial investigation, it appears that one of the switches in a blade server chassis had a software issue, causing a network-wide broadcast storm. Overall effect was that the switching fabric [...]
02.19.08 - 10:27pm
One Mozilla’s biggest assets is our mirror network. It allows us to update over 100 million users in under 48 hours with security updates, host and push extensions, and much more – all with donated server space and bandwidth, giving us the ability to focus our efforts on supporting the development community and making all [...]
10.13.07 - 11:54am
I was reminded of the power of open source software yet again this weekend. A little background:
We here at Mozilla are big fans of OpenVPN. When we rebuilt our datacenter, we did a large search for the right VPN solution. Mozilla’s requirements were somewhat specific:
* Had to work with all three [...]
10.04.07 - 12:00pm
We recently ran an experiment, code named funnelcake (see polvi’s blog post for more details) – this was an interesting project from IT’s perspective for a few reasons.
First a little background – for one 24 hour period, we would need to serve *all* en-US and de downloads which originate from our website – [...]
06.29.07 - 05:56am
As many of you may know, we released a major update to offer 1.5.0.12 -> 2.0.0.4. This is significant to the infrastructure for a few reasons. First off, all of these updates will be *full* updates, i.e. full browser downloads – no 300k mar file. That puts a large load on our [...]
07.11.06 - 08:10am
Here at Mozilla, we have been pretty happy VMWare customers (aside from some of the p2v migration hell). We are moving quite a bit of our infrastructure to VMs and it seems to be working out well.
Enter VMWare 3.0.
You might ask “why would you want to use the first rev a such [...]