Mozilla IT & Operations
What drives Mozilla IT’s data center growth? You do. I can break down the machines in the data center into three sections (and this is a very simplistic view): Classic infrastructure. All the web sites and infrastructure to support Mozilla and Firefox. Release Engineering. All the infrastructure that builds and tests Firefox. Services. Right now… Read more
The following is a guest post from Tim Guarnieri, Principal, Critical Facilities Practice at Q Builders, Inc. Tim’s been providing assistance and guidance to Mozilla in building out SCL3. In laying out racks in a data center, you can either contain the cold air or contain the hot air (or do nothing). In this post,… Read more
Just a short post on our progress. The racks arrived last week… and have been staged out on the floor –
(The short version is over here. This is the long version.) Quick Introduction We’re building out a new 1MW data center in Santa Clara, CA at Vantage Data Centers! Project: SCL3 is our latest data center build out. Ever since we started talking about this internally we knew we wanted to blog about it, to… Read more
We will have a scheduled change window Tuesday, May 24 at 10pm PDT. The following changes will take place: 10:00pm PDT (0500 UTC) DNSSEC Deployment. Mozilla will start publishing the following signed zones: mozilla.com (bug 602424) mozilla.net (bug 602423) This is a continuation of the work we started last summer with mozilla.org. We will monitor… Read more
For several hours this morning, Mozilla’s Phoenix data center suffered several intermittent outages. This was fall out from yesterday’s Juniper SRX JunOS upgrade. The following sites/services may have experienced degraded performance or partial/full outages: Firefox Sync Socorro (crash-stats.mozilla.com & crash-reports.mozilla.com) input.mozilla.com pulse.mozilla.org firefoxlive.mozilla.org demos.mozilla.org www.mozillademos.org www.drumbeat.org Background: There were two separate issues that we encountered,… Read more
We will have an off-schedule maintenance window tomorrow night from 6:00pm to 9:00pm PST. The following changes will take place: 6:00pm PST (0100 UTC) Phoenix Firewall upgrades. We’ll be picking up vendor-recommended software upgrades. The nature of this upgrade requires redundancy to be disabled and as such, all sites will experience a 10-15 second outage.… Read more
We will have a scheduled maintenance window tomorrow night from 4:00pm to 6:00pm PST. The following changes will take place: 4:00pm PST (0000 UTC) support.mozilla.com primary data center migration. In preparation for Firefox 4, we’ll be moving the primary data center serving support.mozilla.com to Phoenix (bug 622752). During the migration the site will remain online… Read more
We will have a scheduled maintenance window tomorrow night from 7:00pm to 9:00pm PST. The following changes will take place: 3:00pm PST (2300 UTC) getpersonas.com update. We’ll be updating getpersonas.com to pick up code updates (bug 630990). The site will remain up and online during this push, however, user logins will be disabled for the… Read more
We will have a scheduled maintenance window tomorrow night from 7:00pm to 9:00pm PST. The following changes will take place: 7:00pm PST (0300 UTC) getpersonas.com storage migration. We’ll be moving storage around in preparation for upcoming work. Unfortunately this requires taking parts of the site offline while data is moved. Duration 1 hours. 7:00pm PST… Read more
