In computers systems (and with others) there are often bottlenecks and removing those often reveals new ones. Today’s an example of just that.
During a normal release we have tools we can use to adjust the rate at which we offer updates. We use this to reduce load on the back end systems or [...]
I’ve been working on a couple capacity planning projects and have been knee deep in bandwidth metrics. That, combined with turning up Level3 yesterday got me looking more into where that bandwidth is coming from (and Reed asked).
The first chart shows a breakdown by protocol. Shouldn’t be any surprise that 82% of Mozilla’s [...]
Derek turned up BGP peering with Level3 this morning out of San Jose (this was supposed to be part of last night’s maintenance but he ran into turn up problems on Level3’s side).
We’ve grown (bandwidth-wise) to the extent that having two transit providers wasn’t sufficient. Should either fail, I wouldn’t have felt comfortable [...]
Last night Derek attempted to upgrade IOS on core1 & core2 to pickup software support for Cisco’s ACE module.
We ran into several issues and postponed the upgrade on core2 until those issues are resolved.
The switch’s Compact Flash cards weren’t formatted in a format that rommon (the low level boot loader) could read and the switch [...]
I’m fairly conservative when it comes to upgrading switches. I generally only upgrade to pick up security fixes. It’s rare that I’ll upgrade just to stay current.
Tonight’s one of those rare exceptions. Derek is upgrading both core1 and core2 to pickup software support for Cisco’s ACE module. We’re planning on using [...]
Completed one of the router upgrades I mentioned the other day lastnight. One real issue I ran into was the built in sup-bootflash: was too small to hold the IOS image I wanted and I wasted some amount of time deleting/squeezing sup-bootflash: and remembering the boot system syntax to boot off disk0:.
Thought I’d share some [...]
A couple months ago I mentioned how things have grown in the past two years at Mozilla. Back then we barely pushed any traffic to the Internet and survived on less than a dozen app servers.
Things have changed. I’ll highlight just a couple of them:
Active Firefox users grew from roughly 20 million users to over [...]
This post is written entirely out of frustration. For what seems like months I’ve been on-and-off troubleshooting wireless connectivity issues with Cisco.
I’ll give a little background first.
At Mozilla’s main campus I’m using a Cisco 3845 ISR with two NM-WLC Wireless LAN controllers and have a total of 9 APs covering two buildings.
I broadcast two SSIDs [...]
When I started at Mozilla two years ago the biggest challenge was handling a release and pushing very close to 100Mbps. Right around that point the firewalls would fall over. We had one data center and essentially one provider and I could count the number of app servers on my two hands.
That was two years [...]
Finally got our home-grown GeoDNS deployed last week, one week later than I wanted. A couple deployment issues and bug 435134 got in the way.
We’re finding all sorts of uses for this now and have moved several websites over to this and have a couple more websites/services (like IRC) scheduled for this.
Purely out of interest [...]
