Category Archives: load balancing

Geolocation & Zeus ZXTM 6.0

Mozilla’s North American store has been down in maintenance mode (you can read about the why) but not the International Store.
The old store used to redirect non-North American users to the International Store, but unfortunately that redirect wasn’t carried over when we took the store offline.
I was inspired Sunday night to [...]

Where in the world is AMO? (Part VI: We did it again!)

(See Part V.)
I have a confession.  We secretly did something last night (we only barely announced it to Metrics).
No, we didn’t secretly replace the fine coffee at some four-star restaurant but pretty close.
Hot off our 2 second gain in average page load times for addons.mozilla.org, we shaved another 2 seconds off by duplicating The Amsterdam [...]

Load Balancer performance issues, fxfeeds.mozilla.org & versioncheck

I mentioned briefly in Monday’s meeting the performance issues we’re having with our load balancers.  Since then, we’ve been hustling to turn up something in the short term to handle Thursday’s Major Update and Firefox 3.0.5/2.0.0.19 release (see here).
For a number of months we’ve been looking at Zeus and their ZXTM product.  It has some [...]

Christmas Load Balancers

Dear Santa,
All I want for Christmas is a load balancer that does not suck.  It should do the following:

Terminate and offload SSL sessions at a rate of no less than 20,000/sec
Provide in-memory content caching
Support web logging, Apache-style (and despite what some hardware vendors thing, web logging is really important)
Have some method of scaling capacity (particularly [...]

geodns, one week later

Finally got our home-grown GeoDNS deployed last week, one week later than I wanted.  A couple deployment issues and bug 435134 got in the way.
We’re finding all sorts of uses for this now and have moved several websites over to this and have a couple more websites/services (like IRC) scheduled for this.
Purely out of interest [...]

Geo DNS or getting the bits closer to you.

The Mozilla community is blessed with a lot of freely donated bandwidth through our mirror network.  This network handles product downloads through bouncer and a subset of this handles releases.mozilla.org, which carries contains Firefox, Thunderbird, Camino, Seamonkey, and Sunbird releases and Add-ons (and is huge, clocking in around 100-130G).
releases.mozilla.org is handled through round-robin DNS.  Regardless [...]

Hello China, part III.

We’ve been pushing production traffic out of our China colo for about a month now.  One of my concerns was how well this site would serve our global user base and how well the Netscaler’s dynamic GSLB would work.  I didn’t want users being sent to this data center who should really goto San Jose [...]

Hello China.

Over the past year we’ve talked about our market share in China (since last April anyways). Li Gong joined Mozilla and in June we had an office. In August I was in China with Justin to setup office infrastructure (phones, vpn) and shop for data center space.
In December I was back [...]

China, Amsterdam, San Jose and global load balancing

Mozilla’s current GSLB (global server load balancing[1]) solution (Citrix Netscalers) is a mix of active proximity probes and static map assignments.
The algorithm first checks to see if there’s a match in the static maps and then falls back to proximity metrics. If that’s missing, it’ll round-robin through all the GSLB sites (effectively three – [...]

Where in the world is AMO? (Part V: It’s live, again!)

With little fanfare, we flipped the switch last night and started serving addons.mozilla.org out of both Amsterdam and San Jose. Took two tries and a hardware swap, but we got it!
This whole saga’s been detailed elsewhere (and here and here and here).
The Good (and the graphs)
Last time, I rolled back when Europe started waking [...]