noise from a mozilla IT/Operations wrangler
We run our web farm behind a pair of Citrix Netscalers in both San Jose and Amsterdam. What really hits these boxes hard is the SSL offloaded traffic and in certain instances has caused the Netscalers to fall over on themselves. Right now our setup looks like: (Pardon the shapes, it’s what I have to… Read more
You use Splunk, of course! And for those that hadn’t noticed, the 3.0 beta went out yesterday. You should probably get it. Update: Under their beta notes I see this: “Only the Firefox browser is supported in this beta. Support for IE will be added later.” I won’t shed any tears over that
With prodding from co-workers I’ve shed the final vestiges of my Windows life. A couple months ago I switched my portable computing platform to a black MacBook that no one wanted (it seemed the perfect size to take with my on my trip to Amsterdam) and now I’ve replaced my desktop with a Mac Pro.… Read more
(This would have been posted earlier this week but I’ve had no end of problems trying to get iframes in WordPress-MU working.) I wrapped up my second century this year over in Lodi, CA this past Sunday doing the Delta Century. Total ride time came in at 6:29. Ride had a number of firsts for… Read more
In an effort to redefine the meaning of “performance”, we turn them into a performance cluster (where slower is better). As Boris Zbarsky said, If the hardware is so fast that, say, the Date.now() resolution (or whatever perl module we use) is insufficient to accurately time the tests, then we have a problem. This follows… Read more
Shortly before 12:30am PDT I had to roll back the DNS changes to AMO and serve it only out of San Jose. Around this time, Europe started coming online and pushed traffic loads up, exhausting the capabilities of the Netscalers in Amsterdam. The Bad Unfortunately when SSL transactions/second hit nearly 900 a second the CPU… Read more
Pushed out the DNS changes to addons.mozilla.org about 36 minutes ago. Those of you on the other side of the planet should see much improved page load times.
After a week or so of testing, we’re ready to flip the switch on getting addons.mozilla.org to be served out of Amsterdam as well as San Jose. I talked about how we’re doing this last week if you’re interested. We’ll make this change during our normal Tuesday maintenance window. Hopefully the Netscalers in Amsterdam will… Read more
I guess we’re not the only ones to do strange things with Mac Minis. These guys are using them as routers at LINX!
One of our objectives for this year was to get a better trending of network traffic and flows for capacity planning, colo planning and attack mitigation. The NetFlow tool we’re using also allows me to run a report of top destination ASNs, or networks we send the most amount of traffic to as well as… Read more
