Done! Anatomy of an ISP meltdown

Anatomy of an ISP meltdown

by Jay Cross on October 26, 2009

logo

Ten days ago most of my websites disappeared from the web.

My internet service provider (ISP), the ironically named DreamHost, was experiencing blackouts and mail delays.

bhlogo

Now Internet Time Blog, Informal Learning Blog, jaycross.com, and related sites have migrated to Bluehost, the top recommendation from a cry for help on Twitter. Actually, my cyber-savvy sysop son made the move. Transferring ten years of accumulated posts on five blogs and six MySQL databases is beyond my abilities.

Please forgive any weirdness from here in the next few days. Feedblitz has sent out a few spams from the transition (sorry).

Tell me when you find broken links and 404s; I’m sure they’re out there.

Thanks for your patience and assistance.


The geeks among you may be interested in a few of the latest status messages from DreamHost.

October 12

DreamHost Network is down.

Posted (October 12th, 2009 at 10:47 pm PST) by Sandon

It looks like our core router lost its BGP session which took down our entire network (as far as we can tell). We have our network administrator heading to the data center now and should be there in 20 minutes or so. More updates to come. This is affecting all DreamHost services.


October 11

Networking issues causing mysql and web downtime

Posted (October 11th, 2009 at 6:13 pm PST) by andrea

Unfortunately, we’re experiencing some networking issues that are affecting our web (including PS) and mysql servers. If your site is suddenly not loading or can’t connect to the database, it’s most likely related. We’re looking into this and will be posting updates as soon as available. Sorry about the inconvenience!


October 10

Packetloss on some MySQL’s and one web-server

Posted (October 10th, 2009 at 3:16 am PST) by Sandon

It looks like one of our edge switches is having some problems causing packetloss which is making the machines extremely slow and unresponsive. This is affecting the following machines:

dewy, huey, cupid, marbles, nanook, donald, daffy, tweety, woodstock, psmysql745, psmysql799, psmysql961, psmysql962, psmysql966, psmysql967, psmysql979, psmysql986, psmysql991, psmysql1829, psmysql1861, psmysql3171, psmysql3228, psmysql4588, psmysql4975, psmysql5278, psmysql6455


October 8

Network problems causing downtime on some homie machines

Posted (October 8th, 2009 at 3:20 pm PST) by andrea

The following machines are affected by the current network outage. Our admins are working on the resolution, please check back for updates and details. We apologize for the inconvenience!

algiers alouettes angels argonauts avengers baku bayhawks bears belmopan bengals bills blackhawks blazers bluebombers bluejays bobcats braves brewers bridgetown broncos browns bruins brumbies brussels bubsy buccaneers bucks buenosaires bulls bullwinkle butterfish canberra cannons cardinals cavs chapulin chivas clippers cobra colts cowboys crew crusaders d-fenders dhaka diamondbacks dodgers dopey dumbo dynamo eagles earthquakes eltigre eskimos expos falcons fever fire flames foghorn force galaxy grinch grizzlies gumby hawks heat herediano highlanders hornets hurricanes indians inki islanders jaguars jazz jets jetsons kabul kings knicks lakers leghorn liberty lightning lions lizards magic magoo manama mariners marlins mets minsk monarchs nassau nationals nets niners nuggets oilers olympiacos outlaws pacers packers padres panthers patriots penguins phillies pirates pistons popeye predators pride pumbaa raiders rams rangers rapids raptors ravens rays reds redwings revolution rockets rockies roughriders royals saprissa seahawks shock slowpoke snoopy sox spaceghost sparks spurs stampeders steelers stjohns suns texans thrashers thunder tigercats tigers tirane titans topcat twins vienna vikings waratahs warriors wizards yankees yerevan zazu and some of our private servers

Leave a Comment

You can use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Previous post:

Next post:

Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 2.5 License. Real Time Web Analytics