CenturyLink RCA?

[SNaslund at medline.com (Naslund, Steve)]

I agree 100%.  Now they need to figure out why bricking the management network stopped forwarding on the optical side.  > (Forgive my top posting, not on my desktop as Iâ??m out of town)

Steven Naslund
Chicago IL
>
>Wild guess, based on my own experience as a NOC admin/head of operations at a large ISP - they have an automated deployment system for new firmware for a (mission critical) piece of backbone hardware.
>
>They may have tested said firmware on a chassis with cards that did not exactly match the hardware they had in actual deployment (ie: card was older hw revision in deployed hardware), and while it worked fine there, it proceeded >shit the bed in the production.
>
>Or, they missed a mandatory low level hardware firmware upgrade that has to be applied separately before the other main upgrade.
>
>Kinda picturing in my mind that they staged all the updates, set a timer, staggered reboot, and after the first hit the fan, they couldnâ??t stop the rest as it fell apart as each upgraded unit fell on its own sword on reboot.
>
>Iâ??ve been bit by the â??this card revision is not supported under this platform/releaseâ?? bug more often then Iâ??d like to admit.
>
>And, yes, my eyes did start to get glossy and hazy the more I read their explanation as well.  Itâ??s exactly the kind of useless post Iâ??d write when I want to get (stupid) people off my back about a problem.