A homeless man’s mattress fire under a bridge in Massachusetts was enough to create the biggest telecommunications disaster for Verizon since the terrorist attacks of 9/11. The fire melted fiber and damaged copper cables that represented the backbone of Verizon’s landline network in the region, disrupting phone, cable, and broadband service for thousands of Verizon’s customers in northeastern Massachusetts in late August. Now that service has been restored, the damages from the outage and its ripple effects are still being calculated as questions are being raised about how the company handles its communications network.

The damage went far beyond an inconvenience for Verizon customers:

• Area businesses were ripe for plundering with Verizon-dependent alarm systems out of service;
• Cell towers went down if they were connected by Verizon’s fiber optic network;
• Local law enforcement communication systems ceased to function in areas where Verizon provided the vital link between the dispatch center and transmitting facilities miles away;
• Banks and other local businesses closed down because Verizon-based connectivity was inoperable. That left ATMs throughout the region out of service and credit card transactions often impossible to manage;
• 911 systems in several communities had to transfer emergency calls to other 911 centers miles away;
• Even the Registry of Motor Vehicles locked their doors and shut down while the outage persisted over several days.

[flv width=”640″ height=”380″]http://www.phillipdampier.com/video/NECN Verizon telecommunications outage causes problems 8-31-12.flv[/flv]
NECN News reports on Verizon’s enormous Massachusetts service outage and how it impacted the lives of affected customers. (3 minutes)

Verizon’s landline network ultimately failed its Massachusetts customers on a scale the company admits it has not seen in a long time.

“It’s the biggest problem we’ve faced, nationally, other than 9-11,” Bill Wilson, area manager for Verizon, told the Eagle-Tribune. “This is the biggest problem we’ve had in 20 years.”

At the heart of the problem is Verizon’s lack of redundancy in its landline network. With fiber optic cables managing a larger share of broadband traffic, phone calls, and even Verizon’s television service, the loss of even a single fiber cable can disrupt service for hundreds or thousands of customers, many more than would be affected by a damaged copper cable.

State Sen. Barry Finegold (D-Andover) is questioning Verizon’s decision not to have a backup plan in place.

“So if there’s a fire there’s a redundant system in place so if one fails there’s another to back it up,” Finegold said.

Customers, particular those working from home, wholeheartedly agreed.

“I am appalled,” Shela Horvitz, a Verizon FIOS customer who lost her phone, Internet and TV service for days as a result of the fire, told the newspaper. “Can you say, ‘Single Point of Failure?’”

[flv width=”640″ height=”380”]http://www.phillipdampier.com/video/Eagle Tribune Verizon Talks to Media About Outage 9-2-12.flv[/flv]

Verizon officials show reporters what the fire did to their network and how they are going to restore service after a fire on Lawrence Central Bridge caused mass outages in the region. From the Eagle-Tribune. (4 minutes)

Verizon blames the entire affair on homeless people, who they say should not have been sleeping on top of their wires. The idea of network redundancy for Verizon’s landline network? “Cost prohibitive,” say company officials.

Joseph Zukowski, vice president for government affairs for the phone company, said the problem was so rare, it was comparable to a 100-year storm. He compared the outage with a natural disaster.

“We have extensive security measures to make the network as secure as possible,” Zukowski said. “We restrict building access and access to our cables. Nowhere on the list is a homeless guy lighting a match on a mattress. We’re not laying blame, but the best thing would have been not to have the tent city there.”

Local police acknowledge the bridge where the cables cross the Merrimack River is a popular spot for the local homeless to congregate, and they have attempted to control the problem. But nobody ever told them Verizon’s vital regional communications network infrastructure was at ground zero of the mattress fire.

“Going forward, if the stuff that’s there is so important, it really needs to be secured so nobody can get access to it,” said police chief John Romero.

Verizon has promised refunds for all affected customers.

[flv width=”640″ height=”380″]http://www.phillipdampier.com/video/Verizon Lawrence MA Bridge Fire Verizon Restoration 2012 9-1-12.flv[/flv]

A Verizon-produced video illustrates how the company is repairing its damaged network. The heat from the fire on August 27th melted and fused both fiber and copper cables, and the protective casings that house the cables.

Verizon: “The work to restore service is complex, given that technicians are splicing thousands of individual copper and fiber-optic connections in a very confined area under the bridge. The conduit structure that holds the cables, which was protected by a metal cage, was destroyed and needs to be replaced. Verizon crews have been working in 24-hour shifts since the fire to restore service for customers and will continue to do so until every customer is back in service.”  (2 minutes)

Otero

When a former labor leader suddenly starts advocating for the interests of AT&T and other super-sized telecommunications companies, even as AT&T’s unionized work force prepared to strike, the smell of Big Telecom money and influence permeates the air.

Jack Otero, identified in the Des Moines Register as “a former member of the AFL-CIO Executive Council and past national president of the AFL-CIO’s Labor Council for Latin American Advancement,” penned a particularly suspicious love letter to deregulation that might as well have been written by AT&T’s director of government relations:

[…]Industries — like broadband Internet — are thriving and creating innovations. Tossing a regulatory grenade into these businesses could wreck markets that create value for consumers and jobs for workers.

The United States is one of the most wired nations in the world. More than 95 percent of households have access to at least one wireline broadband provider, and the vast majority can connect at speeds exceeding 100 Mbps. And monthly packages start as low as $15. That means more families can go online to improve their job skills, look for work or help the kids with their school assignments.

More choices and higher speeds — the signs of a vibrant market — are the product of private investment, not public dollars. Internet service providers have invested over $250 billion in the last four years alone. This has created roughly half a million jobs laying fiber-optic and coaxial cable.

But some squeaky wheels are demanding heavy-handed regulations that would move our broadband Internet to the European model, where taxpayers have to subsidize outdated networks with slow speeds. Some want broadband providers to be required to lease their networks to competitors at discounted prices — as they do in Europe. But lawmakers in both parties agree that this policy, tried in the 1996 Telecommunications Act, failed miserably.

Others argue that broadband Internet providers should not be able to impose a small surcharge on the tiny percentage (less than 1 percent) of consumers who download hundreds of movies and tens of thousands of songs every month — effectively the data usage of a business. They say these fees discriminate against online video companies like Netflix. But that’s silly. More than 99 percent of users can watch plenty of Apple TV or Netflix without approaching the lowest data allotment. Without tiered pricing plans, the rest of us would have to underwrite these super-users.

Okay then.

Otero’s Fantasy World of Broadband sounds great, only it does not exist for the vast majority of Americans. Are most of us able to connect at speeds exceeding 100Mbps?

If you happen to live in a community served by a publicly-owned broadband provider Otero effectively dismisses, you can almost take this fact for granted.

Some of America’s most advanced telecommunications providers are actually owned by the public they serve in dozens of communities small and large. EPB Fiber, Greenlight, Fibrant, Lafayette’s LUS Fiber, among others, deliver super-fast upload and download speeds at very reasonable prices while the giant phone and cable companies offer less service for more money.

The only major telecommunications company with a wide deployment of fiber-to-the-home service is Verizon Communications.

You cannot easily buy residential 100Mbps service from Time Warner Cable, AT&T, CenturyLink, Frontier, FairPoint, or a myriad of other telecom companies at any price, unless you purchase an obscenely expensive business account. From the rest, 100Mbps service typically sets you back $100 a month.

Otero’s quote of affordable $15 broadband is not easy to come by either. It usually requires the customer to qualify for food stamps or certain welfare programs, have a family with school-age children, a perfect payment history, and no recent record of subscribing to broadband service at the regular price.

The only people who believe America is the home of a vibrant market for broadband service are paid employees of telecom companies, paid-off politicians, or their sock-puppet friends and organizations who more often than not receive substantial contributions from phone or cable companies. The fact is, the United States endures a home broadband duopoly in most communities — one cable and one phone company. They charge roughly the same rates for a level of service that Europe and Asia left behind years ago. Broadband prices keep going up here, going down there.

Simply put, Mr. Otero and actual reality have yet to meet. Consider his nonsensical diatribe about the impact of the “heavy-handed” 1996 Telecommunications Act, actually a festival of mindless deregulation that resulted in sweeping consolidation in the telecommunications and broadcasting business and higher prices for consumers.

Otero is upset that big companies like AT&T and Verizon originally had to open up their networks in the early 1990s to independent Internet Service Providers who purchased wholesale access at fair (yet profitable) prices. Those fledgling ISPs developed and marketed third-party Internet service based on those open network rates. Remember the days when you could choose your ISP from a whole host of providers? In some markets, this tradition carried forward with DSL service, but for most it would not last.

The telecommunications industry managed to successfully lobby the government and federal regulators to change the rules. Phone companies did not appreciate the fact they had to open their networks for fair access while cable operators did not. So in 2005, the FCC allowed both to control their broadband networks like third world despots. Competitors were effectively not allowed. Wholesale access, where available, was priced at rates that usually guaranteed few ISPs would ever undercut the cable or phone company’s own broadband product.

The lawmakers who believed open networks represented awful policy were almost entirely corporate-friendly or recipients of enormous campaign contributions from the telecom companies themselves.

So which market is actually on the road to failure?

The LCLAA couldn’t do enough to help AT&T swallow up competitor T-Mobile USA.

The American broadband business model is a firmly established duopoly that charges some of the world’s highest prices and has rapidly fallen behind those “failures” in Europe.

In the United Kingdom, BT — the national phone company, is required to sell access at the wholesale rates Otero dismisses as bad policy. As a result, UK consumers have a greater choice of service providers, and at speeds that are increasingly outpacing the United States. Nationally backed fiber to the home networks in eastern Europe and the Baltic states have already blown past the average speeds Americans can affordably buy from the cable company.

Even Canada requires Bell, the dominant phone company, to open its network to independent ISPs selling DSL service. Without this, Canadians would rarely have a chance to find a service provider offering unlimited, flat rate service.

Otero’s final, and most-tired argument is that data caps force “average” users to subsidize “heavy” users. In fact, as Stop the Cap! reported this week, that fallacy can be safely flushed away when you consider the largest ISPs pay, on average, just $1 per month per subscriber for usage, and that price is dropping fast. The only thing being subsidized here is the telecom “dollar-a-holler” fund, paid to various mouthpiece organizations who deliver the industry’s talking points without looking too obvious.

The Des Moines Register omitted the rest of Mr. Otero’s industry connections. We’re always here to help at Stop the Cap!, so here is what the newspaper forgot:

• Mr. Otero is a board member of Directors of the U.S. Hispanic Leadership Institute (USHLI), a group funded in part by AT&T and Verizon;
• He is the past president of the Labor Council for Latin American Advancement, a group that enthusiastically supported the anti-competitive merger of AT&T and T-Mobile USA;

Mr. Otero has a side hobby of penning nearly identical editorials with largely these same broadband talking points. One wonders what might motivate him into writing letters to the Des Moines Register, the Lexington Herald-Leader, the Gainesville Sun, the Star-Banner, and the Ledger-Inquirer.

Otero may have a case for plagiarism, if he chooses to pursue it, against Mr. Roger Campos, president of the Minority Business RoundTable (the top cable lobbyist, the National Cable & Telecommunications Association is labeled an MBRT “strategic partner” on their website). Campos uses some of the exact same talking points in his own “roundtable” of letters to the editor sent to newspapers all over the place, including the Ventura County Star, the Leaf Chronicle, and the Daily Herald.

The views of the Adam Smith Institute, despite the near-global financial meltdown engineered by the Masters of the Universe.

Forbes columnist Tim Worstall is unimpressed with Google’s foray into fiber optics.

Worstall, a Fellow at the Adam Smith Institute in London, has repeatedly penned columns tsk-tsking the global broadband speed race.

In his world view, nobody except certain specialists needs any connection faster than 2Mbps:

The most obvious being that outside certain very specific uses (video editing for example, where people can pay up for their own T1 line) there’s not really much evidence that speeds above 2 Mbps or so actually improve productivity or economic performance/growth. Sure, they’re great for consumers who want to download movies but that’s not really a justification for a large scale infrastructure program.

Worstall’s Luddite-like knowledge of broadband technology makes it difficult to take him seriously. Notwithstanding the fact a T1 line delivers just 1.5Mbps (at a cost several times a typical cable or DSL broadband connection), Worstall’s declaration that faster speeds are only good for “downloading” movies (the concept of streaming also escapes him) is simple nonsense.

Worstall’s tantrum is really part of a bigger discussion about how to do broadband better in both the United Kingdom and the United States. Incumbent providers are dragging their feet while reaping profits for overpriced, too-slow service. Consumers and businesses are fed up, and some are now increasingly turning to the government to do-something to shake up the status quo.

Government? For those slavishly devoted to free market ideals at the Adam Smith Institute, such a notion guarantees an intemperate outburst with phrases like “government takeover,” “government interference in private business,” or “government monopoly” — all ideas Worstall complains are “blindingly awful.”

“The idea that the solution to anything is a government run engineering monopoly just boggles the mind,” Worstall declares.

In his piece, “Why High Speed Broadband Just Doesn’t Matter,” Worstall has just a single litmus test to define broadband worthiness: how much economic value can be extracted from the Internet — Ferengi economics at their finest.

Worstall (Image: Forbes)

Worstall:

So more people can watch TV. Apologies, but this doesn’t really convince. Higher definition TV just isn’t the sort of technology that boosts the economy of a country. It might be nice to have but it most certainly does not justify taxing some to provide the service to others.

[…] The truth is that as long as you’re getting broadband of a kind (2 Mbps say) then it’s possible to extract that economic value. Faster speeds might be nice but they’re just not necessary for economic development.

Even if you accept Worstall’s inaccurate contention fast Internet is only good for watching online entertainment, he evidently forgets PricewaterhouseCoopers estimated the value of that industry at $2 trillion, and that was by 2011. Why even have a cable television business, if the only thing it is good for is watching reality shows and Law & Order reruns? Because it makes money — lots of it.

Back to Google, which is creating a bit of a pickle for the cable and phone companies — an increasingly fat and happy bunch earning easy profits selling broadband at duopoly market prices. Proponents for better broadband advocating for new, publicly-owned broadband networks have had to confront astroturf and conservative groups using popular memes that “big government” cannot do anything right and if there was a market for gigabit broadband, private companies would already be selling it.

Starting this summer, Google is.

That spells t-r-o-u-b-l-e for the corporate love muffins at the Adam Smith Institute and their industry friends who are quite happy with the way things are today, thank you very much. Google just happens to be an example of a free market success story — a ‘responsible’ company willing to invest money in the game-changing broadband Worstall and friends spent years arguing we don’t actually want or need.

As Kansas City residents line up around the virtual block, eagerly plunking down $10 to “pre-register” for Google service, it becomes difficult to continue the standard line that super-fast Internet is just a tech-geek curiosity.

So what does a free-market-knows-best-devotee do in light of all this? Change the story.

Worstall picks up a premise first offered by The Guardian and runs with it. Namely, Google is actually riding the wave of past phone company failures to cheaply benefit from assets those companies deployed first:

There’s a very large difference between being able to do something usefully experimental with an orphaned asset and having to pay for the construction of that asset in the first place. The telecoms companies lost fortunes on laying that fibre (indeed, several, including such as Global Crossing, went resoundingly bust for billions in doing so). That something that was built for $100 can find a use when it is sold for $1 (just to make up some numbers) is not an argument in favour of spending the $100.

Yet that is exactly what the argument being proposed is. Look, Google’s got really cool fast broadband, now we should build it for everyone! What’s being missed is that, at least so far as we know as yet, that really fast broadband isn’t worth the cost of building it. It only makes sense even for Google because they’ve not had to pay full price for it.

Google got a discount, so that is why they are in the business.

Worstall’s declaration is news to Kansas City, which has been enduring Google’s construction crews for months as they lay fiber infrastructure across the metropolitan area. Evidently Google hired illusionist David Copperfield to perform the masterful trick of shading the truth:  re-purposing already-there fiber while pretending it was being buried and strung for the first time.

Adam Smith didn’t have super fast broadband when he posited his views on unfettered free markets in the 1700s. If his devoted followers are left in charge, you won’t either.

Northern District Mississippi Public Service Commissioner Brandon Presley is unhappy with a new state law that will strip oversight over AT&T. Presley plans to personally file suit in Hinds County Circuit Court against the law, calling it unconstitutional.

“It violates the state constitution,” Presley said of the bill during an interview with the Daily Journal. “There’s no doubt AT&T is the biggest in the state, and this bill will allow them to raise rates without any oversight at all.”

House Bill 825 strips away rate regulation of Mississippi landline service and removes the oversight powers the PSC formerly had to request financial data and statistics dealing with service outages and consumer complaints. The law also permits AT&T to abandon rural Mississippi landline customers at will.

The bill’s author, Rep. Charles Jim Beckett (R-Bruce), told the newspaper he doubts the truth of Presley’s predictions that AT&T will raise landline rates in Mississippi and eventually abandon unprofitable rural sections of the state.

Unfortunately for Beckett, AT&T has a track record of raising rates on basic phone service about a year after winning deregulation in other midwestern and southern states. Beckett’s optimism about AT&T’s benevolence may be slightly colored by $2,500 in campaign contributions he received from the phone company and his extensive involvement with AT&T’s legislative agenda through participation in the American Legislative Exchange Council (ALEC), a group with direct ties to AT&T:

Presley

It seems that Russell and AT&T picked up the food tab for Rep. Jim Beckett and his wife at the ALEC meeting in at the Westin Kierland Resort in Scottsdale, Ariz. from November 30 to December 2, 2011.  AT&T also paid for a few rounds of golf for Rep. Beckett while there.  All said and done, AT&T paid $565.39 to cover expenses for Rep. Beckett and his wife on their three day trip to Scottsdale.

But that’s not all.  AT&T also picked up the tab for $151.70 worth of food and tickets while Rep. Beckett and his wife were at the Spring ALEC meeting in Cincinnati, OH in late April of 2011. AT&T also paid $22.62 for food for Rep. Beckett and his wife while he attended the 2011 Summer ALEC meeting in New Orleans.

The total amount AT&T gave to Rep. Jim Beckett and his wife in 2011 through Randy Russell?  $876.85.  The names of the Becketts appear a total of 36 times in AT&T’s 2011 lobbying report, most of it while the Becketts are at ALEC retreats.

Beckett

Presley has also launched a populist campaign against AT&T, last week telling a fired-up crowd at the Jacinto Festival he will fight AT&T’s bought and paid for law that lets them “raise your rates to whatever they want to.”

Crowds cheered support for Presley as he detailed how AT&T has bought influence with Mississippi state legislators, “just because they pass around money or fly you on jets or buy those big ribeyes.”

Presley has a past history of chasing after utility companies that hire expensive lobbyists and hand out extravagant gifts including golf outings, trips, and even opera tickets to legislators willing to vote their way.

He claims it has gotten so bad, corporate deep-pockets are now shutting out the voices of citizens.

“We have a coin-operated government,” Presley said. “That’s wrong.”

NOAA caught this ominous derecho cloud front in La Porte, Ind on June 29. The same storm would later cut power for millions all the way to the eastern seaboard.

A series of severe thunderstorms accompanied by near-hurricane-force winds caused millions of customers in several Mid-Atlantic states to lose power and telecommunications services late Friday, and some are expected to remain without service until at least this coming weekend.

The storm, known as a “derecho,” uprooted trees, which in turn knocked down power lines and caused wind-related damage to buildings from Ohio to West Virginia, Virginia to Maryland, and even into North Carolina.

But the storm also is raising questions about the massive failures in commercial telecommunications systems that left entire 911 emergency response systems offline for days, wireless networks non-operational, cell phone systems overwhelmed, and broadband service, deemed a lower priority by emergency officials, down and offline.

Some of the biggest problems remain in and around the nation’s capital and in the states of West Virginia and Virginia, where inadequate infrastructure proved especially susceptible to the storm’s damaging winds.

D.C., Maryland, and northern Virginia

In northern Virginia, calls to 911 were met by silence over the weekend, thanks to a catastrophic failure of Verizon’s landline network. With primary lines down, Verizon’s backup 911 systems also failed, leaving millions with no access to emergency responders.

Fairfax County officials finally put the word out the best way to summon emergency help was to drive (through streets littered with debris and downed power lines) to the nearest fire or police station for assistance.

“It’s just not OK for the entire 911 system in the region to go down for the period of time that we were out, especially after an enormous emergency where people needed to make those calls the most,” Sharon Bulova, chairman of the Fairfax County Board of Supervisors, told the Associated Press.

Verizon spokesman Harry Mitchell was left flat-footed, promising an investigation into Verizon’s latest 911 failure, and called the storm as damaging as a hurricane. He urged local officials to “move forward” beyond the immediate criticism and help make progress to get service restored.

Many emergency response networks also depend on telecommunications services, including fiber cables, to reach transmission towers for radio dispatch and mobile data terminals. In northern Virginia, the city of Alexandria has been managing to handle emergency dispatch services for several counties.

With power lines down, cable and phone lines often went as well. In those cases, electric utilities have first priority to restore service, and then cable and phone companies can begin repairs of their own.

Since cable operators rely on power companies to supply electricity to their amplifiers and other equipment, Comcast and Cox, which dominate the region, are blaming most of their outages on power disruptions, and promise service will be restored when the power returns.

Verizon’s DSL and FiOS broadband networks were both disrupted by the storm, primarily because of downed lines and power losses.Even wireless networks, which some might suspect would be immune to downed lines, were also seriously affected by the storm. Cell towers connect to the provider’s network through fiber optic and T1 lines, and although backup power generators can maintain a cell tower for days in some cases, backhaul line cuts can leave cell towers useless.

In metro D.C., call completion problems were a problem during the storm and sometime after as local residents turned to cell phones to communicate. Over the weekend, customers in and around Richmond, Va., found Verizon Wireless useless for text messages because of a service disruption. As backup generators ran dry of fuel, some cell towers that survived the initial storm have been shutting down until maintenance crews arrive and refuel.

The harshest criticism has so far escaped phone and cable companies. Instead, local officials and residents remain focused on Pepco, the power utility serving the Washington area. Pepco has learned from previous storms to become a master of lowered expectations, and is promising to do its best to restore power a week or more after the storm was a memory.

West Virginia and western Virginia

The state of West Virginia, and western rural Virginia state, have illustrated what happens when deteriorating infrastructure is asked to withstand winds of up to 100mph. Frontier’s operations in West Virginia were hit especially hard. Landline networks in that state had been allowed to deteriorate for years by former owner Verizon Communications. Frontier had its hands full trying to keep up with repairs, calling in additional staff and trying to maintain landline service in some areas with the help of generators.

That job was made much harder by a rash of generator thefts that impacted the phone company, and local authorities are still looking for those responsible. At least one-third of all central switching offices operated by Frontier in West Virginia remain on generator power as of yesterday. As of July 3, the company reported it has 12,000 repair requests still waiting for action.

It was a similar story in the western half of Virginia where independent phone companies and Verizon were faced with an enormous number of downed trees and power lines, many in rural areas. More than 108,000 Virginia residents are still without power as of this afternoon, and many will not see it restored until the weekend.

Because the derecho swept across a large area encompassing the entire state, it has been difficult for utility crews to respond from unaffected areas to assist in repairs because the damage was so widespread. Logistically, just coordinating repair operations has proved difficult because cell service has been spotty (or networks have been jammed with calls) in some of the worst-affected areas.

“Derechos are nothing to fool with, but still this was not the most serious storm Virginia has ever dealt with, and the impacts on our telecommunications networks seem to indicate they’ve been allowed to fall apart over the last several years,” shares Stop the Cap! reader Edward Klein, who lives near Roanoke. “I think an investigation is needed to make sure utilities are spending enough money to keep these networks in good shape so this kind of thing doesn’t happen everytime a storm sweeps through.”