A homeless man’s mattress fire under a bridge in Massachusetts was enough to create the biggest telecommunications disaster for Verizon since the terrorist attacks of 9/11. The fire melted fiber and damaged copper cables that represented the backbone of Verizon’s landline network in the region, disrupting phone, cable, and broadband service for thousands of Verizon’s customers in northeastern Massachusetts in late August. Now that service has been restored, the damages from the outage and its ripple effects are still being calculated as questions are being raised about how the company handles its communications network.

The damage went far beyond an inconvenience for Verizon customers:

• Area businesses were ripe for plundering with Verizon-dependent alarm systems out of service;
• Cell towers went down if they were connected by Verizon’s fiber optic network;
• Local law enforcement communication systems ceased to function in areas where Verizon provided the vital link between the dispatch center and transmitting facilities miles away;
• Banks and other local businesses closed down because Verizon-based connectivity was inoperable. That left ATMs throughout the region out of service and credit card transactions often impossible to manage;
• 911 systems in several communities had to transfer emergency calls to other 911 centers miles away;
• Even the Registry of Motor Vehicles locked their doors and shut down while the outage persisted over several days.

[flv width=”640″ height=”380″]http://www.phillipdampier.com/video/NECN Verizon telecommunications outage causes problems 8-31-12.flv[/flv]
NECN News reports on Verizon’s enormous Massachusetts service outage and how it impacted the lives of affected customers. (3 minutes)

Verizon’s landline network ultimately failed its Massachusetts customers on a scale the company admits it has not seen in a long time.

“It’s the biggest problem we’ve faced, nationally, other than 9-11,” Bill Wilson, area manager for Verizon, told the Eagle-Tribune. “This is the biggest problem we’ve had in 20 years.”

At the heart of the problem is Verizon’s lack of redundancy in its landline network. With fiber optic cables managing a larger share of broadband traffic, phone calls, and even Verizon’s television service, the loss of even a single fiber cable can disrupt service for hundreds or thousands of customers, many more than would be affected by a damaged copper cable.

State Sen. Barry Finegold (D-Andover) is questioning Verizon’s decision not to have a backup plan in place.

“So if there’s a fire there’s a redundant system in place so if one fails there’s another to back it up,” Finegold said.

Customers, particular those working from home, wholeheartedly agreed.

“I am appalled,” Shela Horvitz, a Verizon FIOS customer who lost her phone, Internet and TV service for days as a result of the fire, told the newspaper. “Can you say, ‘Single Point of Failure?’”

[flv width=”640″ height=”380”]http://www.phillipdampier.com/video/Eagle Tribune Verizon Talks to Media About Outage 9-2-12.flv[/flv]

Verizon officials show reporters what the fire did to their network and how they are going to restore service after a fire on Lawrence Central Bridge caused mass outages in the region. From the Eagle-Tribune. (4 minutes)

Verizon blames the entire affair on homeless people, who they say should not have been sleeping on top of their wires. The idea of network redundancy for Verizon’s landline network? “Cost prohibitive,” say company officials.

Joseph Zukowski, vice president for government affairs for the phone company, said the problem was so rare, it was comparable to a 100-year storm. He compared the outage with a natural disaster.

“We have extensive security measures to make the network as secure as possible,” Zukowski said. “We restrict building access and access to our cables. Nowhere on the list is a homeless guy lighting a match on a mattress. We’re not laying blame, but the best thing would have been not to have the tent city there.”

Local police acknowledge the bridge where the cables cross the Merrimack River is a popular spot for the local homeless to congregate, and they have attempted to control the problem. But nobody ever told them Verizon’s vital regional communications network infrastructure was at ground zero of the mattress fire.

“Going forward, if the stuff that’s there is so important, it really needs to be secured so nobody can get access to it,” said police chief John Romero.

Verizon has promised refunds for all affected customers.

[flv width=”640″ height=”380″]http://www.phillipdampier.com/video/Verizon Lawrence MA Bridge Fire Verizon Restoration 2012 9-1-12.flv[/flv]

A Verizon-produced video illustrates how the company is repairing its damaged network. The heat from the fire on August 27th melted and fused both fiber and copper cables, and the protective casings that house the cables.

Verizon: “The work to restore service is complex, given that technicians are splicing thousands of individual copper and fiber-optic connections in a very confined area under the bridge. The conduit structure that holds the cables, which was protected by a metal cage, was destroyed and needs to be replaced. Verizon crews have been working in 24-hour shifts since the fire to restore service for customers and will continue to do so until every customer is back in service.”  (2 minutes)

The Republican party platform on technology gives little credit to the Obama Administration’s handling of all-things-high-tech and demands a wholesale deregulation effort to free the hands of service providers, get rid of Net Neutrality, and sell off wireless spectrum to boost wireless communications.

The platform authors are particularly incensed about Net Neutrality, a policy that requires providers to treat Internet content equally on their networks. Some Republicans have previously called that “a government takeover of the Internet,” telling providers what they can and cannot provide customers. Vice-presidential nominee Rep. Paul Ryan (R-Wis.) fiercely opposes Net Neutrality. In 2011, he supported a resolution disapproving of the policy and in 2006 he voted against an amendment to a bill that would have codified it into federal law.

“The most vibrant sector of the American economy, indeed, one-sixth of it, is regulated by the federal government on precedents from the Nineteenth Century. Today’s technology and telecommunications industries are overseen by the FCC, established in 1934 and given the jurisdiction over telecommunications formerly assigned to the Interstate Commerce Commission, which had been created in 1887 to regulate the railroads. This is not a good fit,” the Republican platform states. “Indeed, the development of telecommunications advances so rapidly that even the Telecom Act of 1996 is woefully out of date.”

Mitt Romney is an ardent deregulator. Under a plan favored by the Republican presidential candidate, agencies like the Federal Communications Commission would be required to offset the cost of any new regulations by eliminating existing regulations. Additionally, Romney plans to issue an executive order as president telling all agencies they must notify Congress about any forthcoming regulations and wait for the House and Senate to approve them before they could take effect. With the current level of Congressional gridlock, a consensus to approve any new regulatory policy is unlikely. The end effect would likely be a near-moratorium on government regulation.

The Republican platform also attacked the Obama Administration for failing to expand broadband to rural areas, but offered nothing beyond generalities about “public-private partnerships” on how to expand broadband to the unserved.

Romney

“That hurts rural America, where farmers, ranchers, and small business manufacturers need connectivity to expand their customer base and operate in real time with the world’s producers,” the platform said. “We encourage public-private partnerships to provide predictable support for connecting rural areas so that every American can fully participate in the global economy.”

One can infer from the language in the document Republicans are opposed to public broadband initiatives.

The Republicans also promise to accelerate public spectrum sell-offs to private companies through auctions to expand the number of frequencies available for wireless communications.

The Obama Administration defends its telecommunications policies, noting the FCC’s National Broadband Plan and the American Recovery and Reinvestment Act’s broadband stimulus program have identified unserved areas, despite provider obfuscation, and targeted funding to open up new broadband opportunities. The administration also says it has effectively reformed the Universal Service Fund into a new Connect America Fund that will underwrite prohibitively expensive rural broadband expansion projects.

The White House also defends its spectrum policies noting existing spectrum still has licensed users that face lengthy and often costly transitions to other frequencies to clear space for cell phone companies. Still, President Obama ordered the FCC to find 500MHz of spectrum to reallocate to wireless communications and the FCC plans the first ever incentive auction that will let TV stations voluntarily surrender their frequencies in return for financial incentives.

Both the Obama and Romney campaigns oppose efforts to internationalize Internet regulatory policy through organizations like the United Nations or the International Telecommunications Union. Some governments have stepped up their efforts to lobby for a transition away from Internet policies they see dominated by the United States.

Democrats are also considering Internet language in their party platform for the party’s upcoming convention next month.

[flv]http://www.phillipdampier.com/video/CNBC Business Booming in Chattanooga 5-29-12.flv[/flv]

While telecom industry-backed groups dismiss community broadband as a waste of taxpayer dollars and an excuse for customers to watch illicit videos and steal content, CNBC reports Chattanooga’s infrastructure improvements, including their gigabit fiber network owned by public utility EPB are contributing to the city’s enormous economic growth and falling unemployment rate. Private companies are pouring into Chattanooga and find a city ready to welcome them and meet their digital needs. Community broadband: a waste of taxpayer money or exactly the right fuel to power American cities into the 21st century digital economy?  (2 minutes)

One of the principal components of Internet Overcharging is the so-called “usage meter,” a measurement tool designed to help customers keep track of their usage so they don’t exceed arbitrary usage allowances and face overlimit penalties or speed throttles.

But with no government agency or independent watchdog monitoring the accuracy of the meter, providers can claim any amount of usage they wish, and stick customers with the bill.

Telecom New Zealand is the latest ISP forced to admit its usage meter was wildly inaccurate, with nearly 100,000 accounts impacted by faulty meter measurements between November 2010 and June 2011.  At least 47,000 faced punitive measures including substantial overlimit fees or throttled speeds for exceeding usage limits, even though they actually didn’t.  Now Telecom has admitted the meter was wrong, it violated the Fair Trading Act in the process, and is refunding $2.7NZ million dollars in overcharges. It was either that or face substantial fines from the Commerce Commission.

Telecom called the error that forced some customers into more expensive plans to avoid additional overlimit fees “an incorrect perception about […] data usage.”

“We’re pleased to have reached a settlement with Telecom and that they have made prompt refunds directly back to the customers who have lost out,” said Stuart Wallace, Commerce Commission Competition Manager. “Telecom brought this issue to our attention as soon as they were made aware by their customers and have co-operated fully with the Commission. Due to Telecom’s immediate admission of a breach of the Fair Trading Act, followed by appropriate compensation to customers, the settlement is the best possible outcome for those customers and avoids potentially lengthy and costly court hearings paid for by taxpayers.”

It’s the second usage measurement failure announced by the company this month.  In a separate move, Telecom agreed to pay $31.6 million to five of its competitors overcharged for wholesale broadband service.

When technically-savvy customers realize they are being billed for non-existent usage and the media takes an interest, providers eventually disclose their mistaken measurement tools.

“Customers are expected to keep these ISP’s honest,” says Stuart Littlejohn, a Stop the Cap! reader in Wellington. “ISP’s never suggest their meters are anything except accurate until they are caught with their fingers on the scale, and always in their favor.”

Littlejohn has already received a refund from Telecom for illegitimate overcharges he incurred earlier this year.

“It was an absolute nightmare,” he shares. “We thought someone hacked our wireless network or someone in the home was lying about their usage, all theories encouraged by Telecom employees who pointed the finger at everyone but themselves.”

Littlejohn says after Telecom granted one credit as a “goodwill gesture,” subsequent overcharges that went unexplained were his problem, not theirs.

“After the first credit, everything else is your fault,” he says.

Littlejohn caught the company red-handed when storm damage disrupted his service for nearly a week, and Telecom’s usage meter recorded 22GB of usage on his down-and-out service anyway.

“They ultimately couldn’t argue with themselves, but they tried at first,” he says. “Then I told them to call the department responsible for repairing my service and they quickly learned the line they said used 22GB was out of service at the time the usage was supposed to occur.”

“Without that, they would have probably insisted I still owed them for that ‘usage.'”

Littlejohn wasn’t alone.  Other overbilled customers appealed their case to the New Zealand Herald last June, and two weeks later, Telecom admitted their usage measurement tool was faulty.  But by then, customers were already paying for the erroneous charges:

The Herald has received detailed internet usage logs from two Telecom customers – one in Dunedin and the other in New Plymouth – which show over-counting broadband downloads, in one period by as much as 139 per cent. Both have raised the matter repeatedly with Telecom, but have yet to get an explanation.

“We showed Telecom five days of data as early as February 14,” says director Mark Peisker of Dunedin’s CueClub. “There was massive variance between our data and that reported by the Telecom usage meter. I said to them: ‘Your counting has very little to do with what comes down my line to me’.”

CueClub’s data taken from its two internet routers shows an average of 62 per cent over-counting during a three month period – the worst month being May when Telecom counted an extra 118.24 gigabytes (GB) of usage amounting to $203.97 in overcharging.

“They’re crooks, plain and simple, and only when they were caught did they admit their mistakes, and the only ‘penalty’ they are paying is refunding their ill-gotten gains,” Littlejohn says. “Where is the substantial fine to send a message stealing from your customers is wrong?  A strong fine would tell Telecom they made a costly mistake not worth repeating.”

New Zealand is one of a handful of countries stuck with pervasive Internet Overcharging schemes that limit usage or throttle broadband speeds because of international connectivity limitations.  But as international underseas fiber cables ease traffic congestion, Internet Service Providers are increasingly relaxing usage caps and reducing the level of speed throttling during prime time usage hours.

Now one ISP, Slingshot, has gone all-out, reintroducing an unlimited, flat rate broadband option for New Zealanders who don’t want to worry about how much usage they’ve racked up over the past month.

For roughly $32.50US for the first six months, $65 after that, customers don’t have to watch a usage meter or “gas gauge” or face a wholesale heavy speed throttle when deemed to be using “too much” Internet service.