Last week, Stop the Cap! took a look at Virgin Mobile’s new unlimited $40 prepaid wireless broadband service.  Early testing looked promising, with speed test results that were well within economy tier DSL service and better than expected.  But by early this week the story began to change.

We’ve continued testing the service here and have noticed that while Virgin Mobile’s service turned in respectable performance during the business day (East Coast time), once people started heading home, it’s a completely different story.  For the last five days the service has deteriorated to the point of unusability by dinnertime.

It had gotten so bad, we went back to using Cricket’s wireless broadband.

So what’s happening?

First, it’s important to distinguish that these problems are impacting only Virgin Mobile.  Sprint’s postpaid customers can use the same cell tower and backbone network and not experience any performance issues.  Virgin Mobile’s home location on Sprint’s data network is in San Francisco, and until September 2nd, all traffic headed for the Bay Area to what is basically a virtual LAN on Sprint’s network.  The IP address we were assigned was actually an internal address for that virtual LAN.

Our problems started appearing Monday afternoon when we noticed web pages refused to load completely.  Since many web pages are composed of content from a variety of different web hosts (Google Analytics, advertising, embedded content, etc.), if parts of the page refuse to load, the page itself may not appear at all.  Advertising blocks were the worst problem, often leaving one staring at a blank web page waiting for the ad content to render.

By Wednesday, this problem simply made using Virgin Mobile for broadband untenable.  Few pages — even Google’s home page, refused to load reliably.  When pages did appear, they took longer than dial-up in many cases.  We tried to perform some diagnostics but found trace-routing impossible after the third hop and speed tests could not be loaded, much less run reliably.

The fact the worst problems occurred in the late afternoon and evening hours point to a network completely overloaded with customers.

And indeed, Virgin Mobile admitted as much when it replied to some tweets indicating it had quadrupled capacity by the end of this week.  Some users also reported they no longer connected exclusively through the San Francisco (Walnut Creek) location.

As of Thursday, anecdotal reports indicated some service improvements, but the service is still prone to slowdowns during peak usage times.

A few things are evident now that a week has passed:

1. Virgin Mobile Wireless Broadband does not share the better performing Sprint postpaid data network those customers receive.  Virgin Mobile customer traffic shares a much smaller “pool of bandwidth” because of the limitations imposed by its routing.
2. The company needs to either abandon its current routing scheme or dramatically modify it to accommodate the traffic.
3. Refunds for disgruntled customers are often available for the hardware, but don’t expect to get a refund for data usage.
4. The service problems come regardless of the device used or the number of signal bars you receive.
5. New routing cities have popped up since Thursday to supplement San Francisco — Charlotte, N.C., New York, Atlanta, Boston, Southfield (Mich.), Los Angeles, Philadelphia, and a few others.  Feel free to share yours in the comments section.

On Friday, Virgin Mobile suffered a major outage caused by a power failure that has stopped or seriously delayed delivery of text messages.  The outage is also affecting some data connections and customer service availability.  Angry customers have been pelting the company’s Facebook page with hostile remarks since the outage began.

If you signed up for Virgin Mobile wireless broadband, please share your experiences in our comments section!

Bray Cary -- Frontier's biggest fan in West Virginia

Bray Cary has been falling all over himself again — singing praises for Frontier Communications while many of its customers in West Virginia contend with service problems and outages, sometimes for weeks at a time.

Cary, president and chief executive officer of West Virginia Media, owner of television stations across the state, was a big supporter of the deal to sell Verizon’s landlines in West Virginia to Frontier Communications. This past spring, Cary’s weekly Decision Makers program treated viewers to a softball question and answer session with Frontier’s Ken Arndt, who was forced to “endure” Cary’s contention that opposition to the deal was limited mostly to labor union sour grapes.

With a hard interview like that, Arndt was delighted to be asked back for another edition of Tea-’N-Cookies Breakfast Club With Bray, this time to answer tough questions about how the transition could have possibly gone any better for the independent phone company.

Good morning and welcome to Decision Makers on a weekend when America is discovering the beauty of the great state of West Virginia.  Through the magic of worldwide television […] we here in West Virginia are on the verge of discovering the power of the Internet across all of our hills and all of our valleys.

With that over-the-top introduction, Cary was off, spending nearly 20 minutes glad-handing Arndt through an interview that could have been produced in-house by Frontier’s marketing department.

[flv width=”500″ height=”395″]http://www.phillipdampier.com/video/WTRF Wheeling Decision Makers Cary Arndt Frontier 7-31-10.flv[/flv]

Nearly 20 minutes of mutual admiration between Frontier’s Ken Arndt and WV Media’s Bray Cary can be experienced for yourself.  These segments appeared July 31st on the Decision Makers program.  (19 minutes)

Ohio County, WV

More tea?

Meanwhile, in other parts of the state things are not nearly as rosy as Cary and Arndt contend.

Stop the Cap! reader Ralph points us to Ohio Country, located in the Northern Panhandle of West Virginia, where Frontier has subjected some customers to service outages extending into three weeks.  Entire neighborhoods have lost phone and broadband service.  Dela Misenhelder, who lives in Valley Grove says a storm August 4th knocked out service for her and her neighbors.  Misenhelder used her cell phone to call Frontier three different times to no avail.

“My concern is the elderly,” Misenhelder told a local TV station.  “Do they have cell phones — being out in the country, do they even have a signal — and be able to get 911 in case of an emergency or problem.”

Frontier’s regional general manager, William (Bill) Moon said that Frontier was supposed to have contacted all of the neighbors impacted by the outage to make sure service was restored.  In Misenhelder’s case, since her phone line was still not working, she never got that call.

Moon is a name readers will become increasingly aware of, as he features prominently in damage control efforts by Frontier in northern West Virginia when they get negative media coverage.

[flv width=”640″ height=”380″]http://www.phillipdampier.com/video/WTOV Steubenville Frontier Continues Dealing With Phone Service Issues 8-25-10.flv[/flv]

Dela Misenhelder in Ohio County, W.V., was without her Frontier phone line for three weeks.  She made three calls to Frontier, who ignored her, so Dela called the newsroom of local TV station WTOV-TV in Steubenville, Ohio looking for help.  They achieved results for her, as you’ll see in this report.  (2 minutes)

Hancock County, WV

Matters are even more serious in the northern tip of the state — in Hancock County — where emergency responders are coping with defective T1 data lines that Frontier has failed to maintain properly, causing interruptions in emergency radio traffic.

The problems started when Verizon was in charge, but have gotten considerably worse since Frontier arrived.  Now the backup systems are beginning to fail as well.

When that happens, emergency communications with fire, police, and ambulance can’t happen, forcing first responders to rely on cell phones to communicate with one another.

Frontier called the problems with the T1 lines “odd” and at last check was examining more than 10,000 feet of phone cable looking for problems.

A local TV station witnessed the failure of a Frontier T1 line provided for emergency radio traffic themselves while filming a story on repeated Frontier outages.

On Saturday, another Frontier outage disrupted 911 service across Jefferson, Belmont and Harrison Counties, forcing local media to deliver streams of local direct numbers for emergency officials across all three counties.

[flv width=”640″ height=”380″]http://www.phillipdampier.com/video/WTOV Steubenville Hancock County Experiencing More Phone Problems 7-8-10.flv[/flv]

Not less than three reports about failures in emergency communications attributed to a defective T1 line maintained by Frontier Communications have run on WTOV-TV in the last two months.  (6 minutes)

Residents in Marshall and Wetzell counties, which complete the Northern Panhandle are no strangers to Frontier service problems.  They were Frontier customers before Verizon sold its landline network to the company.

Stop the Cap! reader Mitch in New Martinsville writes to tell us West Virginia is just becoming acquainted with service on ‘the Frontier.’

“The company delivered lousy service to us long before they’ll deliver lousy service to the rest of the state,” he writes. “We cannot get DSL from Frontier because they won’t spend the money to re-engineer the ancient wiring on our street.”

For Mitch, the outage experienced by his ailing grandmother this past February, which stopped calls connecting from outside of the 686 exchange, was the last straw.

“She couldn’t reach me and I couldn’t reach her,” Mitch adds. “If a phone company cannot even handle basic phone call connections, what good are they?”

[flv width=”640″ height=”380″]http://www.phillipdampier.com/video/WTOV Steubenville Phone Service Knocked Out In Parts Of Marshall Wetzel Counties 2-10-10.flv[/flv]

A winter storm knocked out Frontier service across parts of the Northern Panhandle this past February.  Customers discovered they could only dial and receive calls from other local residents.  WTOV-TV covered the story.  (2 minutes)

When Mitch tried to cancel Frontier service, he says they tried to stick him with an early termination fee of more than $100.

“I never signed a contract with them,” he writes.

NY State Attorney General Andrew Cuomo

Mitch escalated his complaint to the West Virginia Public Service Commission, which finally got Frontier to relent.

Mitch’s experience with phantom early termination fees charged by Frontier are hardly new.  Last fall, Frontier was slapped with a $35,000 fine and ordered to refund $50,000 in wrongfully charged termination fees by the NY State Attorney General’s office.

That precedent might come in handy in Washington state, where Frontier “accidentally” put former Verizon customer Steve Matheny in Redmond on an annual contract with a hefty cancellation fee.  When Frontier took over for Verizon, Matheny decided it was time to drop service.  Frontier sent him a final bill including a fee of $120 for terminating his service before his contract had ended.

Only one problem — he never had a contract.

“These folks rolled in and added a fee that no one committed to, at least I didn’t commit to,” he said.

Frontier ignored Matheny’s attempts to get the fee off his final bill, so he called KING-TV in Seattle for help.

As with so many other cases, when local TV stations feature Frontier’s mistakes and bad service on the 6 o’clock evening news, doors to a speedy resolution have a tendency to open.  Matheny got his $120 “fee” removed.

[flv width=”480″ height=”290″]http://www.phillipdampier.com/video/KING Seattle Bundled by accident charged a fee 8-24-10.mp4[/flv]

Redmond, Washington resident Steve Matheny joins a growing number of Frontier customers who suddenly find themselves on annual service contracts with hefty cancellation fees, despite the fact they never agreed to them.  KING-TV reports their intervention finally cut through Frontier’s red tape to get $120 in early cancellation fees removed from a final bill.  (2 minutes)

For West Virginia residents, the next time you experience a problem with your Frontier landline or broadband service, why not contact Bray Cary and ask him what he’ll do about it.  At the very least, ask him to pass you the plate of cookies.

Tens of thousands of Oceanic Time Warner Cable customers across Hawaii were without Internet, cable, and phone service for up to 14 hours after an undersea TW Telecom fiber cable was cut near Lanai at around 1:10am Tuesday.

While broadband users on Kauai and Oahu managed to be rerouted after a two hour outage, residents on Maui and the Big Island endured more than a half-day outage for all of Time Warner Cable services.

The affected cable experienced an outage off Lanai Island

The impact of the fiber cut also disrupted over-the-air broadcasting — many feeds to Hawaii’s translator stations, which extend signals from Honolulu across the Hawaiian Islands, were also sent over the affected cable.

When Time Warner customers in Hawaii woke up Tuesday morning, many were left with fewer than 20 cable signals still working — those delivered via satellite, and no phone or broadband service.

The affected fiber cable is laid in water 3,000 feet deep, which means it will take weeks to manage repairs.  The cable company managed to obtain alternate connections, and some criticized the operator for not having backup service available immediately.

Restoration of services were complete around noon Tuesday for the Big Island, with Maui County getting phone and Internet service back by 3pm.

Hawaiian Telcom, Hawaii’s largest telephone company, said it wasn’t affected by the outage.

The Star-Advertiser reports the fiber cable is rented by Oceanic to communicate with their other cable operations throughout Hawaii:

Oceanic Time Warner rents bandwidth (data transmission capacity) from the fiber-optic cable, co-owned by Colorado-based TW Telecom and Wavecom Solutions, formerly Pacific Lightnet. TW Telecom was part of Time Warner Cable but became an independent entity in 2008.

Oceanic Time Warner is among 144 Maui firms that rent bandwidth from that section of the cable. That section went online in 1997, Miyake said.

When the cable was cut, Internet protocol addresses did not know which route to take back to the mainland. Oceanic crews had to reroute connections through alternate cables connecting the islands.

“We have a daisy-chain fiber connection that connects all the islands together,” said Norman Santos, Oceanic’s vice president of operations. “The main transmission point for Oceanic Cable is here on Oahu.”

Oceanic promises they will be developing additional redundancy in their network in the future to make sure they can restore service more rapidly in the event of a future disruption.

Typically, Oceanic Time Warner Cable does not give refunds unless service is out for a full 24 hours -and- customers specifically requests credit, but the company is debating whether to grant an exception this time.

“We’re going to make a determination as to if and how blanket credits will be authorized, if individual credits will be authorized, but we’re going to do the right thing,” Norman Santos with Oceanic Time Warner Cable told KHON-TV.

Customers can be in a better position to receive that credit by contacting Oceanic today and asking for it before you (and perhaps they) forget.

[flv width=”640″ height=”500″]http://www.phillipdampier.com/video/Time Warner Hawaii Outage 7-27-10.flv[/flv]

Every major television station in Hawaii covered the extensive service outage.  Here is a compilation of reports from KGMB, KHNL, KHON, and KITV-TV regarding the outage, its cause and impact.  (14 minutes)

We have received a copy of AT&T’s statement in response to yesterday’s report about slowed upload speeds impacting customers in several cities around the United States:

AT&T and Alcatel-Lucent jointly identified a software defect — triggered under certain conditions – that impacted uplink performance for Laptop Connect and smartphone customers using 3G HSUPA-capable wireless devices in markets with Alcatel-Lucent equipment. This impacts less than two percent of our wireless customer base. While Alcatel-Lucent develops the appropriate software fix, we are providing normal 3G uplink speeds and consistent performance for affected customers with HSUPA-capable devices.

That two percent figure seems low considering the sheer number of reports received, but it’s not unprecedented.  Equipment and software glitches can create major slowdowns and outages.  While the problem is being fixed, affected customers are falling back to older and slower upload protocols.  AT&T didn’t apologize for the slowed upload speed, nor provide an estimate for when repairs would be complete.  As of the time of writing (3pm ET), problems are still being noted by some customers.

Customers annoyed by the glitch might be able to obtain some credit for the reduced level of service by contacting AT&T customer service and asking for it.

Bzz... bzz... bzz.... AT&T U-verse Voice customers got nothing but busy signals for much of today.

AT&T U-verse telephone service failed its customers this morning from coast to coast.

A major outage, starting at around 5:00am EDT left callers from Los Angeles to Connecticut with nothing but busy signals for at least four hours.

Customers could not reach an operator or 911 emergency services, and calls to AT&T’s customer service and repair lines were met with busy signals.

Some customers headed online to get chat support, but discovered queues stretching into three digits.  John from Tennessee writes Stop the Cap!:

I am number 473 in the chat queue at the moment, which is laughable.  My only other phone is an AT&T prepaid GoPhone and I’m not going to give AT&T 25 cents a minute to tell them their U-verse service has failed.  They’d better hand over some credit.

He was well ahead of Ccalana from Folsom, California who was #852!

Other websites have reported similar complaints from impacted customers.  Broadband Reports noted AT&T confirmed the company suffered a national U-Verse voice outage for much of the day.

Customer service agents have been less than helpful, not giving out much information about what’s behind the collapse of AT&T’s Voice Over IP phone service.

The only good news is that the worst of the outage appears to be over at this point, with customers noting returned dial tones and calling capability starting after noon.

AT&T warns customers outages can make 911 service from U-verse Voice unreliable.

This is the second major outage experienced by AT&T U-verse Voice this month.  The last one occurred May 16th from around 3-8am.  Few customers noticed.

Most phone and cable companies do not extend outage credits for consumers unless they are asked.  So when service is restored, be sure to ask AT&T for a credit on your next bill.