With friends like these…

In an effort to attract new business, Frontier Communications has launched a new nationwide brand platform it claims will help customers “facing challenges and frustrations navigating today’s internet services market.”

The “Don’t Go it Alone” campaign advertises Frontier as your friend on the digital frontier.

In one ad, a balladeer laments customers trying to use a home internet connection that is too slow and unreliable to depend on for working from home. The ad shows customers flocking to nearby coffee shops “looking for bandwidth” they do not have at home.

While the ads claim Frontier’s FiOS network is faster than its competitor — Charter Spectrum, many Frontier customers living outside of a FiOS service area will likely find Frontier’s ads ironic. That is because Frontier has a poor track record achieving the promised speeds it advertises to its large base of DSL customers. The 2016 FCC Report, “Measuring Fixed Broadband” (the annual reports were discontinued by the Trump Administration’s FCC in early 2017), found Frontier a poor performer. Even its fiber network Frontier FiOS was measured losing ground in delivering advertised speeds and performance.

Minnesota Public Radio reports hundreds of complaints about Frontier Communications have prompted statewide public hearings about the company’s alleged poor performance. MPR shares the stories of two frustrated Frontier DSL customers paying for service they do not get. (3:28)

“Our internet here is horrible, our provider is Frontier,” Monica King Von Holtum of Worthington in southwest Minnesota, told Minnesota Public Radio. “It’s infuriating.”

Her service is so bad, she can tell if a neighbor starts using the internet or another family member starts browsing.

“If I’m literally the only person using the internet, it’s fine,” said King Von Holtum. “As soon as we have one or more people using different devices it just tanks and we can’t get anything done.”

She is hardly alone. In Minnesota, the Public Utility Commission has received more than 400 complaints and comments about Frontier’s frustrating performance. Customers report service interruptions lasting up to a week and internet speeds slower than dial-up.

One customer said Frontier lacks “common decency” because of the way it treats its customers, often stuck with only one choice for internet access in their rural service areas.

A speed test showing 0.4 Mbps from 2013 shows this is an ongoing problem.

King Von Houltum showed MPR the results of a speed test while being interviewed.

“We have 0.4 megabits per second,” said King Von Holtum, who pays Frontier for 6 Mbps service. “And our upload is pretty much nonexistent.”

Melody Webster’s family makes regular 5-mile trips into the town of Cannon Falls to use their local library’s Wi-Fi service. It is the only way her children can complete their school assignments, because Frontier’s DSL struggles to open web pages. Webster has called Frontier again and again about the speed problems, but told the public radio station she gets “lied to or pretty much laughed at.”

That’s a story Frontier’s balladeer is not likely to put to song.

Frontier spent an undisclosed amount hiring the ad agency responsible for the new advertising.

“A brand campaign must be creative and memorable. It also has to drive a client’s business forward,” said Lance Jensen, chief creative officer of Hill Holliday, which created the campaign. “The Balladeer is a fun and accessible character who brings humanity and humor to the frustrating experience of dealing with internet and TV service. We can’t wait to put him to work for the Frontier brand.”

The campaign launches this week in Frontier markets nationally and includes broadcast, radio, online video, out of home, digital and social components.

An “affable balladeer” sings about the frustrations of internet users who do not get the internet service they paid for, in this new 30-second ad from Frontier Communications. Ironically, slow speed is the most common complaint about Frontier’s own DSL service. (0:30)

OpenVault’s technology can automatically slow down “abusers” who use too much internet service.

Cable companies looking for ways to raise prices for their broadband services without spending money on network upgrades may be interested in OpenVault’s “Revenue Accelerator” — a cloud based internet usage measurement system that can help push subscribers into higher priced tiers or warn them when they are about to face punitive overlimit fees for exceeding their monthly usage allowance.

OpenVault’s goal is to monetize customers’ internet usage, making cable operators certain each customer is paying as much as possible for internet service without facing customer-displeasing overlimit fees from exceeding their monthly usage allowance.

“All these solutions are designed really to do of a couple things,” said OpenVault CEO and founder Mark Trudeau, in an interview with FierceTelecom. “One is to drive incremental revenues, and two is to drive costs [for cable operators] down, all with the idea of increasing profit for cable operators.”

OpenVault will collect customers’ usage behaviors, reporting back every 15 minutes how much bandwidth each customer is using, as well as enforcing cable company policies to automatically slow down “abusers” who are sending and receiving more than their fair share of data. Enforced network management, built into the platform, can automatically punish customers based on violations of the ISP’s Acceptable Use Policies. Usage violators are then reported to the cable operator, targeted for future marketing campaigns to upgrade their service to a more expensive tier to avoid further time-outs on the internet slow lane.

The technology is cheap to deploy, relying on a set of command lines inserted into cable modem termination systems that collect Internet Protocol Detail Record data and send it on to OpenVault.

“We measure all that for the operators and then what our Revenue Accelerator product does is it helps them micro-target their upgrade candidates,” Trudeau said. “This can have just really massive impacts on their revenues, to be able to truly not just micro-target the upgrade candidates, but also provide their reps with the ammunition they need and the visibility they need into their customer’s behavior and into their homes so they can intelligently talk to a subscriber.”

OpenVault claims the implementation of usage based billing and data caps are immediate money-makers for operators, both from current customers forced to upgrade to avoid the cap and from overall usage billing that delivers an immediate payday to cable operators without having to invest in expensive upgrades or service improvements.

“In real-number terms, evidence shows an immediate return as some OpenVault customers have enjoyed as much as seven percent of subscribers upgrading their service within 90 days of usage based billing deployment,” the company wrote on its blog. “For some operators, this translates into increased ARPU (average revenue per unit) of over $5 per subscriber per month. OpenVault customers that have deployed usage based billing have experienced increased ARPU ranging from $1.50 up to $12 per subscriber per month.”

Comcast has quietly dropped its internet congestion management system, designed to slow down its heaviest users, claiming it has gone unused for more than a year and was no longer needed.

Originally spotted by readers of DSL Reports, the announcement referenced the system that replaced Comcast’s speed throttle that intentionally degraded peer-to-peer network traffic after Comcast claimed it was unfairly impacting its other customers:

As reflected in a June 11, 2018 update to our XFINITY Internet Broadband Disclosures, the congestion management system that was initially deployed in 2008 has been deactivated. As our network technologies and usage of the network continue to evolve, we reserve the right to implement a new congestion management system if necessary in the performance of reasonable network management and in order to maintain a good broadband Internet access service experience for our customers, and will provide updates here as well as other locations if a new system is implemented.

Comcast’s “protocol-agnostic” network management technology, designed by Sandvine and introduced in 2008, measured customer traffic and singled out heavy users for speed reductions when Comcast’s network was saturated with traffic. Customers were unaware if they were deemed heavy users or if their traffic was targeted for temporary speed reductions. Comcast relied on the technology, along with the introduction of a 250 GB nationwide data cap, to control network traffic and stall the need for expensive node-split upgrades.

Comcast claims the introduction of DOCSIS 3.0 (starting in late 2008) and DOCSIS 3.1 (2017) gradually eliminated the need to maintain the congestion management system, because channel bonding vastly expanded available internet bandwidth. What remains in place in most Comcast service areas is Comcast’s controversial 1 TB usage cap. The company initially claimed its data caps were part of a network traffic management strategy, but more recently the company claims it collects more from heavy users to compensate for its broadband investments.

The country’s largest cable internet service provider needed help from an app developer in Portland, Ore. to let it know its broadband pipes were full and to do something about it.

Comcast customers were complaining about slow downloads from the Panic website and the company’s own workers were saying largely the same thing when attempting to remotely connect to the company’s servers from home.

Because Panic’s web servers have just a single connection to the internet via Cogent, it would be a simple matter to track down where the traffic bottleneck was occurring, assuming there was one. The company asked for volunteers to run a test transferring 20MB of data first from Panic’s server and then again from a control server hosted with Linode, a popular and well-respected hosting company.

The results were pretty stunning.

With speeds often around only 356.3kbps for Comcast customers connecting to Panic, something was definitely up. It also explained why employees had a rough time connecting to the company’s server as well — Panic’s workers are based in Portland, Ore., where Comcast is used by almost every employee.

The slowdowns were not related to the time of day and because the problem persisted for weeks, it wasn’t a temporary technical fault. Panic’s blog picks up the story about what is behind all this:

Peering.

Major internet pipes, like Cogent, have peering agreements with network providers, like Comcast. These companies need each other — Cogent can’t exist if their network doesn’t go all the way to the end user, and Comcast can’t exist if they can’t send their customer’s data all over the world. One core tenet of peering is that it is “settlement-free” — neither party pays the other party to exchange their traffic. Instead, each party generates revenue from their customers. Cogent generates revenue from us. Comcast generates revenue from us at home. Everyone wins, right?

After a quick Google session, I learned that Cogent and Comcast have quite a storied history. This history started when Cogent started delivering a great deal of video content to Comcast customers… content from Netflix. and suddenly, the “peering pipe” that connects Cogent and Comcast filled up and slowed dramatically down.

Normally when these peering pipes “fill up”, more capacity is added between the two companies. But, if you believe Cogent’s side of the story, Comcast simply decided not to play ball — and refused to add any additional bandwidth unless Cogent paid them. In other words, Comcast didn’t like being paid nothing to deliver Netflix traffic, which competes with its own TV and streaming offerings. This Ars Technica article covers it well. (How did Netflix solve this problem in 2014? Netflix entered into a business agreement to pay Comcast directly. And suddenly, more peering bandwidth opened up between Comcast and Cogent, like magic.)

We felt certain history was repeating itself: the peering connection between Comcast and Cogent was once again saturated. Cogent said their hands were tied. What now?

In addition to giving the internet public policy community new evidence that peering fights leaving customers stuck in the middle might be heating up once again. It also suggests if Comcast was unaware of the problem, it does not reflect well on the cable company to wait weeks until a customer reports such a serious slowdown before fixing it.

The folks at Panic took a chance and reported the problem to Comcast, bypassing the usual customer support route in favor of a corporate contact who listed a direct email address on the company’s website. Comcast took the request seriously and eventually responded, “give us one to two weeks, and if you re-run your test I think you’ll be happy with the results.”

Indeed, the problem was fixed. The folks at Panic say according to Comcast, two primary changes were made:

1. Comcast added more capacity for Cogent traffic. (As suspected, the pipe was full.)
2. Cogent made some unspecified changes to their traffic engineering.

The folks at Panic and their users are happy that the problem is fixed, but some questions remain:

1. Is Comcast intentionally throttling web traffic in an attempt to extract a more favorable peering agreement with Cogent?
2. How could Comcast not know this particular connection was hopelessly over-capacity for several weeks, leaving customers to deal with heavily throttled traffic.

“While this story amazingly had a happy ending, I’m not looking forward to the next time we’re stuck in the middle of a peering dispute between two companies,” wrote Cabel. “It feels absolutely inevitable, all the more so now that net neutrality is gone. Here’s hoping the next time it happens, the responsible party is as responsive as Comcast was this time.”

Panic explains internet slowdowns resulting from peering disputes in this (3:30) video.

With many cable operators reporting a need to double network capacity every 18-24 months to keep up with customer traffic demands, the industry is spending time and money contemplating how to meet future needs while also finding ways to cut costs and make networks more efficient.

Top technology executives from five major cable operators answered questions (sub. req’d.) from Multichannel News about their current broadband networks and their plans for the future. Some, like Mediacom, are aggressively adopting DOCSIS 3.1 cable broadband upgrades for their customers while companies like Cox and Comcast are deploying multiple solutions that use both traditional hybrid fiber-coax network technology and, on occasion, fiber-to-the-home to boost speed and performance. But at least one cable company — Charter Communications — thinks it can continue operating its existing DOCSIS 3 network without major upgrades for several years to come.

Cable Broadband Traffic Can Be Handled

“We’ve been on a pretty steady path of doubling our network capacity every 18-24 months for several years, and I don’t see anything that makes me think that will change,” said Tony Werner, president of technology and product at Comcast. “We’ve been strategically extending fiber further into our network to meet customer demand, and that effort, combined with our commitment to deploying DOCSIS 3.1 has given us a network that’s powerful, flexible, and ready for what’s next.”

J.R. Walden, senior vice president of technology at Mediacom was more aggressive.

“We have completed the removal of all the analog channels. That was the big step one,” Walden said. “Step two was to start transitioning high-speed data over to DOCSIS 3.1, so we’re not adding any more 3.0 channels, and reuse spectrum for 3.1, which is a bit more efficient. The whole company is 3.1, all the modems we’re buying since June have been 3.1, so we’ve begun that next transition.”

Walden added Mediacom is also trying to improve broadband performance by reducing the number of customers sharing the same connection.

“We average about 285 homes to 290 homes per node as an average,” he said.

Mediacom is also scrapping older technology on the TV side to open new bandwidth. The cable company is getting rid of MPEG-2-only set-top boxes so the company can transition its video lineup to MPEG-4. But even that won’t last long. Walden admits the company will then quickly start moving less-viewed channels and some premium networks to IP delivery.

Traditional cable broadband service relies on a hybrid fiber-coax network.

In its European markets, Liberty Global has adopted Converged Cable Access Platform (CCAP) equipment across its footprint. CCAP technology saves cable operators space and operates more efficiently, and supports future convergence of technologies that cable operators want to adopt in the future. CCAP has helped Liberty Global deal with its 45% traffic growth by making upgrades easier. The company is also using advanced features of CCAP to better balance how many customers are sharing a connection. The next step is adopting DOCSIS 3.1.

“Seventy to 80% of our plant will be DOCSIS 3.1 ready by the end of next year, giving us a path to even greater capacity expansion allowing us to continue to increase the available capacity across our access network, upstream and downstream,” said Dan Hennessy, chief architect of network architecture for Liberty.

Charter is prioritizing maximizing performance on the network it already has.

“Our priority is to constantly balance capacity against demand. It’s a never-ending quest,” said Jay Rolls, Charter’s chief technology officer. “We watch it very closely, and we’re very pragmatic about it — the volume of tools, metrics and ways to see what’s really happening, and invest accordingly, is really deepening in ways that matter.”

Is Fiber-to-the-Home in Your Future?

While some cable operators like Altice’s Cablevision are scrapping their existing hybrid fiber-coax networks in favor of fiber-to-the-home (FTTH), America’s largest cable operators are not in any hurry to follow Altice.

Comcast has expanded its fiber network closer to customers in the last few years, but sees no need to convert customers to FTTH service.

“I feel pretty strongly that the best path ahead is to leverage the existing coaxial network and DOCSIS resources to the fullest, then inch towards FTTH, over time Why? Because we can. We don’t have to build an entire network just to turn up one customer.”

The next generation of cable broadband service may depend on CCAP – technology that will cut operator costs and lay the foundation for changing the way video and other services are delivered to customers.

Cox has a 10-year Network 2.0 plan that will bring fiber closer to customers, but not directly to every home. More important to Cox is having the option to support symmetrical speeds, which means delivering upload speeds as fast as download speeds. In the meantime, network cabling Greensboro can improve your current connectivity and reliability, preparing your network for high-speed internet.

“We’re also thinking about the fiber investment and fiber deep as it relates to our wireless strategy, enabling some of our customers with a small cell strategy but also positioning ourselves to take advantage of that in the future, as well as thinking about fiber deep to benefit both residential and our commercial customers simultaneously,” said Kevin Hart, Cox’s executive vice president and chief product and technology officer.

Liberty/Virgin Media’s Project Lightning is bringing cable broadband and TV service to places in the UK that never had cable service before.

In Europe, Liberty Global’s “Project Lightning” network expansion initiative is building out traditional cable service in the United Kingdom. Most of the UK never adopted cable service, favoring small satellite dish service instead. Now Liberty Global is putting cable expansion on its priority list. But decades after most North Americans got cable service for the first time, today’s new buildouts are based largely on fiber optics — either fiber to the home or fiber to the neighborhood, where coaxial cable completes the journey to a customer’s home.

Charter admits the technology it will use in the future partly depends on what the competition is offering. Rolls says the company can eventually roll out DOCSIS 3.1, take fiber deeper, or offer symmetrical download/upload speeds presumably targeted towards its commercial customers. But he also suggested Charter’s existing network can continue to deliver acceptable levels of service without spending a lot on major upgrades.

“It’s a rational approach, where we’re trying to balance the needs, the available technologies, and the costs,” Rolls said. But he also suggested DOCSIS 3.1 isn’t always the answer to upgrades. “DOCSIS 3.1 has some pretty remarkable capabilities, but it’s not necessarily a hard-and-fast reason to not take fiber deeper, for instance [allowing for additional DOCSIS 3 node splits]. Different situations drive different capacity decisions.”

Walden agreed, and Mediacom customers should not expect more than DOCSIS 3.1 upgrades for the near future.

“[Fiber deep] is a bit further out, at least as a large-scale type of project,” Walden told Multichannel News. “I think fiber deep for multi-dwelling units, high-density areas and some planned higher end communities doing deeper fiber or fiber-to-the-home [is happening]. But as a wholesale [change] and going to node+0 kind of architecture, I don’t see that in the next two years.”

Are Symmetrical Speeds Important for Customers?

Verizon’s fiber to the home service FiOS uses symmetrical broadband speeds to its advantage in the marketplace.

Many fiber to the home networks offer customers identical upload and download speeds, but cable broadband was designed to favor downstream speeds over upstream. That decision was based on the premise the majority of users will receive much more traffic than they send. But as the internet evolves, some are wondering if cable broadband’s asymmetric design is now outdated and some competitors like Verizon’s FiOS fiber to the home service now use its symmetrical speed advantage as a selling point.

Cox Communications does not think most customers care, even though its network upgrades are laying the foundation to deliver symmetrical speeds.

“It’s a little but further out on the horizon,” said Hart. “The upstream growth rate is ticking up a couple of notches, but not to the tune that we would need significant additional capacity and/or a complementary need for symmetrical bandwidth. [A]t this stage, the symmetrical is a nice-to-have for residential and definitely will be a good option for our commercial customers.”

Rolls isn’t sure if symmetrical speeds are important to customers either and Charter has no specific plans to move towards upload speed upgrades.

“The world of applications and services continues to evolve, obviously, but so far we’ve been able to meet those needs with an asymmetrical topology,” Rolls said. “That said, things like real-time gaming, augmented and virtual reality, and the Internet of Things — some of those will likely drive more symmetry in the network. It remains to be seen.”