Some Comcast customers are receiving notifications their service may be briefly interrupted as a result of ongoing network enhancements:

As you can imagine, customers are using our services more than usual, and in certain neighborhoods we are adding capacity to improve our network and your service now. Your area has been identified as a location that will benefit from network improvements, which is why it’s necessary for us to complete the work at this time, so you’ll continue to connect and enjoy the services you expect.

We are installing more fiber throughout our network by replacing some coaxial cable with fiber lines. This will include some construction in your neighborhood and will cause some intermittent interruptions to your service during the day.

In the future, we’ll be able to offer you even more reliable service, greater network capacity and more gig speeds to more homes down the line. This means more downloading, more streaming and more gaming.

Comcast is currently preparing its network for full duplex DOCSIS 4.0 service by adopting “node plus zero” network architecture, which in plainer terms means removing signal amplifiers from existing lines and replacing a significant percentage of its copper coaxial cable infrastructure with fiber optics. The fiber network upgrades are reportedly bringing more consistent and faster internet speed on a more reliable network as soon as the switch is complete. Most customers won’t see fiber cables replacing the current cable line coming into their homes, however. The upgrade is mostly taking place on utility poles and, in some places, underground as Comcast replaces copper wiring with optical fiber cables.

Sometime next year, Comcast is expected to start adopting Full Duplex DOCSIS (FDX) 4.0, the newest cable broadband standard, capable of bringing identical upload and download speeds to customers. It is the only major American cable operator to favor FDX, which will place upstream and downstream traffic on the same block of cable spectrum. Other cable operators including Charter Spectrum, Cox, and Mediacom will support Extended Spectrum DOCSIS (ESD) 4.0, which is expected to be cheaper to deploy and will continue to keep downstream and upstream traffic confined to separate frequency bands, albeit larger ones capable of delivering much faster speeds.

CableLabs unveiled the final DOCSIS 4.0 specification today, dramatically improving upload speeds and offering the potential of much faster internet service from cable operators in the next few years.

DOCSIS 4.0 will support downstream speeds as fast as 10,000 Mbps and upload speed as fast as 6,000 Mbps, finally bringing faster upstream speed to cable company-provided internet. The new standard raises maximum speeds by opening up “extended spectrum” on the coaxial cable coming into your home. By dedicating additional frequencies for data services, cable companies can raise both speed and capacity.

Consumers have been asking for faster upload speeds to support streaming live video, cloud backup services, and a growing number of in-home devices sharing a single internet connection. For years, cable providers have only been able to provide a small fraction of upstream speed in comparison to download speed. That distinction will largely be erased as DOCSIS 4.0 gets deployed over the next few years. Providers are likely to raise upload speeds on existing speed tiers and offer consumers symmetrical download and upload speed for gigabit connections. The increased speed will also likely make cable broadband more attractive to business customers.

The new standard will also decrease network latency, crucial for some online applications. It will also feature more robust security and higher reliability by identifying potential network problems before they become apparent to customers.

Consumers may see DOCSIS 4.0 modems and service available within the next two years.

The next standard for cable broadband is now due by 2020.

For over a year, the cable industry has been stalled after deciding to slash investment in broadband while enduring indecision and confusion over the next generation of cable broadband.

At issue is a simmering disagreement — rare for the usually unified cable industry — about the next generation of cable broadband, dubbed DOCSIS 4.0.

Two sides have emerged. Cable giant Comcast has spent years gradually preparing its network for perhaps the last iteration of coaxial copper-delivered cable internet service. It has spent at least five years gradually pushing optical fiber closer to its customers, retiring additional coaxial cable and the amplifiers and other equipment associated with that technology. The result is a company ready to embrace Full Duplex DOCSIS, known as “FDX.”

FDX is designed to allow upload and download traffic to share the same spectrum, letting cable companies put internet service bandwidth to full use with maximum efficiency. Comcast wants FDX to be a central part of DOCSIS 4.0. The company has been working through a long-term plan to offer much faster internet service, including symmetrical broadband — unified upload and download speeds. This would erase the cable industry’s broadband Achilles’ heel: download speeds much faster than upload speeds.

To achieve FDX, cable companies have to push fiber much deeper into their networks, sometimes right up to the edge of neighborhoods. It also means eliminating signal amplifiers that help keep signals robust as they travel across older coaxial cable infrastructure. Engineers call this concept “Node+0” architecture, which means a network with zero amplifiers.

FDX gives the cable industry the opportunity of running a more robust broadband network, easily capable of 10 Gbps with an upgrade path to 25 Gbps later on. The downside is that it can be very expensive to implement, especially if a cable company has under invested in upgrades and not incrementally laid a foundation for FDX. Wall Street may balk at the upgrade costs. The logistics of readying degrading older infrastructure to launch FDX may be so onerous, some cable systems may find it more cost effective to scrap their existing hybrid fiber-coaxial (HFC) networks and switch to a state-of-the-art fiber to the home network instead. That is precisely what Altice USA is doing with its Cablevision/Optimum system in New York, New Jersey, and Connecticut.

Charter Communications, along with many other smaller cable operators, have been pushing an alternative to FDX that is likely to cost much less to implement. Extended Spectrum DOCSIS (ESD) is designed to work over existing cable systems, including those that still rely on amplifiers and aging coaxial cable. Instead of allowing internet traffic to share bandwidth, ESD follows the existing standard by keeping upload traffic on different frequencies than download traffic. It simply extends the amount of bandwidth open to both types of traffic, which will allow cable systems to raise speeds. ESD will dedicate frequencies up to 3 GHz (and higher in some cases) for internet traffic. DOCSIS 3.1, the current standard, only supports internet traffic on frequencies up to around 1.2 GHz. ESD will also allow cable companies to raise upload speeds and should support up to 10 Gbps downloads. But there are some questions about how well ESD will support 25 Gbps speed and the condition of the cable company’s existing coaxial network will matter a lot more than ever before. A substandard network will cause significant speed degradation and could even disrupt service in some cases.

Despite the limitations of ESD, many cable companies consider its low implementation cost a principal reason to support it over FDX.

For much of this year, cable companies have put upgrades on hold as the industry sorts out which direction DOCSIS 4.0 will take. Equipment manufacturers and vendors have resorted to layoffs and cutbacks and have signaled neither Comcast nor other cable companies are big enough to justify different DOCSIS standards supporting FDX or ESD.

Comcast and Charter are the two largest cable companies in the United States.

Therefore, the cable industry has informally decided DOCSIS 4.0 will need to support both FDX and ESD under a single specification, with next generation cable modems and equipment capable of supporting either technology. At a joint pre-Cable-Tex Expo conference held on Monday, executives from Comcast and Charter appeared to support the new unified approach to DOCSIS 4.0.

John Williams, vice president of outside plant engineering and architecture at Charter Communications, told attendees cable companies need to support both FDX and ESD and stop taking an “either/or” approach.

“In order to do this, we need to look at the synergies and embrace ESD and FDX as the next generation of HFC,” Williams said. “It’s all about scale.”

Charter has been significantly challenged historically because its own legacy cable systems were often behind the times and sometimes dilapidated. Its 2016 acquisition of Time Warner Cable and Bright House Networks only complicated things further, because neither operator had a reputation for using state-of-the-art HFC technology. Costly upgrades have been underway at many Charter-owned cable systems since the merger closed, some still ongoing.

Robert Howald, part of Comcast’s network upgrade team, called the emerging DOCSIS 4.0 standard a “perfect complementary pair” of FDC and ESD. He noted both approaches will allow cable systems to boost speeds to at least 10/10 Gbps, with faster speeds in the future.

Howald pointed out Comcast is already testing FDX technology in Connecticut and Colorado, working out bugs and unexpected technical challenges.

“We feel like we’ve significantly de-risked some of the technology components of FDX,” Howald said. “We felt really good about what we saw in the field.”

What is Full Duplex DOCSIS? This video from CableLabs explains the technology and how it differs from other DOCSIS cable broadband technology. (1:58)

The Wall Street Journal believes the majority of Americans are paying for internet speed they never use or need, but their investigation largely ignores the question of traffic bottlenecks and data caps that require many customers to upgrade to premium tiers to avoid punitive overlimit fees.

The newspaper’s examination was an attempt to test the marketing messages of large cable and phone companies that claim premium speeds of 250, 500, or 1,000 Mbps will enhance video streaming. A total of 53 journalists across the country performed video streaming tests over a period of months, working with researchers at Princeton University and the University of Chicago to determine how much of their available bandwidth was used while streaming videos from Netflix, Amazon Prime Video, YouTube and other popular streaming services.

Unsurprisingly, the newspaper found most only need a fraction of their available internet speed — often less than 10 Mbps — to watch high quality HD streaming video, even with up to seven video streams running concurrently. That is because video streaming services are designed to produce good results even with lower speed connections. Video resolution and buffering are dynamically adjusted by the streaming video player depending on the quality of one’s internet connection, with good results likely for anyone with a basic broadband connection of 10-25 Mbps. As 4K streams become more common, customers will probably get better performance with faster tiers, assuming the customer has an unshaped connection that does not throttle video streaming speeds as many mobile connections do and the streaming service offers a subscription tier offering 4K video. Netflix, for example, charges more for 4K streams. Some other services do not offer this option at all.

Image: WSJ

WSJ:

For most modern televisions, the highest picture clarity is the “full” high-definition standard, 1080p, followed by the slightly lower HD standard, 720p, then “standard resolution,” 480p. The Journal study found a household’s percentage of 1080p viewing had little to do with the speed it was paying for. In some cases, streaming services intentionally transmit in lower resolution to accommodate a device such as a mobile phone.

When all HD viewing is considered—1080p and 720p—there were some benefits to paying for the very highest broadband tiers, those 250 Mbps and above.

Streaming services compress their streams in smart ways, so they don’t require much bandwidth. We took a closer look at specific services by gathering data on our households’ viewing over a period of months. Unlike the “stress test,” this was regular viewing of shows and movies, one at a time.

Netflix streamed at under 4 Mbps, on average, over the course of a show or movie, with not much difference in the experience of someone who was paying for a 15 Mbps connection and someone with a one gigabit (1,000 Mbps) connection. The findings were similar for the other services.

There is a brief speed spike when a stream begins. Netflix reached the highest max speeds of the services we tested, but even those were a fraction of the available bandwidth.

Users watching YouTube might launch a video slightly faster than those watching Netflix, and at lower resolution, but this is a function of how those services work, not your broadband speed, the researchers said.

Whereas Netflix tries to load “nice high quality video” when you press play and hence has higher spikes, YouTube appears to “want to start as fast as possible,” said Paul Schmitt, one of the researchers.

A spokeswoman for Alphabet Inc.’s YouTube said the service chooses playback quality based on factors including type of device, network speed, user preferences and the resolution of the originally uploaded video. A Netflix Inc. spokeswoman said the company aims to deliver quality video with the least possible bandwidth. Amazon.com Inc. had no comment.

The Journal finds little advantage for consumers subscribing to premium speed tiers, if they did so hoping for improved streaming video. The unanswered question is why customers believe they need faster internet speeds to get those improvements in the first place.

The answer often lies in the quality of the connection between the streaming provider and the customer. There are multiple potential bottlenecks that can make a YouTube video stutter and buffer on even the fastest internet connection. Large providers have had high profile disputes with large streaming companies over interconnection agreements that bring Netflix and YouTube traffic to those internet service providers’ customers. Some ISPs want compensation to handle the increasing amount of incoming video traffic and have intentionally not allowed adequate upgrades to keep up with growing subscriber demand. This creates a traffic bottleneck, usually most noticeable at night, when even a small YouTube video can get stuck buffering. Other streaming videos can suffer from repeated pauses or deteriorate into lower resolution video quality, regardless of the speed of your connection.

Another common bottleneck comes from oversold service providers that have too much traffic and not enough capacity to manage it. DSL and satellite internet customers often complain about dramatic slowdowns in performance during peak usage times in the evenings and on weekends. In many cases, too many customers in a neighborhood are sharing the connection back to the phone company. Satellite customers only have a finite amount of bandwidth to work with and once used, all speeds slow. Some other providers do not pay for a large enough pipeline to the internet backbone, making some traffic slow to a crawl when that connection is full.

Customers are sold on speed upgrades by providers that tell them faster speeds will accommodate more video traffic, which is true but not the whole answer. No amount of speed will overcome intentional traffic shaping, an inadequate connection to the video streaming service, or an oversold network. Too bad the Journal did not investigate these conditions, which are more common than many people think.

Finally, some customers feel compelled to upgrade to premium tiers because their provider enforces data caps, and premium tiers offer larger usage allowances. Cable One, Suddenlink, and Mediacom customers, among others, get a larger usage allowance upgrading. Other providers offer a fixed cap, often 1 TB, which does not go away unless a customer pays an additional monthly fee or bundles video service.

Data caps are a concern for video streaming customers because the amount of data that can be consumed in a month is substantial. As video quality improves, data consumption increases. The Journal article does not address data caps.

Finally, the Journal investigation confined itself to video streaming, but internet users are also increasingly using other high traffic services, especially cloud backup and downloading, especially for extremely large video game updates. The next generation of high bandwidth internet applications will only be developed if high speed internet service is pervasive, so having fast internet speed is not a bad thing. In fact, providers have learned it is relatively cheap to increase customer speeds and use that as a justification to raise broadband prices. Other providers, like Charter Spectrum, have dropped lower speed budget plans to sell customers 100 or 200 Mbps service, with a relatively inexpensive upgrade to 400 Mbps also gaining in popularity.

Does the average consumer need a premium speed tier for their home internet connection? Probably not. But they do need affordable unlimited internet service free of bottlenecks and artificial slowdowns, especially at the prices providers charge these days. That is an investigation the Journal should conduct next.

The average Comcast broadband customer now consumes over 200 GB of online data per month, an increase of 34% over just one year ago, according to Dave Watson, president and CEO of Comcast Cable Communications.

The increased usage accelerated during the last quarter of 2018, Watson told investors on a quarterly conference call.

What remains unchanged is Comcast’s data cap, which remains fixed at 1 TB per month for many customers. To avoid overlimit penalty fees of $10 for each additional 50 GB block of data consumed (up to $200 per month), Comcast is still pitching its unlimited data option — insurance against Comcast’s own overlimit penalties, which costs a growing number of customers an extra $50 a month.

Watson knows data usage over Comcast’s network is about to grow exponentially, mostly thanks to streaming video.

“I think that we start with the central view that streaming is going to happen, video over the internet is more friend than foe. and we wish every bit was our bit,” Watson told investors this morning. “If people consume more bits and video clearly does that, and 4K video does even more than that, that is the sweet spot of where this company is going to grow.”

Translation: We intend to make a killing on usage growth. Comcast can market you a faster internet package at a higher price, or as your usage approaches the data cap, scare you into buying overlimit insurance.

Remember that Comcast drops usage caps for some customers willing to rent their latest network gateway (available only in some areas at this time).