Comcast's new usage gauge is being tested in Oregon

Comcast’s long promised “usage gauge” has arrived.  The company promised to provide one to customers more than a year ago when it imposed a 250GB monthly usage limit on its residential broadband accounts.  Although generous in comparison to some other providers that limit customers to as little as 1-5GB of usage per month, Comcast’s allowance and the meter re-emphasizing it has created controversy among customers concerned about usage caps, potential overlimit fees or speed throttles.

Stop the Cap! reader “bones” sent along word of the measurement tool beta test in the Portland, Oregon area, and reviewing the accompanying data exposes some inconvenient facts such usage limits will have on customers.

Comcast’s version of the ‘gas gauge’ depicts usage on a bar graph and is updated monthly.  Company officials claim the average user consumes just 2-4 gigabytes per month, a debatable figure.  Comcast claims about 1% of their subscribers exceed 250GB of usage per month, but does not indicate whether that number has been on the increase as the company unveils new premium speed, premium priced broadband tiers.

Comcast hired NetForecast to “independently” verify the accuracy of the meter, which they claim produces results within 0.5% accuracy.

The company’s report concludes with praise for Comcast’s new meter, claiming it “will shine a new light on a previously unknown and misunderstood aspect of the digital age. NetForecast believes that this information will allow consumers to become better informed, and better informed consumers will help positively shape the Internet’s future.”

It also increases resentment towards a company that makes them check a meter to be sure they are within their “allowance” for the month, particularly when that company makes loads of money on broadband service.

NetForecast’s tests do reveal several new pieces of information to the “net meter” controversy:

1. The company found up to 1GB of traffic per month represented “background traffic associated with modem management.”  That’s a considerable amount of data counted against a customer’s usage, especially for customers stuck on lower consumption usage plans;
2. The increasing complexity of some web pages and their underlying structure can contribute to additional traffic associated with “protocol overhead”;
3. Poorer line quality can result in increased traffic due to retransmission requests;
4. “Unexpected” traffic is so substantial, it warranted its own section in the NetForecast report:

Traffic can be generated by more than just PCs. Any device that has access to the wireless router is a potential Internet traffic generator—including smart phones, game consoles, digital video recorders, printers, cameras, etc. Many non-PC devices “phone home” to a manufacturer or supporting service. These automated connections are transparent to the user as a convenience so the user is unaware of the traffic generated.

The most likely source of unexpected traffic, however, is from software running on PCs throughout the home. The Windows operating system and most popular software have automated update programs. These updates often download and are installed automatically without the need for user intervention. The automation is generally designed for the convenience and protection of the consumer, but the traffic it generates may come as a surprise.

Each program update download may be modest in size, however, when you multiply a modest download by the number of programs calling for updates and the number of PCs in the house, the traffic attributable to updates can be substantial. Furthermore, in some cases the vendor default update settings are very aggressive, with some default settings checking each hour and downloading every possible option even though they are not all needed. For example, a software program may load its interface in a dozen languages even though all household members only know how to read English.

That’s just the beginning.  The company also documented “surprise usage” from smartphones downloading updates, photo sharing sites, online backup, and other online applications.  Perhaps most important are online video services:

A large volume of traffic may be going to digital video recorders such as TiVo. A user in the home may have rented a movie from Amazon, Netflix. Blockbuster, etc. Renting the movie will be a known traffic-generating event, however, many services also preload the start of other movies as well as trailers to make them instantly available should they be called for. As in other situations described above, traffic is consumed for the consumer’s convenience but without his or her knowledge.

If Comcast’s meter results showing your usage doesn’t make sense and you don’t believe or understand the numbers, wait until you read how it is your responsibility, as a customer, to do all the sleuthing.

NetForecast’s prescription for “rogue traffic” requires the customer to shut off their computers and other connected devices for a “digitally silent” period (overnight or on a weekend when traveling).  Then, the customer gets to follow this routine:

At the end of the digital silence turn on one PC and log back into the Comcast meter portal, or you can check from an Internet cafe or other means while you are away. If true digital silence was achieved, the meter should not have incremented by more than 1GB. If there is more than 1GB use over even several days, then there is certainly some other traffic consumer connected through the router.

If the digital silence experiment worked, then carefully add devices back to the home network while watching the meter. Note that the meter only increments once per hour, so it may take some time to find a rogue traffic source. On the other hand, the home may simply be a highly connected place that is leveraging many aspects of the Internet, and the traffic may be entirely due to legitimate use.

“I guess those of us who are Comcast customers get to add this to our ‘list of things to do’ when we are trying to enjoy our broadband service,” writes Stop the Cap! reader Karen in Portland.  “Can you imagine telling a customer whose wireless wi-fi was ‘borrowed’ by a neighbor that they have to do all this when half the time, those customers don’t even understand how to enable wi-fi security?”

Each and every byte gets counted.  Almost.

Exempt from the usage meter are Comcast’s digital phone service and on-demand video services sent to your television. That’s a nice benefit for Comcast, but not so nice for their competitors, such as voice-over-IP telephone services and the aforementioned Netflix, Amazon, and other on-demand broadband video services. Programming sent to your computer over Comcast’s forthcoming TV Everywhere service does count against your allowance, however.

With a 250GB allowance, it may be some time before most customers find themselves routinely having to limit their usage to avoid exceeding it.  But that assumes Comcast doesn’t follow some other providers into a limbo dance of lowered usage allowances.  With a meter in place, it’s as simple as lowering the cap and telling the customer to check before they use.

What do Comcast customers think?  Comcast’s blog amusingly illustrates some company employees love it, and most consumers hate it:

“Finally! This is great stuff, I cannot wait for this to roll out in our market. We’ve been waiting and customers have been asking for months. Keep up the good work out there, and let’s never stop being innovative. We ROCK!” — Ozzie Navarro, presumably the ‘we’ is this instance refers to an author employed by Comcast.

“How is it great that you’re capping a service I pay monthly for at great expense? Now I can see it in a meter, wow! Upgrade your damn infrastructure to support more bandwidth instead of cutting off customers.” — Jason

“Don’t think you are fooling people by saying, ‘Only x% of people use over 250gb/month, and 1-x% of people won’t have to worry.’ Would you outright deny that you are implementing this feature because you feel your TV industry is threatened by Netflix, Slingbox, Hulu.com, et al.? You say it is to provide all users with a better experience. You say that because some people are “hogging the internet”, grandma can’t look at photos of her grandchildren fast enough. Did it ever occur to you that more people are using more web-intensive programs everyday? It’s not like bandwidth is a finite resource. As much as you guys want to say it is, bandwidth is only limited by ISPs. You love to say that your “networks are overburdened.” Hate to point out the obvious, but you are the ones selling the service so you should plan accordingly for usage. You sell people an advertised rate of 10Mbps, knowing full well that unless everyone else in their neighborhood is offline, there isn’t a snowball’s chance in hell you’ll get these speeds.

Then you have the nerve to say because so many people are “abusing their privilege” you must implement a bandwidth cap to “maintain the integrity of our networks.” I pay $50/month just to access this wonderful series of tubes known as the internet. When I was sold this plan, I was told very specifically that it was UNLIMITED.  That meant, if I maxed out my possible internet consumption everyday — no big deal — that’s what unlimited means. It’s becoming more and more obvious that this whole thing is a money grab, much like overdraft fees from our favorite financial institutions. I love how in the last comment you preach about rolling out your DOCSIS 3.0 system, which will supposedly let people have higher speeds. You don’t plan on upgrading the amount we can use per month though do you? That was suspiciously left absent from your article. Basically you are giving us the power use the internet in more innovative ways, but punishing us for trying to take advantage of your speeds. Thanks for giving me the ability to hit the upper limit more easily and quickly!” — Matt

“So a service whose advertising mentions NOTHING about data caps is actually capped, eh? That’s nice. It’s also really nice that you’re rolling out a faster product, so people can use up their allotted internet EVEN FASTER. Comcast doesn’t want people not paying for their ridiculously overpriced TV service, so they cripple their internet so you don’t have a choice. Really nice.” — Comcast customer

One day before the Federal Communications Commission in Washington announced draft guidelines to establish an American Net Neutrality policy, the Canadian Radio-television Telecommunications Commission (CRTC) announced its own guidelines to govern what Canadian broadband providers can and cannot do with the Internet traffic they deliver to millions of Canadian consumers.  While Bell (Canada), the nation’s largest telecommunications company praised the CRTC for its provider-friendly ruling, consumer groups varied their responses from “a step in the right direction” to “weak” to “here comes more gouging.”

The CRTC Net Neutrality policy for Canada essentially permits providers to continue to throttle broadband speeds for both retail and wholesale customers, and block traffic altogether should the CRTC grant permission in “exceptional cases,” as long as the provider discloses the practice to consumers up front, and warns them in advance of any policy changes that further slow their connections.

Laurel Russworm, who runs Stop Usage Based Billing, was not pleased.

“The CRTC decision doesn’t have a silver lining I can find; in fact they essentially said that usage based billing and caps are good tools to use to fight congestion. All Bell Canada has to do is warn us first, then they can gouge as they please. They’ve deferred making a decision on usage based billing until after the court challenges are dismissed, but I’m not holding my breath,” Russworm wrote.

On Wednesday the CRTC decided that Internet providers in Canada need measures to manage the traffic on their networks at certain times to deal with what providers claim to be a congestion problem.  At hearings held this past summer, several CRTC commissioners were receptive to the claims providers made that Canadian broadband does not have the capacity their American neighbors have.  Providers like Bell and Rogers claim that peer to peer traffic and increasing consumption of high bandwidth services have created capacity shortages on their networks, requiring traffic management which artificially slows certain traffic on their networks at “peak times.”  Canadian broadband providers almost universally also impose Internet Overcharging schemes on their customers, limiting customer use and charging them overlimit penalties for exceeding usage allowances.

The commission accepted the providers’ claims and gave the green light to those practices, but said before a provider literally blocks access to online services, or throttles time sensitive traffic on services like Voice Over IP telephone or two-way video conferencing to the point it becomes “degraded,” it needs to get Commission permission first.

Mirko Bibic, Bell Canada’s senior vice-president of regulatory and government affairs, told The Globe and Mail the ruling gives carriers the right to run their businesses the way they see fit. “We’re the experts, and we get the flexibility to determine how to manage our networks to give the user the best experience,” he said.

Bell already “throttles” its Internet service by slowing peer-to-peer downloading between 4:30 p.m. and 1 a.m. to make sure the network is not overloaded by a relatively small number of people transferring large video and music files.

Independent Internet providers are among the biggest proponents of Net Neutrality, and a ban on Internet Overcharging schemes known in Canada as “usage based billing.”  Many Canadian broadband providers obtain connectivity through wholesale accounts purchased from Bell.  The Canadian phone giant imposed both speed throttles and usage based billing on their wholesale customers.  Those costs, and the speed bumps that go with them, are now increasingly passed on to consumers.  Independent providers fear being put out of business.

For many of them, Wednesday’s decision might as well never have happened.

“This has really not changed anything,” Tom Copeland, chair of the Canadian Association of Internet Providers, told PC World.

Copeland said the “biggest, most glaring omission” from the ruling is the lack of restraints on the time of day or how long suppliers like phone or cable companies can manipulate traffic. “So we could continue to see traffic management every day of the year,” he said.

“We’re still not addressing the cause of the problem,” he added: “Either weak points in the network, or abuse by users.” Most casual users of peer-to-peer applications — the biggest offending programs in the eyes of providers – aren’t the problem, he said.

“We just went backwards at warp speed,” lamented John Lawford, counsel for a coalition of consumer groups that fought for an end to throttling of Internet traffic of consumers, “ while we watch the U.S. rocket ahead.”

“The CRTC has said in this decision that ISPs own your content and own your Internet connection” said Lawford, “You just got owned.”

The Public Interest Advocacy Centre represented the Consumers’ Association of Canada, Canada Without Poverty and Option consommateurs during the hearings on Net Neutrality.  PIAC argued that the Telecommunications Act required ISPs not to interfere with customers’ Internet traffic unless such traffic was clearly harming other users of the network and not otherwise.  “ISPs should act as common carriers and just carry traffic, not as broadcasters deciding what you watch” continued Lawford, “but now they can decide what gets through – and how much they get to charge you for the privilege.”  Lawford also noted the CRTC’s requirement for the ISPs to disclose their “Internet traffic management practices” will not actually stop any of the practices.

The CRTC has repeatedly taken broadband industry-friendly positions in direct opposition to Canadian consumer interests, helping to set the stage for Canada’s rapid decline in broadband leadership.  The country’s standing in broadband rankings has taken a stunning fall from its earlier top-shelf position.  Regulatory policies that permit abusive, anti-competitive practices and reward providers for rationing broadband instead of investing in expanding it are at the heart of the problem.

Since the CRTC has taken positions more worthy of a industry trade group than an independent regulator, an increasing number of Canadians are demanding the CRTC lead or get out of the way.  A large group of Canadian voters upset about any issue is sure to attract politicians, and the New Democratic Party of Canada (NDP) has arrived.

Charlie Angus (NDP)

Charlie Angus, New Democrat Digital Affairs Critic and MP for Timmins-James Bay, who already is on record opposing Internet Overcharging schemes, says the CRTC dropped the ball on Net Neutrality.

“Yesterday’s CRTC decision on Internet traffic-management practices is a blow to the future of digital innovation in Canada,” Angus said in a statement.

“This interference [from traffic management] will be bad news for small third-party competitors and leaves consumers subject to digital snooping and interference from cable giants,” he added.

“Basically the CRTC has left the wolves in charge of the henhouse. ISP giants have been given the green light to shape traffic on the internet in favor of their corporate interests,” he said. “This decision is a huge blow to the future competitiveness of the Internet.”

Angus says that the premise of today’s decision – that notification from the ISP will allow customers to make an informed decision on where to buy Internet service – misses the harsh reality that the market for Internet service in Canada is not nearly competitive enough to work.

“Canada has fallen to the back of the pack in Internet service provision and pricing after leading the way for years. This is the direct result of a small band of ISP giants blocking out competition,” Angus said. “This decision clears the way for ISPs to squeeze out third-party players who are attempting to provide better price and service options.”

South of the border, the FCC has taken clear steps toward the establishment of Internet neutrality on U.S. networks.

Angus said that principle of Net Neutrality should be at the center of Internet policy in Canada, and that the CRTC has missed a golden opportunity with yesterday’s decision.

“The principle of Net Neutrality must be a cornerstone of the innovation agenda. The CRTC has once again acted as the rubber stamp for large ISP and cable players to dominate the market and decide which traffic goes in the fast lane and which traffic gets stuck in the slow lane. This decision continues a long and dismal tradition of Canada’s communication policy decisions chipping away at the public interest to the benefit of a few corporate giants.”

Dissolve the CRTC, a group collecting signatures to petition for the closure of the Commission, also made several comments about the CRTC decision.

Among their conclusions:

• The new policy leaves the door open to providers deciding their economic interests are better served from traffic management practices like throttles and usage limits than network investments.  Short term limits may serve the interests of stockholders, but could discourage long term investments needed to create new 21st century broadband platforms;
• The Commission’s encouragement that providers make additional investments in their networks is likely to fall on deaf ears.  It was Bell’s lack of investment in their broadband network which led to the traffic management practices, and the recent hearings about them, in the first place.  Without mandates, there is no real pressure on Bell to change their investment strategy.
• The Commission’s policy to regulate this issue through a user complaint process that calls out bad actors has no historical precedent of working.  The CRTC has a long history of ignoring public involvement in telecommunications proceedings, and does not like to involve themselves with individual customer complaints.  Campaigns to flood the CRTC with complaints on specific issues using their language may be the only way to get them to investigate.  Additionally, complaints that call out the disparity in network management policies between wholesale and retail accounts may only lead to additional restrictions on both types of accounts, making a bad situation even worse.

Canadians must contact their elected officials and demand federal legislation to enact true consumer protection and broadband reform policies to restore Canada to a position of leadership in broadband.  The CRTC is ineffective and must not be the final arbiter on these important issues.

Phillip Dampier

The Wall Street Journal today published an article reviewing the landscape of flat rate broadband service and how some Internet providers want to change it.

The article quotes me on the issue of Internet Overcharging becoming a political football in the Net Neutrality debate.

“This could come down to carriers saying, ‘If you don’t allow us to manage our networks the way we see fit, then we will just have to cap everything,’ ” says Phillip Dampier, a consumer advocate focusing on technology issues in Rochester, N.Y. “They’ll make it an either/or thing: give them more control over their network or expect metered broadband.”

Mr. Dampier was among those who forced Time Warner Cable to shelve a metered Internet pilot program in several cities last year. The company, which had argued the plan would be a fairer way to charge for access, acknowledged it was a “debacle.” It won’t say if it plans to revive the trials.

Unfortunately, the article never bothers to mention Stop the Cap!, the website dedicated to fighting these overcharging schemes.

AT&T weighs in on their experiment to overcharge consumers in Beaumont, Texas and Reno, Nevada, and analysts think Net Neutrality arguments may give providers an excuse to expand those experiments, launch price increases and blame it on Net Neutrality policies:

“Some type of usage-based model, for those customers who have abnormally high usage patterns, seems inevitable,” an AT&T spokesman says. AT&T declined to provide more details on its trials.

“Unquestionably, the carriers erred in their initial selling of broadband with a flat rate,” says Elroy Jopling, research director of Gartner Inc. “They assumed no one would use it as much as they do now, but then along came high-definition movies. They’re now trying to get around that mistake.”

Network neutrality deals primarily with ensuring that Internet providers don’t favor any online traffic over any other. Still, Mr. Jopling and other analysts argue, the net neutrality debate might provide the carriers with an opening to argue for changing that pricing.

“With network neutrality enforced, the only other option for carriers is to charge by the byte or to raise the flat-rate pricing,” says Johna Till Johnson, president of Nemertes Research. “Right now they’re just deciding which one to do. Just be prepared to pay more.”

It's "Rep. Eric Massa," Not 'Joe Messa'

The article has several flaws.

• It mis-identifies Rep. Eric Massa (D-New York) as “Rep. Joe Messa.”  Rep. Massa introduced legislation to ban Internet Overcharging when companies cannot produce actual evidence to justify it, particularly in the limited competitive marketplace for broadband in the United States.
• The article fails to mention the usage limits proposed by smaller broadband providers, including Frontier’s infamous 5GB usage definition in their Acceptable Use Policy.  This is a very important fact to consider when the article quotes Professor Andrew Odlyzko, an independent authority on broadband usage, as stating the average broadband consumer uses triple that amount (15 gigabytes per month).
• The quotation about the number of e-mails or web page views available under plan allowances that routinely appear in such articles ignores the increasing use of higher bandwidth applications like online video.  Telling a consumer they can send 75 million e-mails is irrelevant information because no consumer would ever need to worry about usage limits if they only used their account for web page browsing and e-mail usage.  They very much do have to be concerned if they use their service to watch online video from Hulu or Netflix, or use one of the online backup services.
• The article makes no mention of publicly available financial reports from broadband providers like Time Warner Cable that prove that at the same time their profits on broadband service are increasing, the company’s costs to provide the service continue to decline, along with the dollar amounts they spend to maintain and expand that network to meet demand.  Providing readers with insight into the true financial picture of a broadband provider, instead of simply quoting the public relations line of the day would seem particularly appropriate for The Wall Street Journal.
• The article doesn’t make mention that the same providers arguing increased Internet traffic is creating a problem for them are also working to launch an online video distribution platform that will rival Hulu in size and scope.  TV Everywhere will consume an enormous amount of the broadband network they claim can’t handle today’s traffic without Internet Overcharging schemes being thrown on customers.  Of course, such usage limits are very convenient for companies like Comcast, Time Warner Cable and AT&T, which are now in the business of selling pay television programming to consumers.  Should a consumer choose to watch all of their television online instead of paying for a cable package, a usage allowance will help put a stop to that very quickly, as will planned restrictions that only provide online video to “authenticated” existing pay television subscribers.

One thing remains certain – providers are still itching to overcharge you for your broadband service.  Consumers and the public interest groups that want to represent them must stand unified in opposition to Internet Overcharging schemes and for Net Neutrality protection, and never accept sacrificing one for the other.

Vint Cerf, “Chief Internet Evangelist” for Google’s Public Policy Blog, raised objections and concerns about the broadband industry’s efforts to impose “consumption-based billing” on customers.

Cerf noted plans by several cable operators to test usage caps in an effort to manage their Internet traffic.

“At least one proposal  has surfaced that would charge users by the byte after a certain amount of data has been transmitted during a given period, […] a kind of volume cap, which I do not  find to be a very useful practice,  ” said Cerf.

“Given an arbitrary amount of time, one can transfer arbitrarily large amounts of information,” he said.

Excerpt: “Network management also should be narrowly tailored, with bandwidth constraints aimed essentially at times of actual congestion. In the middle of the night, available capacity may be entirely sufficient, and thus moderating users’ traffic may be unnecessary. Some have suggested metered pricing — charging by the megabyte rather than flat fee plans — as a solution to congestion, and prices could be adjusted at non-peak periods. These kinds of pricing plans, depending on how they are devised or implemented, could end up creating the wrong incentives for consumers to scale back their use of Internet applications over broadband networks.”

To date, the two largest cable broadband providers, Comcast & Time-Warner are already considering moving to a consumption-based billing system, but with no decrease in existing rates.   Instead, customers exceeding those usage caps will find overage charges on their monthly bills.

Several DSL providers, most notably Frontier Communications, have already imposed even more draconian usage caps on their customers; Frontier now limits DSL customers to just 5GB of traffic per month.