I see a number of stories from consumers upset about poor service from their cable or telephone provider, but Joanne Hanson from Indio, California has a keeper:

After waiting for the Time Warner Cable people, who were two hours late, the installer disappeared when he told me he needed to go to the truck.

After speaking with the supervisor about the installer disappearing, he told me that the guy had left because of the poor air quality in my home. It made him feel unsafe, so he left, unannounced.

Then they told me that they couldn’t reschedule until next week because they are overbooked.

Phillip "No, I won't take your word for it" Dampier

Did you realize if you are pro-Net Neutrality, you’re probably pro-piracy and a broadband hog?  That’s the new low achieved this past week by Net Neutrality opponents who are spending millions trying to protect their broadband fiefdoms from any regulation.  But even if they lose their fight to stop Net Neutrality when they find consumers won’t accept a throttled “network managed” broadband future, providers will be “forced” to control those dirty pirates and broadband hogs with usage limits and overlimit fees to help “pay for network expansion.”

It’s why Net Neutrality and Internet Overcharging schemes like usage caps and “consumption billing” go hand in hand.  What providers can’t profit from on one end they’ll try from another.

Longtime readers of Stop the Cap! already know how this scam works.  Canadian broadband users got stuck with both: speed throttles -and- usage caps and overlimit fees.  Assuming purposely throttled speeds are banned by Net Neutrality policies, simply under-investing in network expansion, despite the rampant profit-earning capacity broadband delivers, gets us to the same place — throttled speeds from overcongested networks and a convenient excuse to impose usage limits and other control measures to more “fairly” provide service to every customer.  Best of all, providers can pocket the overlimit fees charged to customers who exceed their allowance and train them to use less broadband with fears of more stinging penalty fees on their next bill.

Back in 2008, when Stop the Cap! launched, we challenged providers to provide the raw data to prove their assertions that they needed to impose formal limits and so-called “consumption-based billing” and abandon the lucrative flat rate pricing model that earns them billions in profits every year.  Of course, they have always refused, citing “competitive reasons,” “customer privacy,” or some combination of laws that supposedly prohibits any third party analysis.  Of course, they’re only too happy to characterize usage themselves, and we’re supposed to trust them — the same people that want to use that data to justify Internet Overcharging schemes.  Independent analysis?  When broadband pigs fly!

Now, telecom analyst Benoit Felten from the Yankee Group is asking the same questions on his Fiberevolution blog and issuing a challenge:

So here’s a challenge for them: in the next few days, I will specify on this blog a standard dataset that would enable me to do an in-depth data analysis into network usage by individual users. Any telco willing to actually understand what’s happening there and to answer the question on the existence of hogs once and for all can extract that data and send it over to me, I will analyse it for free, on my spare time. All I ask is that they let me publish the results of said research (even though their names need not be mentioned if they don’t wish it to be). Of course, if I find myself to be wrong and if indeed I manage to identify users that systematically degrade the experience for other users, I will say so publicly. If, as I suspect, there are no such users, I will also say so publicly. The data will back either of these assertions.

Felton’s co-author Herman offers his assessment:

Unfortunately, to the best of our knowledge, the way that telcos identify the Bandwidth Hogs is not by monitoring if they cause unfair traffic congestion for other users. No, they just measure the total data downloaded per user, list the top 5% and call them hogs.

For those service providers with data caps, these are usually set around 50 Gbyte and go up to 150 Gbyte a month. This is therefore a good indication of the level of bandwidth at which you start being considered a “hog”.  But wait: 50 Gbyte a month is… 150 kbps average (0,15 Mbps), 150 Gbyte a month is 450 kbps on average. If you have a 10 Mbps link, that’s only 1,5 % or 4,5 % of its maximum advertised speed!

And that would be “hogging”?

The fact is that what most telcos call hogs are simply people who overall and on average download more than others. Blaming them for network congestion is actually an admission that telcos are uncomfortable with the ‘all you can eat’ broadband schemes that they themselves introduced on the market to get people to subscribe. In other words, the marketing push to get people to subscribe to broadband worked, but now the telcos see a missed opportunity at price discrimination…

TCP/IP is by definition an egalitarian protocol. Implemented well, it should result in an equal distribution of available bandwidth in the operator’s network between end-users; so the concept of a bandwidth hog is by definition an impossibility. An end-user can download all his access line will sustain when the network is comparatively empty, but as soon as it fills up from other users’ traffic, his own download (or upload) rate will diminish until it’s no bigger than what anyone else gets.

Rep. Eric Massa (D-NY) has a better idea to stop Internet Overcharging: the Broadband Internet Fairness Act (HR 2902), which would ban unjustified billing schemes for broadband

The arbitrary nature of what constitutes a “hog” invalidates providers’ arguments at the outset.  Frontier defines a hog as someone who consumes more than 5GB.  Comcast sets their definition of a broadband piggy at 250GB.  The gap between the two is wide enough to allow a small planet to slip through unencumbered.

If a consumer does all of their downloading from midnight to six the following morning, are they as much of a hog on a shared cable modem network as the user watching Hulu during prime broadband usage time?  Probably not.  If a cable provider tries to force too many homes to share the same finite amount of bandwidth available in a designated area, service will slow for everyone during peak usage times.  But nobody will notice or care if customers are maxing out their connection in the middle of the night.  The appropriate answer, especially for an industry that enjoys enormous profits, is to expand their network to maintain basic quality of service at peak times.  DOCSIS 3 upgrades for cable are cost efficient, flexible and often profitable, because providers can market new, premium-priced speed tiers to those who want cutting edge service.

Instead, some providers see delaying upgrades as a better answer, enjoying the cost savings that follow implementation of usage caps, limits and other overcharging schemes which artificially limit demand and further monetize their broadband service offerings.

Unfortunately, even if Felten got responses from providers, he’ll be forced to trust the integrity of data he didn’t collect himself.  Rep. Eric Massa has a better idea.  His proposed Broadband Internet Fairness Act would ban such overcharging schemes unless providers could prove to the satisfaction of a federal agency that such pricing was warranted.  The big difference is that providing “massaged” data to Mr. Felton might be naughty, but would be downright criminal if tried with the federal government.

Shouldn’t the central lesson here be to “trust but verify?”

Frontier's latest promotion promotes one price, but you'll pay considerably more thanks to profit-padding fees, surcharges, and taxes.

Frontier Communications is mass-mailing its latest DSL promotion to customers — a year of their fastest tier DSL service for just $20.10 per month.

Labeled “FrontierFast,” the promotion claims you will get a “groundbreaking value” on their fastest Internet service for $20.10 per month, with a Price Protection Plan and a $4.50 monthly modem fee.  Frontier says you will enjoy:

• Breakthrough speeds at an unbeatable price
• Dedicated, unshared connection that won’t bog down during peak hours
• Safe, secure Frontier Mail and a personal online portal powered by Yahoo!
• Free professional installation
• A three month free-trial of Peace of Mind Hard Drive Backup and unlimited technical support.

Sounds reasonable… until you explore the terms and conditions that are attached to it.  Frontier has created a minefield of tricks and traps designed to maximize their profits and make you jump through hoops to minimize your exposure to them.

Let’s explore:

1. The $4.50 monthly modem fee makes it $24.60 for 2010.  The modem fee is nothing more than profit-padding.
2. That “Price Protection Plan” is really a nice way of saying “contract term” committing you to sticking with Frontier broadband for one year, or face a $200 early cancellation penalty.
3. That “Peace of Mind” trial is anything but if you forget to cancel before the three free months are up.  If you don’t they’ll charge you an extra $9.99 a month for the service.  Forgot to cancel during the trial?  Then pony up a $50 cancellation fee if you want out.  At least the free trial is optional.  Do yourself a favor and opt out before Frontier opts-in your wallet.
4. The promotion is available to new customers only, and you are required to bundle it with phone service -and- pay installation fees for that phone line, if you don’t have one already.
5. Service is subject to availability, speeds are not guaranteed, and your credit will be checked before you get service.
6. Taxes and surcharges apply, and they do add up fast.  You can easily add an additional $10 when combining the modem rental fee with the other fees Frontier collects for various taxing authorities.
7. Don’t forget Frontier defines an appropriate amount of usage at just 5GB per month in their Acceptable Use Policy.

Broadband service shouldn’t have to come with a minefield of fine print and profit-padding fees and surcharges.  The out-the-door price should be published so customers can truly understand what they are getting into, before exposing themselves to those steep cancellation fees.  They should also not have to worry about a ridiculous 5GB limit in Frontier’s Acceptable Use Policy.

Master conspiracy theorist Glenn Beck should have written the last episode of The X Files.  To think I waited nine seasons to find what truth was out there only to have screenwriter Chris Carter rip me off with a chain smoker sitting in a Native American pueblo hearing the date when “they” arrive to begin colonization.  Imagine what Glenn Beck could have conjured up given the same nine years.

The problem with wildly-spun conspiracy theories is that you usually end up tangled in one, and Beck proved when he managed to tie his boss, Rupert Murdoch, into both a ‘Maoist -and- Marxist plot.’

To Beck, Net Neutrality and its supporters come straight out of Marxism. Beck warns “if you sit down and work with these people (Net Neutrality proponent Free Press), you might as well just go out and purchase your own blindfold and cigarette for the firing squad, because I don’t see the difference here.”

Beck slammed a Federal Trade Commission workshop he tied to Free Press, a pro-consumer advocacy group Beck considers Maoist (I didn’t realize they had the power to run government agency workshops — oh wait, they don’t), accusing the whole affair of being a conspiracy to silence free speech.

But here comes the “oops.”  It turns out this very same workshop which ran Tuesday, “From Town Criers to Bloggers: How Will Journalism Survive the Internet Age,” had among its participants none other than News Corporation CEO Rupert Murdoch, who was one of the featured speakers.

Just a few weeks earlier, Beck’s attempt to slam Fox News enemy MSNBC (and its owner NBC) brought a broad indictment against too-similar-sounding messages promoting volunteerism from President Obama and the Entertainment Industry Foundation (EIF), which Beck likened to “living in Mao’s China right now,” noting NBC executive Mitch Metcalf is an “EIF board member.”

How inconvenient for Glenn that Murdoch sits on EIF’s honorary board of governors, and Fox Broadcasting is a participant in the group’s initiatives.

Meanwhile, over on RedState, the blog that bans you for fact-checking their nonsense, writer Neil Stevens just discovered the Obama Administration is working on a National Broadband Plan.  That is like missing a train… that left the platform January 20th, 2009:

Comcast's new usage gauge is being tested in Oregon

Comcast’s long promised “usage gauge” has arrived.  The company promised to provide one to customers more than a year ago when it imposed a 250GB monthly usage limit on its residential broadband accounts.  Although generous in comparison to some other providers that limit customers to as little as 1-5GB of usage per month, Comcast’s allowance and the meter re-emphasizing it has created controversy among customers concerned about usage caps, potential overlimit fees or speed throttles.

Stop the Cap! reader “bones” sent along word of the measurement tool beta test in the Portland, Oregon area, and reviewing the accompanying data exposes some inconvenient facts such usage limits will have on customers.

Comcast’s version of the ‘gas gauge’ depicts usage on a bar graph and is updated monthly.  Company officials claim the average user consumes just 2-4 gigabytes per month, a debatable figure.  Comcast claims about 1% of their subscribers exceed 250GB of usage per month, but does not indicate whether that number has been on the increase as the company unveils new premium speed, premium priced broadband tiers.

Comcast hired NetForecast to “independently” verify the accuracy of the meter, which they claim produces results within 0.5% accuracy.

The company’s report concludes with praise for Comcast’s new meter, claiming it “will shine a new light on a previously unknown and misunderstood aspect of the digital age. NetForecast believes that this information will allow consumers to become better informed, and better informed consumers will help positively shape the Internet’s future.”

It also increases resentment towards a company that makes them check a meter to be sure they are within their “allowance” for the month, particularly when that company makes loads of money on broadband service.

NetForecast’s tests do reveal several new pieces of information to the “net meter” controversy:

1. The company found up to 1GB of traffic per month represented “background traffic associated with modem management.”  That’s a considerable amount of data counted against a customer’s usage, especially for customers stuck on lower consumption usage plans;
2. The increasing complexity of some web pages and their underlying structure can contribute to additional traffic associated with “protocol overhead”;
3. Poorer line quality can result in increased traffic due to retransmission requests;
4. “Unexpected” traffic is so substantial, it warranted its own section in the NetForecast report:

Traffic can be generated by more than just PCs. Any device that has access to the wireless router is a potential Internet traffic generator—including smart phones, game consoles, digital video recorders, printers, cameras, etc. Many non-PC devices “phone home” to a manufacturer or supporting service. These automated connections are transparent to the user as a convenience so the user is unaware of the traffic generated.

The most likely source of unexpected traffic, however, is from software running on PCs throughout the home. The Windows operating system and most popular software have automated update programs. These updates often download and are installed automatically without the need for user intervention. The automation is generally designed for the convenience and protection of the consumer, but the traffic it generates may come as a surprise.

Each program update download may be modest in size, however, when you multiply a modest download by the number of programs calling for updates and the number of PCs in the house, the traffic attributable to updates can be substantial. Furthermore, in some cases the vendor default update settings are very aggressive, with some default settings checking each hour and downloading every possible option even though they are not all needed. For example, a software program may load its interface in a dozen languages even though all household members only know how to read English.

That’s just the beginning.  The company also documented “surprise usage” from smartphones downloading updates, photo sharing sites, online backup, and other online applications.  Perhaps most important are online video services:

A large volume of traffic may be going to digital video recorders such as TiVo. A user in the home may have rented a movie from Amazon, Netflix. Blockbuster, etc. Renting the movie will be a known traffic-generating event, however, many services also preload the start of other movies as well as trailers to make them instantly available should they be called for. As in other situations described above, traffic is consumed for the consumer’s convenience but without his or her knowledge.

If Comcast’s meter results showing your usage doesn’t make sense and you don’t believe or understand the numbers, wait until you read how it is your responsibility, as a customer, to do all the sleuthing.

NetForecast’s prescription for “rogue traffic” requires the customer to shut off their computers and other connected devices for a “digitally silent” period (overnight or on a weekend when traveling).  Then, the customer gets to follow this routine:

At the end of the digital silence turn on one PC and log back into the Comcast meter portal, or you can check from an Internet cafe or other means while you are away. If true digital silence was achieved, the meter should not have incremented by more than 1GB. If there is more than 1GB use over even several days, then there is certainly some other traffic consumer connected through the router.

If the digital silence experiment worked, then carefully add devices back to the home network while watching the meter. Note that the meter only increments once per hour, so it may take some time to find a rogue traffic source. On the other hand, the home may simply be a highly connected place that is leveraging many aspects of the Internet, and the traffic may be entirely due to legitimate use.

“I guess those of us who are Comcast customers get to add this to our ‘list of things to do’ when we are trying to enjoy our broadband service,” writes Stop the Cap! reader Karen in Portland.  “Can you imagine telling a customer whose wireless wi-fi was ‘borrowed’ by a neighbor that they have to do all this when half the time, those customers don’t even understand how to enable wi-fi security?”

Each and every byte gets counted.  Almost.

Exempt from the usage meter are Comcast’s digital phone service and on-demand video services sent to your television. That’s a nice benefit for Comcast, but not so nice for their competitors, such as voice-over-IP telephone services and the aforementioned Netflix, Amazon, and other on-demand broadband video services. Programming sent to your computer over Comcast’s forthcoming TV Everywhere service does count against your allowance, however.

With a 250GB allowance, it may be some time before most customers find themselves routinely having to limit their usage to avoid exceeding it.  But that assumes Comcast doesn’t follow some other providers into a limbo dance of lowered usage allowances.  With a meter in place, it’s as simple as lowering the cap and telling the customer to check before they use.

What do Comcast customers think?  Comcast’s blog amusingly illustrates some company employees love it, and most consumers hate it:

“Finally! This is great stuff, I cannot wait for this to roll out in our market. We’ve been waiting and customers have been asking for months. Keep up the good work out there, and let’s never stop being innovative. We ROCK!” — Ozzie Navarro, presumably the ‘we’ is this instance refers to an author employed by Comcast.

“How is it great that you’re capping a service I pay monthly for at great expense? Now I can see it in a meter, wow! Upgrade your damn infrastructure to support more bandwidth instead of cutting off customers.” — Jason

“Don’t think you are fooling people by saying, ‘Only x% of people use over 250gb/month, and 1-x% of people won’t have to worry.’ Would you outright deny that you are implementing this feature because you feel your TV industry is threatened by Netflix, Slingbox, Hulu.com, et al.? You say it is to provide all users with a better experience. You say that because some people are “hogging the internet”, grandma can’t look at photos of her grandchildren fast enough. Did it ever occur to you that more people are using more web-intensive programs everyday? It’s not like bandwidth is a finite resource. As much as you guys want to say it is, bandwidth is only limited by ISPs. You love to say that your “networks are overburdened.” Hate to point out the obvious, but you are the ones selling the service so you should plan accordingly for usage. You sell people an advertised rate of 10Mbps, knowing full well that unless everyone else in their neighborhood is offline, there isn’t a snowball’s chance in hell you’ll get these speeds.

Then you have the nerve to say because so many people are “abusing their privilege” you must implement a bandwidth cap to “maintain the integrity of our networks.” I pay $50/month just to access this wonderful series of tubes known as the internet. When I was sold this plan, I was told very specifically that it was UNLIMITED.  That meant, if I maxed out my possible internet consumption everyday — no big deal — that’s what unlimited means. It’s becoming more and more obvious that this whole thing is a money grab, much like overdraft fees from our favorite financial institutions. I love how in the last comment you preach about rolling out your DOCSIS 3.0 system, which will supposedly let people have higher speeds. You don’t plan on upgrading the amount we can use per month though do you? That was suspiciously left absent from your article. Basically you are giving us the power use the internet in more innovative ways, but punishing us for trying to take advantage of your speeds. Thanks for giving me the ability to hit the upper limit more easily and quickly!” — Matt

“So a service whose advertising mentions NOTHING about data caps is actually capped, eh? That’s nice. It’s also really nice that you’re rolling out a faster product, so people can use up their allotted internet EVEN FASTER. Comcast doesn’t want people not paying for their ridiculously overpriced TV service, so they cripple their internet so you don’t have a choice. Really nice.” — Comcast customer