One of the principal components of Internet Overcharging is the so-called “usage meter,” a measurement tool designed to help customers keep track of their usage so they don’t exceed arbitrary usage allowances and face overlimit penalties or speed throttles.

But with no government agency or independent watchdog monitoring the accuracy of the meter, providers can claim any amount of usage they wish, and stick customers with the bill.

Telecom New Zealand is the latest ISP forced to admit its usage meter was wildly inaccurate, with nearly 100,000 accounts impacted by faulty meter measurements between November 2010 and June 2011.  At least 47,000 faced punitive measures including substantial overlimit fees or throttled speeds for exceeding usage limits, even though they actually didn’t.  Now Telecom has admitted the meter was wrong, it violated the Fair Trading Act in the process, and is refunding $2.7NZ million dollars in overcharges. It was either that or face substantial fines from the Commerce Commission.

Telecom called the error that forced some customers into more expensive plans to avoid additional overlimit fees “an incorrect perception about […] data usage.”

“We’re pleased to have reached a settlement with Telecom and that they have made prompt refunds directly back to the customers who have lost out,” said Stuart Wallace, Commerce Commission Competition Manager. “Telecom brought this issue to our attention as soon as they were made aware by their customers and have co-operated fully with the Commission. Due to Telecom’s immediate admission of a breach of the Fair Trading Act, followed by appropriate compensation to customers, the settlement is the best possible outcome for those customers and avoids potentially lengthy and costly court hearings paid for by taxpayers.”

It’s the second usage measurement failure announced by the company this month.  In a separate move, Telecom agreed to pay $31.6 million to five of its competitors overcharged for wholesale broadband service.

When technically-savvy customers realize they are being billed for non-existent usage and the media takes an interest, providers eventually disclose their mistaken measurement tools.

“Customers are expected to keep these ISP’s honest,” says Stuart Littlejohn, a Stop the Cap! reader in Wellington. “ISP’s never suggest their meters are anything except accurate until they are caught with their fingers on the scale, and always in their favor.”

Littlejohn has already received a refund from Telecom for illegitimate overcharges he incurred earlier this year.

“It was an absolute nightmare,” he shares. “We thought someone hacked our wireless network or someone in the home was lying about their usage, all theories encouraged by Telecom employees who pointed the finger at everyone but themselves.”

Littlejohn says after Telecom granted one credit as a “goodwill gesture,” subsequent overcharges that went unexplained were his problem, not theirs.

“After the first credit, everything else is your fault,” he says.

Littlejohn caught the company red-handed when storm damage disrupted his service for nearly a week, and Telecom’s usage meter recorded 22GB of usage on his down-and-out service anyway.

“They ultimately couldn’t argue with themselves, but they tried at first,” he says. “Then I told them to call the department responsible for repairing my service and they quickly learned the line they said used 22GB was out of service at the time the usage was supposed to occur.”

“Without that, they would have probably insisted I still owed them for that ‘usage.'”

Littlejohn wasn’t alone.  Other overbilled customers appealed their case to the New Zealand Herald last June, and two weeks later, Telecom admitted their usage measurement tool was faulty.  But by then, customers were already paying for the erroneous charges:

The Herald has received detailed internet usage logs from two Telecom customers – one in Dunedin and the other in New Plymouth – which show over-counting broadband downloads, in one period by as much as 139 per cent. Both have raised the matter repeatedly with Telecom, but have yet to get an explanation.

“We showed Telecom five days of data as early as February 14,” says director Mark Peisker of Dunedin’s CueClub. “There was massive variance between our data and that reported by the Telecom usage meter. I said to them: ‘Your counting has very little to do with what comes down my line to me’.”

CueClub’s data taken from its two internet routers shows an average of 62 per cent over-counting during a three month period – the worst month being May when Telecom counted an extra 118.24 gigabytes (GB) of usage amounting to $203.97 in overcharging.

“They’re crooks, plain and simple, and only when they were caught did they admit their mistakes, and the only ‘penalty’ they are paying is refunding their ill-gotten gains,” Littlejohn says. “Where is the substantial fine to send a message stealing from your customers is wrong?  A strong fine would tell Telecom they made a costly mistake not worth repeating.”

After nearly a half-million Canadians expressed outrage about Bell’s Internet Overcharging practices, the company is responding.  This week, Bell sent a letter to their wholesale customers announcing it plans to end the practice of speed throttling peer-to-peer file traffic (at least for them):

Effective November 2011, new links implemented by Bell to augment our DSL network may not be subject to Technical Internet Traffic Management Practices (ITMP).  ITMPs were introduced in March, 2008 to address congestion on the network due to the increased use of Peer-to-Peer file sharing applications during peak periods. While congestion still exists, the impact of Peer-to-Peer file sharing applications on congestion has reduced. Furthermore, as we continue to groom and build out our network, customers may be migrated to network facilities where Technical Internet Traffic Management Practices (ITMPs) will not be applied.

Peer-to-peer traffic, once all the rage for swapping music, movies, and software (legally or otherwise), has been declining as a percentage of Internet traffic and legal online entertainment services (Netflix, et al.) have become available.  Copyright crackdowns and usage caps manage to further restrict customers from leaving P2P software running continuously as it can rapidly eat into usage allowances.

With increased capacity of Bell’s networks and decreased interest in file swapping software among customers, the practice of throttling such traffic (along with the unintended collateral damage to online gaming), means such network management practices have outlived their usefulness.

Providers these days are far more likely to blame online video for congested networks.  But once providers attach a speed throttle to an application, it can be difficult to remove.  Even as Bell announced it would no longer throttle their wholesale clients, retail customers will still suffer with reduced speeds during “peak usage times” — 4:30pm-2am local time.

Michael Geist, who covers Canadian broadband issues, wonders if Bell’s throttles are actually in violation of the Canadian Radio-television and Telecommunications Commission’s traffic management guidelines:

While Bell says its congestion has been reduced, its retail throttling practices have remained unchanged, throttling P2P applications from 4:30 pm to 2:00 am.  Given the decline in congestion, a CRTC complaint might ask whether the current throttling policy “results in discrimination or preference as little as reasonably possible” and ask for explanation why its data cap policies “would not reasonably address the need and effectively achieve the same purpose as the ITMP.”  In fact, the same can now be said for many other ISPs who deploy broad based throttling practices (Rogers, Cogeco), which may not be reasonable under the CRTC policy.

A Verizon Wireless 4G/LTE customer that managed to consume nearly 56GB of data over a two-week period has found he has temporarily lost his 4G privileges during peak usage times on Verizon’s network.

Droid Life reports Verizon’s speed throttle apparently also works on the company’s much-faster 4G network, because the customer found his 4G speeds reduced to dial-up during peak usage periods.  The throttle reduces speeds so much, even browsing web pages becomes a painful experience.  Remarkably, the customer tells Droid Life he still has regular speed access to Verizon’s more congested 3G network, which he now uses when his 4G speeds are reduced.

Verizon Wireless specifically exempts 4G customers from wholesale enforcement of their speed throttle, but the company’s standard Acceptable Use Policy still gives Verizon broad latitude to deal with customers who create an “adverse impact” on their network:

Network disruptions and unfriendly activity: Using the Services for any activity that adversely affects the ability of other people or systems to use either Verizon Wireless Services or other parties’ Internet-based resources. This specifically but without limitation includes excessive consumption of network or system resources whether intentional or unintentional. This also includes “denial of service” (DoS) attacks against another network host or individual user. Interference with or disruption of other network users, network services or network equipment is prohibited.

Such policies are commonplace at every Internet Service Provider, but they are typically enforced only in instances where a neighborhood or region is experiencing especially heavy traffic loads.  That seems to be the case with Droid Life‘s reader, because other customers report they have managed to rack up nearly 120GB in 4G usage over 10 days with no speed reductions.  Verizon reportedly told the throttled customer his speeds were reduced because his ‘excessive downloading’ was an “abuse of the network.”

To run up tens of gigabytes of usage over two weeks usually means the customer is using a tethering application or mobile hotspot app, services for which Verizon charges extra.  We don’t know if this customer is paying for those services or using one of the third-party apps Verizon frowns on.

The selective enforcement of speed throttles may be the result of an overeager Verizon employee subjectively cracking down.  It might also result from the subscriber using services on an especially congested cell site.  We cannot be certain, and Verizon isn’t commenting on the record.  The company officially claims it is standing by the terms of its original plans to throttle the top 5% of 3G users.

With the ongoing crackdowns on what providers deem to be “excessive usage,” it is safe to assume those attempting to use any wireless broadband plan as a home or office broadband replacement is risking the wrath of their providers who consider anything beyond 2-4GB of usage per month on an “unlimited data plan” to be “too much.”

Apple is set to announce a new iPhone or two early this afternoon, but some in the tech media notice the frenetic excitement of the newest Apple sensation has been tempered, in part because many of the new software and cloud storage features will run into usage caps for some, speed throttles for everyone else.

The imminent arrival of anticipated models iPhone 4S, expected to sell at AT&T and Verizon and iPhone 5, which is rumored to be sold exclusively by Sprint during a short sales window, remains a big deal for all three carriers.  Verizon is reportedly allowing its call center employees to take unlimited overtime in preparation for the anticipated rush of questions and orders.  Sprint, which has 33 million customers on two-year contracts, has made a commitment to sell at least 30.5 million Apple iPhones over four years, if reports by the Wall Street Journal turn out to be accurate.  That’s a lot of phones.

[flv width=”512″ height=”308″]http://www.phillipdampier.com/video/Sprint Getting iPhone 10-3-11.flv[/flv]

9 to 5 Mac shows off a mock image of what the newest iPhone 5 will probably look like. Pay close attention to the rounded edges and bezel.

Reports from the Wall Street Journal, WDAF-TV in Sprint’s home base of Kansas City, and Bloomberg News discuss the implications of Sprint’s deal with Apple.  (11 minutes)

That’s also an enormous gamble for Sprint, which is guaranteed no real profits from the venture until the year 2014.  If the company does win temporary exclusivity of an iPhone model that includes support for Sprint’s 4G network, WiMax, it will also bring the company an enormous number of new customers.

Among the most important new features of the phone is iOS 5, the latest version of Apple’s mobile operating system.  It comes loaded with new ways to burn through the stingy usage caps AT&T and Verizon Wireless are now providing their customers:

1. Over the air upgrades/activations: Apple’s notoriously huge software updates can be delivered to your wireless device without syncing it on a personal computer.  That means downloading software updates that can easily exceed the 200MB “light usage” plans some carriers sell budget-conscious customers;
2. Notification Center: Puts messages from e-mail, texts, and apps in a more convenient place to access and respond, increasing usage;
3. NewsStand: Leverages newspaper and magazine content in a single app, downloading content pushed to your phone, increasing usage;
4. Safari Sync: The Safari web browser will now sync with other instances of the browser on other devices to keep your reading list updated;
5. iMessage: Send texts, photos, and bandwidth-hogging video to friends and family, potentially driving up usage considerably;

But nothing is expected to spike wireless data usage like Apple’s new iCloud and iTunes Match, both of which manage and sync multimedia content and app purchases between devices “over the cloud.”  Unfortunately, repeated journeys of this type will burn through your usage allowance, and those with significant-sized libraries of photos, music, or videos are at serious risk of blasting past their usage cap.  Even customers who use more than 4-5GB on “unlimited data plans” sold by AT&T and Verizon will face the scourge of the speed throttle, which will reduce your zippy new phone to speeds that resemble dial-up.

AT&T and Verizon Apple iPhone customers are at the highest risk of facing the speed throttle, because Apple is not expected to support either company’s 4G data network.  Verizon only exempts 4G customers from the speed throttle when they use the 4G network.

The one company well-positioned to capitalize on these realities happens to be Sprint, which is keeping its truly unlimited data plan.  If Apple comes through with 4G support for Sprint, customers could not only say goodbye to AT&T and Verizon’s slower 3G speeds, they would also be able to rest easy knowing they won’t experience bill shock or a month in the dial-up speed penalty corner if deemed to be using “too much” service.

Customers of the two biggest carriers need to get familiar with switching to Wi-Fi as often as possible, and avoid using data-intensive features on usage-limited plans.  For Verizon and AT&T, it’s the best of all worlds — another two year contract for a usage-limited data plan that guarantees increased revenue and reduced costs.  For you, it’s an improved phone you can never use to its full potential.

[flv width=”512″ height=”308″]http://www.phillipdampier.com/video/Little Buzz Over New iPhone 10-4-11.flv[/flv]

The Wall Street Journal reports there isn’t as much buzz over this year’s newest iPhone.  Bloomberg talks about the software changes in the new phone, and WWLP-TV in Springfield notes Verizon’s unions are calling on Americans to boycott the new phone until Verizon workers get a fair contract.  (8 minutes)

Update 2:00pm ET:  The Wall Street Journal reports the Sprint iPhone will not support their 4G network: According to people familiar with the company’s plans, the hotly anticipated device won’t operate on long-term evolution or WiMAX fourth-generation networks. Those wireless networks promise speedier downloading to mobile devices of episodes of television programs, as well as cute baby photos. The people said the device will work on 3G networks, which are broadly in use today and are the standard for the current iPhone 4. AT&T says its HSPA+ network has 4G-like speeds.

Update 4:00pm ET: The announcement event finally concludes with news the iPhone 5 is vaporware for now.  Sprint will end up with the same Apple 4S phone AT&T and Verizon will sell on their respective networks. The San Jose Mercury News was not thrilled with the event:

At a rollout that lacked some of the thrills and surprises of past product releases — and disappointed some in attendance who expected a completely made-over iPhone 5 — Siri stood out as the sexiest new feature on an iPhone that, contrary to speculation, isn’t any thinner or different looking on the outside than its predecessor, the iPhone 4.

“This phone is better than the iPhone 4 in many ways, even though it looks the same,” said Avi Greengart, an analyst with Current Analysis on hand for the unveiling before several hundred reporters, bloggers, analysts and other guests. “Sales will be wildly successful, but Apple fanboys’ expectations probably were not met today.”

The new phone, which will be available Oct. 15 after pre-orders begin Oct. 7, will cost $199 for a 16-gigabyte version, $299 for 32GB and $399 for 64 GB. It had been center-stage in the tech blogosphere for months, as pundits weighed in with what they saw as the most obvious bells and whistles Apple would unleash on their growing fan base. Tuesday, some were surprised by how wrong that had been.

The phone that everyone thought would be thinner than the iPhone 4, pretty much resembled its older sibling. But as analysts had suspected, the new phone is much faster, thanks for the new A5 chip inside it, and it has plenty of consumer-pleasing attributes, most of them inside the case.