With video streaming now accounting for at least 64 percent of all Internet traffic, it should have come as no surprise to Australia’s ISPs that as data caps are eased and popular online video services like Netflix arrive, traffic spikes would occur on their networks as well.

It surprised them anyway.

Telecom analyst Paul Budde told the WAToday newspaper “video streaming requires our ISPs to have robust infrastructure, and to use it in more sophisticated ways, and that largely caught Australia off guard. I think it’s fair to say everybody underestimated the effect of Netflix.”

Not everybody.

Australia’s National Broadband Network (NBN) was originally envisioned by the then Labor government as a fiber-to-the-home network capable of enormous capacity and gigabit speed. Prime Minister Kevin Rudd proposed buying out the country’s existing copper phone wire infrastructure from telecom giant Telstra to scrap it. Instead of DSL and a limited number of cable broadband providers, the national fiber to the home network would provide service to the majority of Australians, with exceptionally rural residents served by wireless and/or satellite.

Conservative critics slammed the NBN as a fiscal “white elephant” that would duplicate or overrun private investment and saddle taxpayers with the construction costs. In the run up to the federal election of 2013, critics proposed to scale back the NBN as a provider of last resort that would only offer service where others did not. Others suggested a scaled-down network would be more fiscally responsible. After the votes were counted, a Coalition government was formed, run by the conservative Liberal and National parties. Within weeks, they downsized the NBN and replaced most of its governing board.

Plans for a national fiber to the home network similar to Verizon FiOS were dropped, replaced with fiber to the neighborhood technology somewhat comparable to AT&T U-verse or Bell Fibe. Instead of gigabit fiber, Australians would rely on a motley mix of technologies including wireless broadband, DSL, VDSL, cable, and in areas where the work had begun under the earlier government, a limited amount of fiber.

In hindsight, the penny wise-pound foolish approach to broadband upgrades has begun to haunt the conservatives, who have already broken several commitments regarding the promised performance of the downsized network and are likely to break several more, forcing more costly upgrades that would have been unnecessary if the government remained focused on an all-fiber network.

Communications Minister Malcolm Turnbull has admitted the new NBN will not be able to deliver 25Mbps service to all Australians by 2016. Only 43 percent of the country will get that speed, partly because of technical compromises engineers have been forced to make to accommodate the legacy copper network that isn’t going anywhere.

Think Broadband called the fiber to the neighborhood NBN “a farce” that has led to lowest common denominator broadband. A need to co-exist with ADSL2+ technology already offered to Australians has constrained any speed benefits available from offering faster DSL variants like VDSL2. Customers qualified for VDSL2 broadband speeds will be limited to a maximum of 12Mbps to avoid interfering with existing ADSL2+ services already deployed to other customers. Only multi-dwelling units escape this limitation because those buildings typically host their own DSLAM, which provides service to each customer inside the building. In those cases, customers are limited to a maximum of 25Mbps, not exactly broadband nirvana. The NBN is predicting it will take at least a year to take the bandwidth limits off VDSL2.

The need for further upgrades as a result of traffic growth breaks another firm commitment from the conservative government.

NBN executive chairman Ziggy Switkowski told reporters in 2013 that technology used in the NBN would not need to be upgraded for at least five years after construction.

“The NBN would not need to upgraded sooner than five years of construction of the first access technology,” Switkowski said. “It is economically more efficient to upgrade over time rather than build a future-proof technology in a field where fast-changing technology is the norm.”

Since Switkowski made that statement two years ago, other providers around the world have gravitated towards fiber optics, believing its capacity and upgradability makes it the best future-proof technology available to handle the kind of traffic growth also now being seen in Australia. At the start of 2015, 315,000 Australians were signed up for online video services. Today, more than two million subscribe, with Netflix adding more than a million customers in less than four months after it launched down under.

Many ISPs offer larger data caps or remove them altogether for “preferred partner” streaming services like Netflix. With usage caps in place, some customers would have used up an entire month’s allowance after just one night watching Netflix.

But the online viewing has created problems for several ISPs, especially during peak usage times. iiNet reports up to 25% of all its network traffic now comes from Netflix. As a result iiNet is accelerating network upgrades.

Customers still reliant on the NBN’s partial copper network are also reporting slowdowns, especially in the evening. The NBN will have to upgrade its backbone connection as well as the last mile connection it maintains with customers who often share access through a DSLAM. The more customers use their connections for Netflix, the greater the likelihood of congestion slowdowns until capacity upgrades are completed.

Optus worries its customers have extended Internet peak time usage by almost 90 minutes each night as they watch online streaming instead of free-to-air TV. Telstra adds it also faces a strain from “well over half” of the traffic on its network now consisting of video content.

This may explain why Internet entrepreneur and NBN co-board director Simon Hackett wishes the fiber to the neighborhood technology would disappear and be replaced by true fiber to the home service.

“It sucks,” Hackett told an audience at the Rewind/Fast Forward event in Sydney in March, referring to the fiber to the neighborhood technology. His mission is to try and make the government’s priority for cheaper broadband infrastructure “as least worse as possible.”

“Fiber-to the-[neighborhood] is the least-exciting part of the current policy, no arguments,” he added. “If I could wave a wand, it’s the bit I’d erase.”

Another cost of the Coalition government’s slimmed-down Internet expansion is already clear.

According to Netflix’s own ISP speed index, which ranks providers on the quality of streaming Netflix on their networks, Australia lags well behind the top speeds of dozens of other developed nations, including Mexico and Argentina.

But even those anemic speeds come at a high cost to ISPs, charged a connectivity virtual circuit charge (CVC) by NBN costing $12.91 per 1Mbps. The fee is designed to help recoup network construction and upgrade costs. But the fee was set before the online video wave reached Australia. iiNet boss David Buckingham worries he will have to charge customers a “Netflix tax” of $19.18 a month for moderate Netflix viewing to recoup enough money to pay the CVC fees. If a viewer wants to watch a 4K video stream, Buckingham predicts ISPs will have to place a surcharge of $44.26 a month on occasional 4K viewing, if customers can even sustain such a video on NBN’s often anemic broadband connections.

Some experts fear costs will continue to rise as the government eventually recognizes its budget-priced NBN is saddled with obsolete technology that will need expensive upgrades sooner than most think.

Instead of staying focused on fiber optics, technology the former Rudd government suggested would offer Australians gigabit speeds almost immediately and would have plenty of capacity for traffic, the conservative, constrained, “more affordable” NBN is leaving many customers with no better than 12Mbps with a future promise to deliver 50Mbps some day. There is little value for money from that.

The Australian government’s proposal to launch a nationwide fiber to the home National Broadband Network (NBN) has been scrapped by the more conservative Liberal-National Coalition that replaced the Labor government in a recent election.

As a result, the Coalition has announced initial plans to revise the NBN with a mixture of cheaper technology that can result in faster deployment of lower speed broadband at a lower cost. If implemented, fiber to the home service will only reach a minority of homes. In its place,  cable broadband may be the dominant technology where cable companies already operate. For almost everyone else, technology comparable to AT&T U-verse is the favored choice of the new government, mixing fiber-to-the-neighborhood with existing copper wires into homes..

[flv]http://www.phillipdampier.com/video/ABC Malcolm Turnbull moves to put Coalitions stamp on NBN Co 9-24-13.mp4[/flv]

Australia’s new Communications Minister moves to put the Coalition government’s stamp on the National Broadband Network, replacing most of the promised fiber-to-the-home technology with a service comparable to AT&T U-verse. From ABC-TV (6:32)

Just a year earlier Telstra, Australia’s largest phone company, was planning to decommission and scrap its copper landline network, considered “five minutes to midnight” back in 2003 by Telstra’s head of government and corporate affairs, Tony Warren. Now the country will effectively embrace copper technology once more with an incremental DSL upgrade, forfeiting speeds of up to 1,000Mbps over fiber in return for a minimum speed guarantee from the government of 24Mbps over VDSL.

The turnabout has massive implications for current providers. Telstra, which expected to see its prominence in Australian broadband diminished under Labor’s NBN is once again a rising star. The Liberal-National Coalition government appointed Telstra’s former CEO Ziggy Switkowski to run a “rebooted” Coalition NBN that critics are now calling Telstra 3.0. Communications Minister Malcolm Turnbull also installed three new members of the NBN’s governing board consisting of a Telstra executive, a founder of a commercial Internet Service Provider, and an ex-construction boss who left the NBN in 2011.

[flv]http://www.phillipdampier.com/video/ABC Malcolm Turnbull Outlines NBN Review 9-24-13.mp4[/flv]

ABC reports Communications Minister Malcolm Turnbull asked for the resignations of the entire NBN board, one of the first steps to re-envision the NBN under the Liberal-National Coalition’s party platform. Turnbull accused the former government of setting political targets for fiber broadband and was never forthcoming about the true cost and complexity of the ambitious fiber project. (8:50)

Some Australians complain that NBN’s proposed reliance on Telstra copper is a mistake. Telstra has allowed its landline infrastructure to decline over the years and many are skeptical they will ever see faster speeds promised over wiring put in place decades earlier.

The NBN under the Liberal-National Coalition will depend heavily on two copper-based technologies to deliver speed enhancements: VDSL and vectoring. Both require short runs of well-maintained copper wiring to deliver peak performance. The longer the copper line, the worse it will perform. If that line is compromised, VDSL and vectoring are unlikely to make much difference, as AT&T has discovered in its effort to roll out faster U-verse speeds, much to the frustration of customers that cannot upgrade until AT&T invests in cleaning up its troubled copper network.

Coalition critics also warn the new government will foolishly spend less on a fiber-copper network today that will need expensive fiber upgrades tomorrow.

Turnbull isn’t happy with Australia’s mainstream media for lazy reporting on the issues.

ABC Radio reports that the Coalition’s approach to the NBN may be penny-wise, pound foolish. By the time the NBN rolls out fiber to the neighborhood and Telstra is required to invest in upgrades to its copper network to make it work, fiber to the home service could turn out to have been cheaper all along. (5:11)
You must remain on this page to hear the clip, or you can download the clip and listen later.

“I have to say that by and large the standard of reporting of technology and broadband by the mainstream media has been woeful,” Turnbull said. “If the Australian public are misinformed about these issues, it was in large part a consequence of the unwillingness of the mainstream media to pay any attention to what is really going on in the industry.”

With much of the new NBN dependent on Telstra’s copper telephone network, Stuart Lee, Telstra’s managing director of its wholesale division, rushed to defend the suitability of the same copper network Telstra was prepared to scrap under the last government.

Lee said he was especially annoyed with critics that call Telstra’s copper networking “aging.”

“The other thing that makes me cross when I hear it, and I see it a lot in the press is the talk of the aging copper network. It’s not. It’s not an aging copper network. It’s like grandfather’s axe; it’s had five new handles and three new heads. When it breaks, we replace the broken bit. So it’s much the same as it always has been and always will be,” Lee said. “It’s just an older technology, it’s not that the asset itself has deteriorated.”

When questioned about several recent high-profile mass service disruptions Australians experienced on Telstra’s landline copper network, Lee blamed the weather, not the network.

“They correlate to weather events, and the weather events we’ve had in the last [few years] is about five to six times the previous ones, so surprise surprise there is a lot more damage,” said Lee.

The new government has charged the Labor-run NBN with inefficiency, taxpayer-funded waste, and playing politics with broadband by giving high priority to fiber upgrades in constituencies served by threatened Labor MPs. Lee added NBN Co has played loose with the facts, declaring premises “passed” by the new fiber network without allowing customers to order service on the new network. That can become a serious problem, because the NBN plan calls for customers’ existing copper phone and DSL service to be decommissioned soon after the fiber network becomes available.

iiNet’s chief technology officer, John Lindsay said that the potential for disconnecting customers from the ADSL network while they still can’t order NBN service was “madness.”

The Labor government’s NBN has also been under fire for a pricing formula that includes a usage component when setting prices. Impenetrably named the “connectivity virtual circuit” charge, or CVC, the NBN charges retail providers a monthly connection fee for each customer and a usage charge that includes a virtual data allowance originally set at 30GB. Retail providers are billed extra when customers exceed the informal allowance. Although the government promised to reduce the charges, they effectively haven’t and likely won’t until 2017.

Lindsay called the CVC an artificial tax comparable to the Labor government’s carbon tax, and represents a digital barrier to limit customer usage.

“It’s a tax on packets,” Lindsay said.

[flv]http://www.phillipdampier.com/video/ABC NBN Copper 11-19-13.mp4[/flv]

Tasmanian residents complain NBN Co’s new fiber network is claimed to be available, but actually isn’t in many neighborhoods now scheduled for disconnection from Telstra’s copper landline and DSL network. (2:17)

The Wall Street Journal’s not-living-in-the-real-world editorial page strikes again.

The commentary pages have always been the weakest part of the Journal, primarily because they screech pro-corporate talking points in contrast to the more balanced reporting in the rest of the newspaper.

Mr. Holman W. Jenkins, Jr. decided to distort broadband reality (again) in yesterday’s edition with a glowing commentary on how wonderful broadband providers are in his piece, “Springtime for Broadband.” The only thing missing was a border in fine print labeled, “Sponsored by Verizon, AT&T, and your cable company.”

While your Internet bill is being hiked at the same time your provider is slapping usage limits on your connection, Jenkins dismisses consumer-fueled complaints about broadband price gouging, assaulting Net Neutrality, and overall poor customer service as part of Washington’s “broadband policy circus.”

Charges fly hourly that Google or some other company is guilty of gross insult to net neutrality (that sacred principle nobody can define). Oregon Sen. Ron Wyden has introduced legislation to regulate data caps and Internet pricing. Law professor Susan Crawford, until recently a White House technology adviser, clearly craves to be America’s next go-to talking head on broadband. Lately she’s been everywhere calling for a crackdown on the competing “monopolists” who supply Internet access.

How dare they complain, decries Jenkins in a robust defense of the 21st century version of the railway robber barons.

Comfortably playing patty cake with provider-fed talking points from the industry echo chamber, Jenkins is ready for battle, facts or not.

But wireless providers have invested big money to deploy high-speed mobile networks, and fixed and mobile are inevitably beginning to compete. The latest evidence: Australia recently predicted that up to 30% of households will go the all-wireless route and won’t be customers for its vaunted national broadband project.

Not exactly. The basis for this 30% figure is the National Broadband Network’s own business plan, which warns –if– the company raised prices to a maximum theoretical level, up to 30 percent of its customers would rely on wireless instead… by the year 2039. That is 26 years from now. You have nothing better to do in the meantime, right?

In fact, conservative critics of the fiber network, some defending the big wireless cell phone industry in Australia, have suggested fiber optics is a big waste of money because “wireless is the future.”

That old chestnut again.

“Now you can present a bulletin without touching a typewriter … it’s just there on the computer system, you don’t need a reel to reel tape recorder. I’ve got a touchscreen in front of me. Back then I had a big cartridge deck,” said Ray Hadley on 2GB radio. “Can you imagine the advances in technology in the next 26 years? I can’t. I can’t comprehend it. By the time they finish the NBN, it could be superseded by something we don’t even know about.”

NBN Myths, a website set up to tackle the disinformation campaign from political and industry opponents has one simple fact to convey: “Despite what you may have read from certain clueless commentators, there is not a single country or telecommunications company anywhere in the world that is attempting to replace fixed networks with wireless in urban areas, or even planning to do so in the future.”

Even Telstra, the biggest telecom company in Australia scoffs at such a notion, noting a growing number of its customers have both wired and wireless service, and they do not depend on one over the other.

Research firm Telsyte found that 85 per cent of Australians want speeds of 50Mbps or higher, speeds impossible for wireless to offer. In fact, when the NBN fiber network became available to Australians, almost half the current users as of October last year had chosen an even-faster 100Mbps plan option. But Australians also want mobile broadband, and they are signing up for that as well.

The Australian Bureau of Statistics notes the number of mobile broadband Internet connections also grew by around 40% in Australia between 2009 and 2010. But here is the Achilles heel of wireless: it cannot deliver the same speeds or capacity, and providers charge high prices and deliver low usage caps. As a result, the wireless industry has pulled off a coup: they earn enormous revenues from networks they have successfully rationed. The total amount of data downloaded over Australia’s wireless networks actually fell on a per user basis, despite the growth in customers.

Much of Jenkins’ commentary is spoon-fed by the industry-funded Information Technology and Innovation Foundation, which produces industry-sponsored studies designed to tell America all is well in our broadband duopoly.

In the latest federal survey, the average broadband speed in America is up to 15.6 megabits per second, from 14.3 a year earlier. Nearly half of customers who six months ago made do with one megabit or less have now moved up to higher speeds. Since 2009, the U.S. has gone from 22nd fastest Internet to the eighth fastest.

The 15.6Mbps figure comes from the Federal Communications Commission. The statistics about our global speed ranking come from Akamai’s voluntary speed test program. Other studies rate America much lower. More importantly, while providers in the U.S. try to squeeze out more performance from their copper networks, other countries are laying speedier fiber networks that are destined to once again leapfrog over the United States. Most charge less for their broadband connections as well.

Jenkins also quotes the ITIF which touts 20 million miles of fiber were laid in America last year. But the ITIF, when pressed, will admit the majority of that fiber was “middle mile” connections, institutional or business network fiber you cannot access, or fiber to cell towers. Fiber to the home expansion has stalled, primarily because Verizon has suspended expansion of its FiOS network to new areas after Wall Street loudly complained about the cost.

Jenkins argues that if we leave providers alone and stop criticizing their growing prices, declining competition, and fat profits, the marketplace will suddenly decide to invest in network upgrades yet again.

“The day may come when even Verizon, which visibly soured on its $23 billion FiOS bet, rediscovers an urge to invest in fixed broadband infrastructure to meet growing consumer lust for hi-def services,” writes Jenkins.

Would Wall Street rather see providers invest in network upgrades or return profits to shareholders? Investment expansion in the broadband industry comes when a company senses if they do not spend the money, their business will be swept away by others that will. Cable broadband threatens telephone company DSL, so AT&T cherry-picked communities for investment in its half-measure U-verse fiber to the neighborhood network. Google Fiber, should it choose to expand, will be an even bigger threat to both cable and phone companies. Municipal fiber to the home networks upset the incumbent players so much, they spend millions of ratepayer dollars in efforts to legislate them out of existence.

Jenkins’ view that giving the industry carte blanche to do and charge as it pleases to stimulate a better broadband future is as fanciful as NBN critics in Australia suggesting fiber upgrades should be canceled in favor of waiting 20+ years for improved wireless to come along.

He even approves of Internet Overcharging schemes like usage caps and consumption billing, calling it proper price discrimination in a “fiercely competitive” environment to defray a network’s fixed costs.

Do you think there is fierce competition for your broadband dollar?

Broadband’s fixed costs are so low and predictable, it literally calls out consumption pricing as just the latest overreach for enhanced profits. As Suddenlink’s CEO himself admitted, the era of big expensive cable upgrades are over. Incremental upgrades are cheap, the costs to offer broadband are declining, so it is time to reap the profits.

Jenkins closes with one recommendation we can agree with: “A low-tech way to stir up broadband competition would be to relax the regulatory obstacles to the actual physical provision of broadband.”

We can start by scrapping all the state laws the industry lobbied to enact that prohibit community-owned broadband competition. If big cable and phone companies won’t provide communities with the quality of broadband service they need to compete for 21st century jobs, let those communities do it themselves.

Australia’s march towards an all-fiber future took an important step last week when the government announced a wide-ranging agreement with Telstra, the country’s largest phone company, to use Telstra’s existing infrastructure to help construct a national fiber network.

After two years of negotiations, Australian Prime Minister Julia Gillard on Thursday announced an $11 billion deal between Telstra and NBN Co to allow NBN to use Telstra’s existing conduits, poles, and network facilities to provide a foundation for the construction of the all-fiber network and the removal of existing copper wiring.

The deal is expected to save the government millions by not having to construct redundant facilities.

The network is expected to take a decade to complete, and will provide optical fiber broadband to at least nine out of ten Australian households.  The project will make Australia a global broadband leader, far ahead of the United States and Canada and most of western Europe.

As part of the deal, Telstra agreed to pay $2 billion for upgrades to its own infrastructure in preparation of migrating customers to the NBN.  Telstra’s CEO, David Thodey, said the agreement ended the uncertainty surrounding Telstra’s possible association with NBN and will allow his company to focus on customer service.

Gillard and Communications Minister Stephen Conroy turned on Australia’s first connection to the NBN in May at the Presbyterian Ladies College in Armidale in the east Australian state of New South Wales.

The town is one of five test markets where the NBN will first operate.  Areas in Melbourne, Townsville, coastal New South Wales and South Australia will also be switched on in coming months.

[flv width=”512″ height=”308″]http://www.phillipdampier.com/video/Nine Network NBN Switched On 5-11.flv[/flv]

Nine Network in Australia covered the opening of the country’s National Broadband Network in Armidale earlier this year, and what it means for Australians as fiber broadband replaces older technology.  The opposition gripes the government is spending too much on the network.  (7 minutes)

Liberal opposition to the NBN has been fierce in some quarters, with Opposition communications spokesman Malcolm Turnbull claiming the government is overspending on a network that delivers fiber straight to the home.  Gillard accused the conservative opposition of seeking to rip installed fiber straight out of the ground if they were to come to power, a charge Turnbull rejects as ridiculous.

 

He prefers a “fiber to the neighborhood” approach, similar to AT&T U-verse, which he says will bring good enough speeds to Australians faster and cheaper than an entirely fiber based network would.  But fiber proponents claim the costs will come down as the network construction ramps up, delivering economy of scale.  The government also believes fiber to the home is more upgradable and more reliable than a hybrid fiber-copper network.

Most of all, Australians are celebrating the imminent end of usage-based pricing, fair access policies that reduce speeds of heavy users to near-dial-up, and the fact they are likely to be among the top-five ranked broadband nations globally when the network is complete.

[flv width=”640″ height=”500″]http://www.phillipdampier.com/video/Sky News ABC NBN and Telstra Achieve Deal 6-23-11.flv[/flv]

Sky News and ABC report on the government’s deal with Telstra to retire the nation’s copper wire network and work together to build fiber to the home to virtually every Australian. (7 minutes)

Telstra, Australia’s dominant telecommunications company, is openly concerned about the prospect of Australians finally shedding themselves from Internet Overcharging schemes like low usage caps and throttled speed.  But instead of doing away with these profit-boosting schemes themselves, they’ve decided to argue that consumers don’t need the country’s newest 1TB usage allowance plans, calling them publicity gimmicks.

Of course, Telstra doesn’t offer a 1TB plan.

Heath Gibson tries to explain away Telstra’s Internet Overcharging in a company blog post:

A terabyte is a lot of data. One provider claimed it’s enough to download about 200 DVD quality movies and still have quota left over.  Whilst my inner geek is salivating at the possibilities, the analyst in me is questioning just how many people currently need, or could even use, a terabyte of data each and every month.

Gibson believes the average Australian is better off plans like Telstra’s 50GB DSL service, running $49.30US per month on a two-year contract.  When all the charges and fees are totaled, Australians will pay Mr. Gibson’s company $2,364.50US for two years of service that slows to 64kbps once your monthly 50GB allotment is used up.

“Terabyte plans will have appeal to a special niche and demand for these plans will no doubt grow over time,” Gibson wrote. “But for now my advice to most people would be to look past the attention grabbing headline, check how big a plan you really need and keep in mind all the other things that go in to making a great ISP.”

Australians have already made that decision and they have been voting with their feet to other providers.  On the same day Gibson was dismissing the competition, Telstra CEO David Thodey was responding to it, recognizing the company has lost significant market share because of high prices and poor customer service.

He told The Advertiser improvements were underway.

“The focus on customer service is something that is innate within Telstra, but our delivery leaves a lot to be desired,” he said.

So is their pricing.  Gibson’s views defending rationed Internet service are similar to the arguments broadband providers in the States use to defend their failure to keep up in the global broadband speed race.  Only instead of dismissing the need for unlimited service, American providers try and convince customers they don’t need the faster speeds they don’t deliver.