Home » Broadband Speed »Public Policy & Gov't » Currently Reading:

Broadband.gov Testing America’s Broadband Speeds, But Questions Arise About Accuracy of Test

Phillip Dampier March 15, 2010 Broadband Speed, Public Policy & Gov't 5 Comments

The Federal Communications Commission wants to know how fast your broadband connection is.  The federal agency is now offering consumers and businesses a chance to test broadband speeds to raise awareness about broadband.  But the test results also help illustrate the wide variation between speeds promised by providers and those actually experienced by customers.

The FCC wants to collect this information because broadband providers have often refused to provide it themselves, citing customer privacy or an unwillingness to release potentially useful information to competitors.  By asking visitors to supply their street address and general location, the agency can at least develop anecdotal information about the range of speeds Americans experience.

However, the agency is likely to discover wide variations in the accuracy of the results based not on what service providers deliver, but instead what the speed test itself reports.

The FCC is relying on two speed test providers, randomly assigned to those taking the test.

  • Measurement Lab (M-Lab), which provides researchers with Internet measurement tools on a collaborative basis, and
  • Ookla, a private company that provides web-based network diagnostic applications.

Stop the Cap! used both providers to conduct three individual speed tests from Broadband.gov.  There were dramatic differences in results.  M-Lab consistently reported far slower speeds than Ookla.  Ookla’s results were closest to the advertised speeds from our broadband provider — Time Warner Cable.

This speed test result from M-Lab was the closest to the average of all three speed tests conducted with this service

Ookla's speed test came closest to achieving the marketed speeds for Rochester, New York Time Warner Cable Road Runner Turbo customers. The download speeds reported also include the effects of "PowerBoost," a temporary burst of additional downstream speed.

Both speed test providers rely on different regional servers to deliver potentially more accurate speed test results, less impacted by the additional “hops” traffic must take when traveling outside of a nearby region.  But considering the enormous disparity between the two tests, these real-world results may not actually represent reality.

Which test comes closest to the actual speeds available here?  Ookla.  But even then, your results may vary.  Ookla provides speed tests for both Time Warner Cable and Frontier Communications, our local phone company.  The downstream speeds reported were widely different, despite both test servers being located within a 50 mile radius.

Time Warner Cable's speed test application is also provided by Ookla. (This result comes from a server in nearby Syracuse -- the Rochester location was not working properly)

Ookla's speed test for Frontier Communications delivered dramatically different results for downstream speeds

The FCC seems to acknowledge the potential disparity in results on their disclaimer page:

Please note that the Consumer Broadband Test in its current software based form may not be an accurate representation of connection quality provided by your broadband provider. The results can be impacted by a range of factors — for instance, the test can vary based on the geographical distance of the user from the testing server, end-user hardware, network congestion, and time of day. However, this application can provide a helpful indicator in comparing consumers’ relative broadband connection quality and in understanding the performance metrics of broadband connections.

What results do you get from Broadband.gov’s provided speed tests?  Share your findings in our comment section.




Share

Other stories of interest:

  1. Road Runner Upload Speed Increased for Standard Customers in Rochester, No Change for Turbo
  2. Road Runner Focus Group Testing Higher Speed Tier Names/Pricing?
  3. Telecom New Zealand Fined For Misleading Customers With “Unlimited” Broadband Offer That Heavily Throttled Speeds
  4. Beaumont-Area AT&T Customer Gets Himself Exempted from Internet Overcharging: Can You?
  5. Time Warner Cable Nation’s Third Largest Internet Service Provider – 62 Percent of Its Customers Take Broadband

Currently there are 5 comments on this Article:

  1. Tim says:

    I can’t even run the gov test. The test won’t even show up. It keeps saying I need to install Java, which I have. I have Firefox 3.6 with Java 6.0.18. I even allowed all scripts on the page. Oh well…

  2. Tkpvictory3 says:

    Mine says zero… Oh yea that’s because it’s not available in at my residence!

  3. Uncle Ken says:

    works just fine even with all firewall and protection in place.
    D 7292
    U 962
    LAT 26 ms
    Jitter 2 ms

  4. BrionS says:

    I like to get my info from several sources and here’s what they say about my Roadrunner connection (supposed to be 15 Mbps down, 1 Mbps up):

    TWC Speed Test (Rochester, NY)
    – 19.73 Mbps down
    – 0.97 Mbps up

    Frontier
    – 11.39 Mbps down
    – 0.95 Mbps up

    Broadband.gov (Ookla test)
    – 17.95 Mbps down
    – 0.96 Mbps up
    – 55ms Latency
    – 7 ms JItter

    Broadband.gov (Mlab test)
    – 16.24 Mbps down
    – 0.90 Mbps up
    – 205 ms Latency
    – 401 ms Jitter

    Speedtest.net (Ookla)
    – 19.53 Mbps down
    – 0.95 Mbps up
    – 81 ms Latency

    Measurement Lab (mlab)
    – 15.89 Mbps up
    – 0.88 Mbps down

    So what’s it all mean? Well they all pretty much agree I get about 1Mbps up (as advertised), but they disagree a bit about the 15 Mbps down I’m supposed to get, varying from 11.93 Mbps (Frontier) to 19.73 Mbps (TWC) and averaging 16.79 Mbps (better than advertised).

    At the end of the day though, I get my web sites and data files in a timely manner most of the time so the exact speed doesn’t matter to me because I don’t notice the lack of speed. If it slowed down significantly I’d probably notice, but fluctuating between 5 Mbps is hard to distinguish. On the other hand, if I had a 50 Mbps connection downstream and a 10 Mbps connection upstream I’m sure I’d notice a drastic difference.

    I will also mention that I had a NAT firewall up during the tests without opening any specific ports.

    • Tim says:

      Doesn’t Time Warner do that “speedboost” thing? That would give erroneous results because it boosts your speed for around 2 seconds worth.

      Finally able to test mine out. I have 12Mb/sec download and 1.5Mb/sec upload through Uverse.

      Download – 11089 Kb/s

      Upload – 1425 Kb/s

      Latency – 57ms

      Jitter – 2ms

      Speakeasy:

      Download – 11.53 Mb/s

      Upload – 1.46Mb/s

Search This Site:

Contributions:

Recent Comments:

  • Jeremy: Keep it up Crime Warner, Google will soon be a competitor of yours here in KC and then I can dump your internet and atrocious cable/cable box....
  • Mileena: Welp, just let us know when we have to start protesting......
  • Phillip Dampier: I love the industry argument that network builds in rural area just don't make sense. But they still manage to fund lobbying campaigns to keep munici...
  • Phillip Dampier: Verizon FiOS is deregulated. In fact, both Verizon and AT&T have fought for the ultimate in "hands off" telecom regulation: the statewide franchise f...
  • Phillip Dampier: I am more convinced than ever Genachowski is not going to stay as chairman during a second Obama administration. He was angling for a position at the ...
  • Phillip Dampier: You are evidently a new reader here. Service complaints, outages, and policy changes for TV, broadband, and phone service have all been covered here f...
  • Phillip Dampier: I think I answered your question. I don't have any problem with customers being able to roam on cable Wi-Fi networks. You are the one using the wor...
  • Scott: Last I checked Marriott and Cadillac dealerships weren't essential services that affect citizens access to public online services, education, and gene...
  • Jordan Kratz: Genachowski is just as Corrupt as the rest of this Government.Within 5 - 20 years i am more and more believing a real revolution or a complete falling...
  • Jeremy: "It just depends on who has his ear the most." It's definitely not us little American consumers....
  • thad: Either Genachowski is ignorant (which as the FCC chairman he is paid not to be) or he is working to the benefit of current, traditional, Teleco behemo...
  • Sean: A phone company says having customers with working phones is a harmful business model? WTH?...

Your Account: