Home » Broadband Speed »Public Policy & Gov't » Currently Reading:

Broadband.gov Testing America’s Broadband Speeds, But Questions Arise About Accuracy of Test

Phillip Dampier March 15, 2010 Broadband Speed, Public Policy & Gov't 5 Comments

The Federal Communications Commission wants to know how fast your broadband connection is.  The federal agency is now offering consumers and businesses a chance to test broadband speeds to raise awareness about broadband.  But the test results also help illustrate the wide variation between speeds promised by providers and those actually experienced by customers.

The FCC wants to collect this information because broadband providers have often refused to provide it themselves, citing customer privacy or an unwillingness to release potentially useful information to competitors.  By asking visitors to supply their street address and general location, the agency can at least develop anecdotal information about the range of speeds Americans experience.

However, the agency is likely to discover wide variations in the accuracy of the results based not on what service providers deliver, but instead what the speed test itself reports.

The FCC is relying on two speed test providers, randomly assigned to those taking the test.

  • Measurement Lab (M-Lab), which provides researchers with Internet measurement tools on a collaborative basis, and
  • Ookla, a private company that provides web-based network diagnostic applications.

Stop the Cap! used both providers to conduct three individual speed tests from Broadband.gov.  There were dramatic differences in results.  M-Lab consistently reported far slower speeds than Ookla.  Ookla’s results were closest to the advertised speeds from our broadband provider — Time Warner Cable.

This speed test result from M-Lab was the closest to the average of all three speed tests conducted with this service

Ookla's speed test came closest to achieving the marketed speeds for Rochester, New York Time Warner Cable Road Runner Turbo customers. The download speeds reported also include the effects of "PowerBoost," a temporary burst of additional downstream speed.

Both speed test providers rely on different regional servers to deliver potentially more accurate speed test results, less impacted by the additional “hops” traffic must take when traveling outside of a nearby region.  But considering the enormous disparity between the two tests, these real-world results may not actually represent reality.

Which test comes closest to the actual speeds available here?  Ookla.  But even then, your results may vary.  Ookla provides speed tests for both Time Warner Cable and Frontier Communications, our local phone company.  The downstream speeds reported were widely different, despite both test servers being located within a 50 mile radius.

Time Warner Cable's speed test application is also provided by Ookla. (This result comes from a server in nearby Syracuse -- the Rochester location was not working properly)

Ookla's speed test for Frontier Communications delivered dramatically different results for downstream speeds

The FCC seems to acknowledge the potential disparity in results on their disclaimer page:

Please note that the Consumer Broadband Test in its current software based form may not be an accurate representation of connection quality provided by your broadband provider. The results can be impacted by a range of factors — for instance, the test can vary based on the geographical distance of the user from the testing server, end-user hardware, network congestion, and time of day. However, this application can provide a helpful indicator in comparing consumers’ relative broadband connection quality and in understanding the performance metrics of broadband connections.

What results do you get from Broadband.gov’s provided speed tests?  Share your findings in our comment section.

Currently there are 5 comments on this Article:

  1. Tim says:

    I can’t even run the gov test. The test won’t even show up. It keeps saying I need to install Java, which I have. I have Firefox 3.6 with Java 6.0.18. I even allowed all scripts on the page. Oh well…

  2. Tkpvictory3 says:

    Mine says zero… Oh yea that’s because it’s not available in at my residence!

  3. Uncle Ken says:

    works just fine even with all firewall and protection in place.
    D 7292
    U 962
    LAT 26 ms
    Jitter 2 ms

  4. BrionS says:

    I like to get my info from several sources and here’s what they say about my Roadrunner connection (supposed to be 15 Mbps down, 1 Mbps up):

    TWC Speed Test (Rochester, NY)
    – 19.73 Mbps down
    – 0.97 Mbps up

    Frontier
    – 11.39 Mbps down
    – 0.95 Mbps up

    Broadband.gov (Ookla test)
    – 17.95 Mbps down
    – 0.96 Mbps up
    – 55ms Latency
    – 7 ms JItter

    Broadband.gov (Mlab test)
    – 16.24 Mbps down
    – 0.90 Mbps up
    – 205 ms Latency
    – 401 ms Jitter

    Speedtest.net (Ookla)
    – 19.53 Mbps down
    – 0.95 Mbps up
    – 81 ms Latency

    Measurement Lab (mlab)
    – 15.89 Mbps up
    – 0.88 Mbps down

    So what’s it all mean? Well they all pretty much agree I get about 1Mbps up (as advertised), but they disagree a bit about the 15 Mbps down I’m supposed to get, varying from 11.93 Mbps (Frontier) to 19.73 Mbps (TWC) and averaging 16.79 Mbps (better than advertised).

    At the end of the day though, I get my web sites and data files in a timely manner most of the time so the exact speed doesn’t matter to me because I don’t notice the lack of speed. If it slowed down significantly I’d probably notice, but fluctuating between 5 Mbps is hard to distinguish. On the other hand, if I had a 50 Mbps connection downstream and a 10 Mbps connection upstream I’m sure I’d notice a drastic difference.

    I will also mention that I had a NAT firewall up during the tests without opening any specific ports.

    • Tim says:

      Doesn’t Time Warner do that “speedboost” thing? That would give erroneous results because it boosts your speed for around 2 seconds worth.

      Finally able to test mine out. I have 12Mb/sec download and 1.5Mb/sec upload through Uverse.

      Download – 11089 Kb/s

      Upload – 1425 Kb/s

      Latency – 57ms

      Jitter – 2ms

      Speakeasy:

      Download – 11.53 Mb/s

      Upload – 1.46Mb/s







Search This Site:

Contributions:

Recent Comments:

  • Uncle Ken: Best part of this story is one company letting another piggyback on their working cable till it was sorted out. Shows people still do care. Brings o...
  • tresho: "They would normally be able to assign you a “broadband phone number” instantly." That's what I was expecting. What got to me was their insertio...
  • Phillip Dampier: That activation message telling you to wait a few days is ridiculous, but it is probably there because Virgin Mobile suffered a huge national outage l...
  • Phillip Dampier: When you first activate, you are stuck on their much slower 1xRTT connection, which can be painfully slow. I didn't experience any of these issues ...
  • Phillip Dampier: The Road Runner national help desk is run by a third party company, although I'm not sure that's who you ended up talking with. The agreement says fe...
  • Bill: Phillip writes regarding ESPN3 that: " [...] it also means Road Runner customers who don’t take cable-TV will not have access." This is the way I also...
  • Tim: These Networks are biting off more than they can chew. More and more people are going to drop cable if this keeps happening, which it will. Once that ...
  • agent00kevin: My experience: I bought a Mifi 2200 at WalMart this afternoon + the 40$ card needed for unlimited service. Got everything home, booted up the lapt...
  • tresho: The previous commenters apparently were able to activate their Virgin Mobile service. I wasn't. I bought a MC760 at my local Walmart on Friday after...
  • Will: Thanks for answering my questions. I do have a bit of engineering knowledge on how CDMA 3G EVDO works so your post has answered my questions. So basic...
  • Ron Paul FTW: Sorry... The link to The Creature from Jekyll Island speech was wrong... Here is the link: http://www.youtube.com/watch?v=Zus8_xl8qUI Find a...
  • Paul: Virgin Mobile's broadband data is obviously being routed differently than Sprint users' data. Sprint is clearly providing less resources to Virgin Mob...

Your Account: