![]() ![]() By also preserving raw test data as collected and annotated, and curating views in intermediate steps, we can also support users whose research is concerned with unfiltered or non-curated tests. ![]() The presentation of NDT data in a series of datasets and views in BigQuery represents M-Lab’s strategy for data curation, providing a cleaned and filtered view of test results that can be used to attempt answering the most common research questions of our community requiring known good test results. Note that we sometimes use the terms “table” and “view” interchangeably: they reflect different internal implementations, but due to billing and access controls everything documented here as a table is actually presented as a view. Find out more about how to get access on our BigQuery QuickStart page. To make NDT data more readily available for research and analysis, M-Lab parses all NDT data into BigQuery tables and views, and makes query access available for free by subscription to a Google Group. Details on how M-Lab publishes test data in raw form are provided on our Google Cloud Storage documentation page. The raw data also includes TCP packet captures (.pcap files) for most NDT tests, however the pcap files are not indexed in BigQuery yet. Dedicated users can reconstruct our analysis and in principle fully replicate our parsers. Generally, BigQuery rows indicate the locations of the raw data from which they were derived. As our parsing and analysis algorithms improve, M-Lab periodically reprocesses all of this archived data. Unparsed Raw NDT Data in GCSĪll of the raw data and log files from the measurement fleet are archived in their original format and available in Google Cloud Storage. Please review M-Lab’s Privacy Policy to understand what data is collected and how data is used before initiating a test. NDT does not collect any information about you as an Internet user. M-Lab conducts the test and publishes all test results to promote Internet research. When you run NDT, the IP address provided by your Internet Service Provider will be collected along with your measurement results. Client supports an opt-in data transfer limit.Uses the BBR TCP congestion control algorithm, falling back to Cubic when BBR is not available on the client side.ndt7 is an NDT protocol that uses TCP BBR where available, operates on standard HTTP(S) ports (80, 443).Uses the Cubic TCP congestion control algorithm.Collected using ndt-server, which follows the legacy NDT protocol to support existing NDT clients that use it.ndt5 is an NDT protocol designed to be backward compatible with legacy NDT clients.Used the Reno TCP congestion control algorithm.Collected using the original version of NDT server.Relied on the web100 kernel module for TCP statistics.web100 is the protocol referring to data collected by the original NDT server.We now refer to these as “datatypes” for the NDT test. NDT Testing ProtocolsĪs a part of our transition from the web100 version of NDT server to the new platform, M-Lab named specific protocol versions for the original server and the new one we are now using. For more information, please see our blog post discussing the Evolution of NDT. Over the last decade, there are three primary themes that have driven the evolution of NDT: standard kernel instrumentation, advances in TCP congestion control, and protocols and ports to support more clients. Originally developed at Internet2, M-Lab has hosted NDT since our founding in 2009, and helped maintain and develop NDT for most of its history on the M-Lab platform. If you are interested in running an NDT test, please visit our site: History NDT reports upload and download speeds and latency metrics. NDT measures “single stream performance” or “bulk transport capacity”. NDT is a single stream performance measurement of a connection’s capacity for “bulk transport” (as defined in IETF’s RFC 3148. Home / Tests / NDT (Network Diagnostic Tool) NDT (Network Diagnostic Tool)
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |