draft-ietf-bmwg-ospfconv-term-04.txt   draft-ietf-bmwg-ospfconv-term-05.txt 
Network Working Group Vishwas Manral Network Working Group Vishwas Manral
Internet Draft Netplane Systems Internet Draft Netplane Systems
Russ White Russ White
Cisco Systems Cisco Systems
Aman Shaikh Aman Shaikh
Expiration Date: September 2003 University of California Expiration Date: December 2003 University of California
File Name: draft-ietf- bmwg-ospfconv-term-04.txt March 2003 File Name: draft-ietf-bmwg-ospfconv-term-05.txt June 2003
OSPF Benchmarking Terminology and Concepts OSPF Benchmarking Terminology and Concepts
draft-ietf-bmwg-ospfconv-term-04.txt draft-ietf-bmwg-ospfconv-term-05.txt
1. Status of this Memo 1. Status of this Memo
This document is an Internet-Draft and is in full conformance with This document is an Internet-Draft and is in full conformance with
all provisions of Section 10 of RFC2026. all provisions of Section 10 of RFC2026.
Internet Drafts are working documents of the Internet Engineering Internet Drafts are working documents of the Internet Engineering
Task Force (IETF), its Areas, and its Working Groups. Note that other Task Force (IETF), its Areas, and its Working Groups. Note that other
groups may also distribute working documents as Internet Drafts. groups may also distribute working documents as Internet Drafts.
skipping to change at page 2, line 17 skipping to change at page 2, line 17
This draft is a companion to [BENCHMARK], which describes basic Open This draft is a companion to [BENCHMARK], which describes basic Open
Shortest Path First [OSPF] testing methods. This draft explains Shortest Path First [OSPF] testing methods. This draft explains
terminology and concepts used in OSPF Testing Framework Drafts, such terminology and concepts used in OSPF Testing Framework Drafts, such
as [BENCHMARK]. as [BENCHMARK].
4. Common Definitions 4. Common Definitions
Definitions in this section are well known industry and benchmarking Definitions in this section are well known industry and benchmarking
terms which may be defined elsewhere. terms which may be defined elsewhere.
o Internal Measurements o White Box (Internal) Measurements
- Definition - Definition
Internal measurements are measurements taken on the Device White Box measurements are measurements taken on the Dev-
Under Test (DUT) itself; also known as White Box Measure- ice Under Test (DUT) itself.
ments.
- Discussion - Discussion
These measurement rely on output and event recording, These measurement rely on output and event recording,
along with the clocking and timestamping available on the along with the clocking and timestamping available on the
DUT itself. Taking measurements on the DUT may impact the DUT itself. Taking measurements on the DUT may impact the
actual outcome of the test, since it can increase proces- actual outcome of the test, since it can increase proces-
sor loading, memory utilization, and timing factors. Some sor loading, memory utilization, and timing factors. Some
devices may not have the required output readily available devices may not have the required output readily available
for taking internal measurements, as well. for taking internal measurements, as well.
Note: Internal measurements can be influenced by the Note: White box measurements can be influenced by the
vendor's implementation of the various timers and process- vendor's implementation of the various timers and process-
ing models. Whenever possible, internal measurements ing models. Whenever possible, internal measurements
should be compared to external measurements to verify and should be compared to external measurements to verify and
validate them. validate them.
o External Measurements o Black Box (External) Measurements
- Definition - Definition
External measurements infer the performance of the DUT Black Box measurements infer the performance of the DUT
through observation of its communications with other through observation of its communications with other dev-
devices; also known as Black Box Measurements. ices.
- Discussion - Discussion
One example of an external measurement is when a down- One example of a black box measurement is when a down-
stream device receives complete routing information from stream device receives complete routing information from
the DUT, it can be inferred that the DUT has transmitted the DUT, it can be inferred that the DUT has transmitted
all the routing information available. External measure- all the routing information available. External measure-
ments suffer in that they include not just the protocol ments suffer in that they include not just the protocol
action times, but also propagation delays, queuing delays, action times, but also propagation delays, queuing delays,
and other such factors. and other such factors.
For the purposes of [BENCHMARK], external techniques are For the purposes of [BENCHMARK], external techniques are
more readily applicable. more readily applicable.
o Multi-device Measurements o Multi-device Measurements
- Definition
Multi-device measurements require the measurement of
events occurring on multiple devices within the testbed.
- Discussion
For instance, the timestamp on a device generating an
event could be used as the marker for the beginning of a
test, while the timestamp on the DUT or some other device
might be used to determine when the DUT has finished pro-
cessing the event.
These sorts of measurements are the most problematic, and
are to be avoided where possible, since the timestamps of
the devices in the test bed must be synchronized within
milliseconds for the test results to be meaningful. Given
the state of network time protocol implementation, expect-
ing the timestamps on several devices to be within mil-
liseconds of each other is highly optimistic.
5. Terms Defined Elsewhere 5. Terms Defined Elsewhere
Terms in this section are defined elsewhere, and included only to Terms in this section are defined elsewhere, and included only to
include a discussion of those terms in reference to [BENCHMARK]. include a discussion of those terms in reference to [BENCHMARK].
o Point-to-Point links o Point-to-Point links
- Definition - Definition
See [OSPF], Section 1.2. See [OSPF], Section 1.2.
 End of changes. 

This html diff was produced by rfcdiff 1.23, available from http://www.levkowetz.com/ietf/tools/rfcdiff/