draft-ietf-bmwg-ospfconv-term-05.txt   draft-ietf-bmwg-ospfconv-term-06.txt 
Network Working Group Vishwas Manral Network Working Group Vishwas Manral
Internet Draft Netplane Systems Internet Draft Netplane Systems
Russ White Russ White
Cisco Systems Cisco Systems
Aman Shaikh Aman Shaikh
Expiration Date: December 2003 University of California Expiration Date: March 2004 University of California
File Name: draft-ietf-bmwg-ospfconv-term-05.txt June 2003
OSPF Benchmarking Terminology and Concepts OSPF Benchmarking Terminology and Concepts
draft-ietf-bmwg-ospfconv-term-05.txt draft-ietf-bmwg-ospfconv-term-06.txt
1. Status of this Memo 1. Status of this Memo
This document is an Internet-Draft and is in full conformance with This document is an Internet-Draft and is in full conformance with
all provisions of Section 10 of RFC2026. all provisions of Section 10 of RFC2026.
Internet Drafts are working documents of the Internet Engineering Internet Drafts are working documents of the Internet Engineering
Task Force (IETF), its Areas, and its Working Groups. Note that other Task Force (IETF), its Areas, and its Working Groups. Note that other
groups may also distribute working documents as Internet Drafts. groups may also distribute working documents as Internet Drafts.
skipping to change at page 2, line 21 skipping to change at page 2, line 21
4. Common Definitions 4. Common Definitions
Definitions in this section are well known industry and benchmarking Definitions in this section are well known industry and benchmarking
terms which may be defined elsewhere. terms which may be defined elsewhere.
o White Box (Internal) Measurements o White Box (Internal) Measurements
- Definition - Definition
White Box measurements are measurements taken on the Dev- White Box measurements are measurements reported and col-
ice Under Test (DUT) itself. lected on the Device Under Test (DUT) itself.
- Discussion - Discussion
These measurement rely on output and event recording, These measurement rely on output and event recording,
along with the clocking and timestamping available on the along with the clocking and timestamping available on the
DUT itself. Taking measurements on the DUT may impact the DUT itself. Taking measurements on the DUT may impact the
actual outcome of the test, since it can increase proces- actual outcome of the test, since it can increase proces-
sor loading, memory utilization, and timing factors. Some sor loading, memory utilization, and timing factors. Some
devices may not have the required output readily available devices may not have the required output readily available
for taking internal measurements, as well. for taking internal measurements, as well.
Note: White box measurements can be influenced by the Note: White box measurements can be influenced by the
vendor's implementation of the various timers and process- vendor's implementation of the various timers and process-
ing models. Whenever possible, internal measurements ing models. Whenever possible, internal measurements
should be compared to external measurements to verify and should be compared to external measurements to verify and
validate them. validate them.
o Black Box (External) Measurements Because of the potential for variations in collection and
presentation methods across different DUTs, white box
measurements MUST NOT be used as a basis of comparison in
benchmarks. This has been a guiding principal of Bench-
marking Methodology Working Group.
o Black Box (External) Measurements
- Definition - Definition
Black Box measurements infer the performance of the DUT Black Box measurements infer the performance of the DUT
through observation of its communications with other dev- through observation of its communications with other dev-
ices. ices.
- Discussion - Discussion
One example of a black box measurement is when a down- One example of a black box measurement is when a down-
stream device receives complete routing information from stream device receives complete routing information from
the DUT, it can be inferred that the DUT has transmitted the DUT, it can be inferred that the DUT has transmitted
all the routing information available. External measure- all the routing information available. External measure-
ments suffer in that they include not just the protocol ments of internal operations may suffer in that they
action times, but also propagation delays, queuing delays, include not just the protocol action times, but also pro-
and other such factors. pagation delays, queuing delays, and other such factors.
For the purposes of [BENCHMARK], external techniques are For the purposes of [BENCHMARK], external techniques are
more readily applicable. more readily applicable.
o Multi-device Measurements o Multi-device Measurements
- Measurements assessing communications (usually in combina-
tion with internal operations) between two or more DUTs.
Multi-device measurements may be internal or external.
5. Terms Defined Elsewhere 5. Terms Defined Elsewhere
Terms in this section are defined elsewhere, and included only to Terms in this section are defined elsewhere, and included only to
include a discussion of those terms in reference to [BENCHMARK]. include a discussion of those terms in reference to [BENCHMARK].
o Point-to-Point links o Point-to-Point links
- Definition - Definition
See [OSPF], Section 1.2. See [OSPF], Section 1.2.
 End of changes. 

This html diff was produced by rfcdiff 1.23, available from http://www.levkowetz.com/ietf/tools/rfcdiff/