Computing History · Lessons from Failures

Fitting FDDI Management into an 802 Frame: Ancillary Data and the Unused ALT Field

How FDDI carried station management frames, what the alternative media access control field was specified to select, and why a general-purpose slot in a frame header did not produce the architectural flexibility its designers expected.

Frame formats accumulate fields that exist for reasons the next generation does not share. The FDDI token ring, standardized by ANSI in the late 1980s and adopted by ISO/IEC, is a case study in how a header designed by a committee with a long horizon produced structures that were specified in detail, priced in bytes, and then never used, while the field that did the real work was a two-byte service access point inherited from the IEEE 802 family that FDDI’s designers were not targeting.

The frame as specified

A FDDI frame begins with a preamble of idle symbols, followed by the start delimiter, then the media access control frame control field. The frame control byte’s low four bits carry the class bits: a value that denotes an asynchronous frame, a value for a synchronous frame, and a value for a special frame used to request the token. Its high four bits carry the address length and a bit indicating whether this is an 802-type frame.

After the control field come the destination and source addresses, each six bytes in the standard canonical form, or two bytes in the shortened form the address-length bits select. Then the information field, then the frame check sequence, the end delimiter, and the frame status symbols. The CRC covers the control field through the information field. A frame’s maximum size depends on the negotiated maximum transmission unit, the largest of which is 4500 bytes, a figure that also matches the maximum payload of the 802.5 token ring frame that a bridge was expected to carry, so a maximum-size token ring frame fits inside a maximum-size FDDI frame without fragmentation.

That relationship is why the number is 4500 and not something derived from FDDI’s own timing. The frame size was chosen to accommodate a bridge’s peer protocol, not by the ring’s properties. A ring with a smaller negotiated unit is legal, and the negotiation is how the ring responds to stations that cannot hold the larger buffer.

The station management frames have their own path. A station management frame is recognized by the frame control field and carries a fixed header with a station management version, frame class, type and identifier, followed by a station management information field whose content ranges from configuration parameters to neighbor information addresses to error log data. Every conforming station must implement the subset of station management that exchanges neighbor addresses, because the ring’s topology discovery depends on it: a station learns its neighbors by receiving their frames and reading the source address, and the management protocol provides the enumeration for management entities.

What the header costs

The specified header is not small. Six bytes of destination plus six of source plus the control byte plus the four-byte CRC plus the delimiter and status overhead puts a floor of about 20 bytes over any payload. For a station management frame carrying a single neighbor’s address, the payload is 6 bytes. The ratio of header to payload on that path is more than 3 to 1, and the entire class of traffic exists to maintain a network whose data path has one of the better header-to-payload ratios available at the time.

The designers knew this. Station management traffic is low-rate and bursty, generated at initialization and when the ring changes. A 100 Mbit/s ring running a station management exchange of a few hundred bytes at ring startup spends no meaningful fraction of its capacity on it. The frame format was optimized for the bulk path and the management path paid the header cost without anyone thinking it a problem, because it was not one.

The field that was meant to be the escape hatch

The 802-type bit in the frame control field exists so that an FDDI frame can carry a frame in the format of the IEEE 802 family, where the information field begins with an LLC header. That header’s service access point fields are the demultiplexing key for everything above the MAC layer, which is why FDDI could carry IPX, AppleTalk, DECnet and IPv4 without a new frame format for each. The EtherType convention of the Ethernet world is the other common form, and the 802-type bit is what lets a station know which convention applies to the bytes it just received.

The alternative-media control field specifies the alternative media access control to be used, part of a station management facility for supporting multiple media access control implementations on one station. This is the interesting design decision because it is an explicit flexibility mechanism: a station can run more than one media access control entity, and the field names which one a frame belongs to.

What the field presupposed is a station with more than one kind of link interface that must present a unified management view, typically a bridge or a concentrator that attaches rings to other media. What actually happened is that endpoints ran one media access control at a time, and bridging equipment used dedicated hardware whose management interface was not the frame format. Protocol variety appeared one layer up, where the service access point already distinguished it. The flexibility was specified, conformance-tested and unused, because the layer at which the need appeared was not the layer the mechanism instrumented.

The cost of a specified capability

An unused capability in a standard is not free. It must be implemented or at least accepted, it must be tested, it must appear in a conformance test suite, and every implementation’s documentation must describe what it does when it receives a frame carrying a value it does not implement. The last of these is the expensive one. A receiver that gets a frame with an unrecognized media access control selector has to decide whether to discard silently, to count it as an error, or to forward it. Each choice is a behaviour that the next implementer must match, and none is dictated by the standard’s primary text.

The general pattern in link-layer design is that flexibility specified before the demand exists is either unexercised or exercised in a way the specification did not anticipate. FDDI’s frame format had room for the 802 world, and the 802 world’s own evolution toward switched Ethernet happened at a layer that did not need FDDI to accommodate it.

Why the ring lost to the switch

The failure that matters historically is not in the frame format. It is in the medium access method, and the frame format is where the medium access method is encoded.

FDDI’s token protocol grants transmission rights by passing a token around a physical ring. A station that receives the token may transmit for a period bounded by a timer, then releases the token by transmitting it to the next station. The ring’s physical extent is therefore the sum of the delays of all stations and all cable segments, and the protocol’s efficiency depends on the ratio of transmission time to ring latency: on a long ring with many stations, the token circulates while stations wait, and the waiting is not productive.

The mitigation is to transmit a frame in fragments and to release the token immediately after transmission rather than waiting for the frame to return, which requires the station to be able to receive its own fragments and is precisely the mechanism that FDDI’s designers added to let a large frame cross a ring with many stations. The token holding time is negotiated at ring initialization and constrained by the target token rotation time, which every station agrees on.

The failure mode is a station with a stuck transmitter. On a ring, every frame passes through every station, so a station that fails to repeat a symbol breaks the ring for every other station. The containment mechanism is the dual ring: stations attach to two counter-rotating rings and wrap their own attachment on detecting a loss of signal, which isolates the failed segment. That is a real solution and it costs a doubling of the cable plant, a wrap decision in every station, and a recovery protocol whose behaviour depends on where in the ring the failure occurred.

A switched Ethernet avoids the problem by construction: the medium in one direction terminates at a switch port. A station that stops transmitting affects its own link. The frame format is simpler, the recovery is per-port, and the aggregate throughput improves with the number of ports because there is no shared medium to share.

Measurement in the wrong place

The comparisons made at the time focused on the ring’s determinism. A token protocol with a negotiated rotation time has a bound on access delay that a contention protocol with exponential backoff cannot state. That bound is real and the quantitative argument for it is correct.

The bound is only useful if the traffic is multiplexed onto a shared medium that a station must wait for. Once the medium is a point-to-point link, there is no access contention to bound, and the delay is dominated by queueing at the switch and by the serialization of frames. The guarantee that the token ring provided became irrelevant rather than wrong, and the frame format that carried the guarantee was carried along with it. The same displacement of a design’s quantitative advantage by a change in the layer beneath it is traced for messaging standards in X.400 Versus SMTP: When a Better-Designed Messaging System Loses.

What the frame format did and did not prevent

FDDI’s address format handled unicast, multicast, and the group addressing needed for its own management frames. Its frame length was chosen to carry a maximal token ring frame, which itself was bounded by the time a station holds the medium. Each of those is a defensible chain of reasoning, and the chain terminates at a medium access method that the market abandoned.

The specified-but-unused alternative media access control field is the sharper lesson. A design that anticipates variety will specify a selector for it. A design that does not know where the variety will appear will place the selector at the place where the committee was looking, which is usually the layer the committee was working on. The variety appeared one layer up, where a two-byte service access point was already sufficient, and the selector was superseded by a field it did not replace.

Frame formats are cheap to extend and expensive to retire. The field that was used in FDDI carried a type code that already existed elsewhere, and the field that was invented for the purpose carried nothing.

References

  1. ANSI X3.239: Fibre Distributed Data Interface (FDDI) — Token Ring Physical Layer Protocol (PHY) — American National Standards Institute
  2. ANSI X3.148: Fibre Distributed Data Interface (FDDI) — Token Ring Media Access Control (MAC) — American National Standards Institute
  3. ISO/IEC 9314-2: Information processing systems — Fibre Distributed Data Interface (FDDI) — Part 2: Token Ring Media Access Control — ISO/IEC
  4. RFC 2467: Transmission of IPv6 Packets over FDDI Networks — IETF