Multiple connections & design complexity

[csapuntz@cisco.com]

There has been significant comment that using multiple connections
per session adds significantly to complexity of the design.
This message is an attempt to describe the complexity exactly.
I hope that you'll agree with me that the complexity is not onerous.

There are two ways in which multiple connections are used in iSCSI:

1) Multiple simultaneous TCP connections for bandwidth
	
2) Multiple TCP connections for fault tolerance/recovery
	(i.e. when one TCP connection in a session dies, 
         another one starts up)

The features in iSCSI that come out of #1:
Command Reference Number
Expected Command Reference Number (not strictly necessary if the window never
    shrinks)
Max Command Reference Number
Session ID

The features in iSCSI that come out of #2:
Status Reference Number
Expected Status Reference Number
Session ID
Recovery bit in opcode field
Connection IDs for TCP connections

And the following iSCSI opcode has been suggested by some for recovery:
Terminate TCP connection

-Costa