EXPERIMENTAL EVALUATION OF ETHERNET SWITCH PACKET BUFFER STRUCTURES
Victor I. Moiseev, Perm State University, Perm, Russia, vim@psu.ru
Abstract
A method to detect or verify actual packet buffer size of an Ethernet switch with different queuing disciplines presented. In enterprise and datacenter networking environment there exists a need for a method to experimentally verify or measure exactly how deep packet buffers are and which structures and service disciplines do they have. Also there exists lack of published specifications from switch vendors on these topics. Aim. To develop a method to detect queuing discipline and actual buffer sizes of Ethernet switches. Materials and methods. Based on possible buffer architectures we study effects of different engineering decisions on observed traffic patterns. We show how from these patterns internal buffer schemes could be revealed. Buffers are verified on size and priority handling. Buffer sizes estimated on the basis of analyzed packet loss under overload conditions. Results. We present numeric results of buffer size estimation for an Ethernet switch of popular vendor and give some thoughts on how modern complex QoS schemes can be identified and verified. We also show experimental data on packet loss and packet flow structures in several configurations. In some cases incast or outcast collapse effects observed. Conclusion. The method presented is suitable for reliable verification of packet buffer sizes and queue structures in store-and-forward Ethernet switches.
Keywords: scheduling discipline, QoS, packet buffer, priority queue, stress testing.
References
1. Szigeti T., Hattingh C., Barton R., Briley K. End-to-End QoS Network Design: Quality of Service for Rich-Media & Cloud Networks, 2nd Edition. Cisco Press, 2012.- 1040p.
2. Transport of MPEG-2 TS Based DVB Services over IP Based Networks ETSI TS 102 034 V2.1.1 European Broadcasting Union, France, 2016 — 331p.
3. Order of the Ministry of Information Technologies and Communications of the Russian Federation of September 27, 2007 No. 113 «On approval of the Requirements for the organizational and technical support for the stable functioning of the public communications network» [Prikaz Ministerstva informatzionnyh tehnologiy I svyazi Rossiyskoy Federatzii ot 27.09.2007 #113 «Ob otverzhdenii Trebovaniy k organizatzinno-tehnicheskomu obespecheniyu ustoychivogo funktsionirovaniya seti svyazi obshego polzovaniya»] Available at: URL: http://minsvyaz.ru/ru/documents/3921/ (accessed: 01.09.2019).
4. Warner J. Packet buffers Available at: URL: https://people.ucsc.edu/~warner/buffer.html (accessed: 01.02.2019).
5. Arista LANZ Overview Available at: URL: https:// people.ucsc.edu/~warner/Bufs/Arista_LANZ_Overview_TechBulletin_0213.pdf (accessed: 26.09.2019).
6. Mellanox Spectrum vs. Broadcom StrataXGS Tomahawk / Tolly Group, 2016 Available at URL: http://www.mellanox.com/related-docs/products/tolly-report-performance-evaluation-2016-march.pdf (accessed: 10.10.2019).
7. Intel Ethernet Switch Family Memory Efficiency Non-blocking Fabric Architecture Available at: URL: https://people.ucsc.edu/~warner/Bufs/intel-memory-efficiency-paper.pdf (accessed 26.09.2019).
8. Speeding Applications in Data Center Networks Available at URL: https://miercom.com/pdf/reports/20160210.pdf (accessed: 01.10.2019).
9. Grossman D. New Terminology and Clarifications for Diffserv Available at URL: https://tools.ietf.org/html/rfc3260 (accessed: 14.10.2019).
10. IEEE Standard for Local and Metropolitan Area Network—Bridges and Bridged Networks / Institute of Electrical and Electronics Engineers, 2018. Available at: URL: https://ieeexplore.ieee.org/document/8403927 (accessed: 10.10.2019).
11. Moiseev V.I. Switch Packet Buffer Audit Method [Metod audita paketnogo bufera kommutatora]. Vestnik Permskogo Universiteta. Seriya «Informatsionniye Sistemy i Tehnologii». Vol. 1, Perm, 2018, pp. 32-35.
12. Zuckerman M. Introduction to Queueing Theory and Stochastic Teletraffic Models Available at: URL: https://arxiv.org/pdf/1307.2968.pdf (accessed: 14.10.2019).
13. Bradner S., McQuaid J. RFC-2544. Benchmarking Methodology for Network Interconnect Devices Available at: URL: https://www.ietf.org/rfc/rfc2544.txt (accessed 26.09.2019).
14. Garcia J.-M., Brun O., Gauchard D. Transient Analytical Solution of M/D/1/N Queues. Journal of applied Probability. Vol. 39, No. 4 (Dec.,2002), pp. 853-864.
15. PCAP-TSTAMP – packet time stamps in libpcap Available at: URL: https://www.tcpdump.org/manpages/pcap-tstamp.7.txt (accessed: 26.09.2019).
16. Tsukerman A. Buffer size on 3750G Available at: URL: https://people.ucsc.edu/~warner/Bufs/3750G-buf.pdf (accessed: 10.10.2019).
17. Catalyst 2960 and 2960-S Switches Software Configuration Guide, Release 12.2(58)SE Available at: URL: https://www.cisco.com/c/en/us/td/docs/ switches/lan/catalyst2960/software/release/12-2_58_se/configuration/guide/ 2960scg/swqos.html (accessed: 10.10.2019).
18. Chen Y., Griffith R., Liu J., Katz R. Understanding TCP Incast Throughput Collapse in Datacenter Networks. Proceedings of WREN’09, 21 august, 2009, Barcelona, Spain.
19. Prakash P., Dixit A., Kompella R. The TCP Outcast Problem: Exposing Unfairness in Data Center Networks Available at: URL: https://www.usenix.org/ system/files/conference/nsdi12/nsdi12-final126.pdf (accessed: 10.10.2019).
Information about author:
Victor I. Moiseev, Lead programmer of IT-department of Perm State University, assistant professor of Faculty of Physics of Perm State University, Perm, Russia