Compressing IP forwarding tables: Realizing information-theoretical space bounds and fast lookups simultaneously

Attila Korosi, Janos Tapolcai, Bence Mihalka, Gabor Meszaros, Gabor Retvari

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Citations (Scopus)

Abstract

The Internet routing ecosystem is facing compelling scalability challenges, manifested primarily in the rapid growth of IP packet forwarding tables. The forwarding table, implemented at the data plane fast path of Internet routers to drive the packet forwarding process, currently contains about half a million entries and counting. Meanwhile, it needs to support millions of complex queries and updates per second. In this paper, we make the curious observation that the entropy of IP forwarding tables is very small and, what is more, seems to increase at a lower pace than the size of the network. This suggests that a sophisticated compression scheme may effectively and persistently reduce the memory footprint of IP forwarding tables, shielding operators from scalability matters at least temporarily. Our main contribution is such a compression scheme which, for the first time, admits both the required information-theoretical size bounds and attains fast lookups, thanks to aggressive level compression. Although we find the underlying optimization problem NP-complete, we can still give a lightweight heuristic algorithm with firm approximation guarantees. This allows us to squeeze real IP forwarding tables, comprising almost 500, 000 prefixes, to just about 140 - 200 KBytes of memory within a factor of 2 - 3 of the entropy bound, so that forwarding decisions take only 8 - 10 memory accesses on average and updates are supported efficiently. Our compression scheme may be of more general interest, as it is applicable to essentially any prefix tree.

Original languageEnglish
Title of host publicationProceedings - IEEE 22nd International
PublisherIEEE Computer Society
Pages332-343
Number of pages12
ISBN (Electronic)9781479962044
DOIs
Publication statusPublished - Dec 9 2014
Event22nd IEEE International Conference on Network Protocols, ICNP 2014 - Research Triangle, United States
Duration: Oct 21 2014Oct 24 2014

Publication series

NameProceedings - International Conference on Network Protocols, ICNP
ISSN (Print)1092-1648

Other

Other22nd IEEE International Conference on Network Protocols, ICNP 2014
CountryUnited States
CityResearch Triangle
Period10/21/1410/24/14

    Fingerprint

Keywords

  • IP forwarding
  • data compression
  • prefix trees

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Software

Cite this

Korosi, A., Tapolcai, J., Mihalka, B., Meszaros, G., & Retvari, G. (2014). Compressing IP forwarding tables: Realizing information-theoretical space bounds and fast lookups simultaneously. In Proceedings - IEEE 22nd International (pp. 332-343). [6980394] (Proceedings - International Conference on Network Protocols, ICNP). IEEE Computer Society. https://doi.org/10.1109/ICNP.2014.55