Academia.eduAcademia.edu

Outline

Survey on Load Balancing in Peer-to-Peer Distributed Hash Tables

2000, IEEE Communications Surveys & Tutorials

https://doi.org/10.1109/SURV.2013.060313.00157

Abstract

Peer-to-peer systems represent a radical shift from the classical client-server paradigm in which a centralized server processes requests from all clients. In a peer-to-peer (P2P) system, every "peer" can play the role of a client and a server at the same time, hence sharing responsibilities among all parties. As in practice some peers or connecting links may be heavily loaded in comparison to others, load balancing algorithms are necessary to ensure a fair distribution of the load among participating peers. In this survey, we present load management solutions in P2P systems. According to the level at which they operate, we classify the different approaches into three categories: object placement, routing protocol, and underlay. The first two approaches tackle information lookup and retrieval in the overlay network, while the last one addresses traffic imbalance at the level of the underlying network.

References (66)

  1. B. Godfrey, K. Lakshminarayanan, S. Surana, R. Karp, and I. Stoica, "Load balancing in dynamic structured P2P systems," in Proc. IEEE International Conference on Computer Communications (INFOCOM), Hong Kong, 2004.
  2. S. Serbu, S. Bianchi, P. Kropf, and P. Felber, "Dynamic load sharing in peer-to-peer systems: When some peers are more equal than others," IEEE Internet Comput., vol. 11, no. 4, pp. 53-61, 2007.
  3. S. Prabhavat, H. Nishiyama, N. Ansari, and N. Kato, "On load distri- bution over multipath networks," IEEE Commun. Surveys Tuts., vol. 14, no. 3, pp. 662-680, quarter 2012.
  4. R. I. Davis and A. Burns, "A survey of hard real-time scheduling for multiprocessor systems," ACM Comput. Surv., vol. 43, no. 4, pp. 35:1- 35:44, Oct. 2011.
  5. K. Kenthapadi and G. S. Manku, "Decentralized algorithms using both local and random probes for p2p load balancing," in Proc. 17th Annual ACM Symposium on Parallelism in Algorithms and Architectures (SPAA). New York, NY, USA: ACM, 2005, pp. 135-144.
  6. H. Shen and Y. Zhu, "Plover: A proactive low-overhead file replication scheme for structured p2p systems," in IEEE International Conference on Communications (ICC), 2008, pp. 5619-5623.
  7. L. Garcés-Erice, K. W. Ross, E. W. Biersack, P. A. Felber, and G. Urvoy- Keller, "Topology-centric look-up service," in COST264/ACM 5th In- ternational Workshop on Networked Group Communications (NGC).
  8. Springer, 2003, pp. 58-69.
  9. S. Serbu, P. Kropf, and P. Felber, "Improving the dependability of prefix- based routing in dhts," in Proc. International Conference on the move to meaningful internet systems (OTM), ser. Lecture Notes in Computer Science, no. 4803. Springer Berlin / Heidelberg, 2007, pp. 206-225.
  10. H. Yamamoto, D. Maruta, and Y. Oie, "Replication methods for load balancing on distributed storages in P2P networks," IEICE Trans., vol. 89-D, no. 1, pp. 171-180, 2006.
  11. A. Rowstron and P. Druschel, "Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems," in IFIP/ACM International Conference on Distributed Systems Platforms (Middle- ware), ser. Lecture Notes in Computer Science, R. Guerraoui, Ed., no. 2218. Springer Heidelberg, Germany, 2001, pp. 329-350.
  12. S. Ratnasamy, M. Handley, R. Karp, and S. Shenker, "Topologically- aware overlay construction and server selection," in Proc. IEEE Inter- national Conference on Computer Communications (INFOCOM), June 2002.
  13. I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Balakrishnan, "Chord: A scalable peer-to-peer lookup service for internet applica- tions," in Proc. ACM Special Interest Group on Data Communications (SIGCOMM), 2001, pp. 149-160.
  14. M. Steiner, T. En-Najjary, and E. W. Biersack, "A global view of KAD," in Proc. 7th ACM SIGCOMM conference on Internet measurement, ser. IMC '07. New York, NY, USA: ACM, 2007, pp. 117-122.
  15. P. Maymounkov and D. Mazieres, "Kademlia: A peer-to-peer infor- mation system based on the xor metric," in Proc. 1st International Workshop on Peer-to-Peer Systems, 2002, pp. 53-65.
  16. M. Steiner, W. Effelsberg, and T. En-najjary, "Load reduction in the kad peer-to-peer system," in In Fifth International Workshop on Databases, Information Systems and Peer-to-Peer Computing (DBISP2P, 2007.
  17. D. Carra, M. Steiner, and P. Michiardi, "Adaptive load balancing in KAD," in In Proc. Peer-to-Peer Computing 2011, 2011, pp. 92-101.
  18. S. Ratnasamy, P. Francis, M. Handley, R. Karp, and S. Shenker, "A scalable content addressable network," in Proc. ACM Special Interest Group on Data Communications (SIGCOMM), 2001, pp. 161-172.
  19. S. Seetharaman, V. Hilt, M. Hofmann, and M. Ammar, "Preemptive strategies to improve routing performance of native and overlay layers," in Proc. IEEE International Conference on Computer Communications (INFOCOM), 2007.
  20. P. B. Godfrey and I. Stoica, "Heterogeneity and load balance in distributed hash tables," in Proc. IEEE International Conference on Computer Communications (INFOCOM), 2005.
  21. D. Karger, E. Lehman, T. Leighton, M. Levine, D. Lewin, and R. Pan- igrahy, "Consistent hashing and random trees: Distributed caching protocols for relieving hot spots on the World Wide Web," in Proc. ACM Symposium on Theory of Computing (STOC), 1997, pp. 654-663.
  22. V. King and J. Saia, "Choosing a random peer," in Proc. the twenty- third annual ACM symposium on Principles of distributed computing, ser. PODC '04. New York, NY, USA: ACM, 2004, pp. 125-130.
  23. B. Y. Zhao, L. Huang, J. Stribling, S. C. Rhea, A. D. Joseph, and J. D. Kubiatowicz, "Tapestry: A resilient global-scale overlay for service deployment," IEEE J. Sel. Areas Commun., vol. 22, no. 1, pp. 41-53, 2004.
  24. D. Malkhi, M. Naor, and D. Ratajczak, "Viceroy: A scalable and dynamic emulation of the butterfly," in Proc. 21st ACM Symposium on Principles of Distributed Computing (PODC), 2002, pp. 183-192.
  25. M. F. Kaashoek and D. R. Karger, "Koorde: A simple degree-optimal distributed hash table," in Proc. 2nd International Workshop on Peer- to-Peer Systems, 2003, pp. 323-336.
  26. M. Bienkowski, M. Korzeniowski, and F. M. auf der Heide, "Dynamic load balancing in distributed hash tables," in Proc. 4th International Workshop, IPTPS 2005. Springer-Verlag Berlin / Heidelberg, 2005, pp. 217-225.
  27. A. Rao, K. Lakshminarayanan, S. Surana, R. Karp, and I. Stoica, "Load balancing in structured p2p systems," in Proc. 2nd International Workshop IPTPS 2003. Springer Berlin / Heidelberg, 2003, pp. 68-79.
  28. D. R. Karger and M. Ruhl, "Simple efficient load balancing algorithms for peer-to-peer systems," in Proc. 16th Annual ACM Symposium on Parallelism in Algorithms and Architectures (SPAA). New York, NY, USA: ACM, 2004, pp. 36-43.
  29. J. Ledlie and M. Seltzer, "Distributed, secure load balancing with skew, heterogeneity and churn," in Proc. IEEE International Conference on Computer Communications (INFOCOM), vol. 2. IEEE, 2005, pp. 1419- 1430.
  30. F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica, "Wide- area cooperative storage with CFS," in Proc. ACM Symposium on Operating Systems Principles (SOSP), 2001, pp. 202-215.
  31. D. Wu, Y. Tian, and K.-W. Ng, "Resilient and efficient load balancing in distributed hash tables," J. Network and Computer Applications, vol. 32, no. 1, pp. 45-60, Jan. 2009.
  32. J. Byers, J. Considine, and M. Mitzenmacher, "Simple load balancing for distributed hash tables," in 2nd International Workshop on Peer-to- Peer Systems (IPTPS '03), 2003, pp. 80-87.
  33. M. Mitzenmacher, A. W. Richa, and R. Sitaraman, "The power of two random choices: A survey of techniques and results," in in Handbook of Randomized Computing. Kluwer, 2000, pp. 255-312.
  34. T.-T. Wu and K. Wang, "An efficient load balancing scheme for resilient search in kad peer to peer networks," in IEEE 9th Malaysia International Conference on Communications. IEEE Computer Society, 2009, pp. 759 -764.
  35. E. Cohen and S. Shenker, "Replication strategies in unstructured peer- to-peer networks," in In Proc. ACM Special Interest Group on Data Communications (SIGCOMM), August 2002.
  36. Q. Lv, P. Cao, E. Cohen, K. Li, and S. Shenker, "Search and replication in unstructured peer-to-peer networks," in Proc. 16th international conference on Supercomputing (ICS). New York, NY, USA: ACM, 2002, pp. 84-95.
  37. Q. Wang, K. Daudjee, and M. T. Özsu, "Popularity-aware prefetch in P2P range caching," in Proc. 8th International Conference on Peer- to-Peer Computing (P2P). Washington, DC, USA: IEEE Computer Society, 2008, pp. 53-62.
  38. S. Bianchi, S. Serbu, P. Felber, and P. Kropf, "Adaptive load balancing for DHT lookups," in Proc. 15th International Conference on Computer Communications and Networks (ICCCN), 2006, pp. 411-418.
  39. A. Rowstron and P. Druschel, "Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility," in 18th ACM Symposium on Operating Systems Principles (SOSP), 2001, pp. 188- 201.
  40. M. Roussopoulos and M. Baker, "Cup: Controlled update propagation in peer-to-peer networks," in Proc. 2003 USENIX Annual Technical Conference, 2003.
  41. C. Wang, L. Xiao, Y. Liu, and P. Zheng, "DiCAS: An efficient distributed caching mechanism for P2P systems," IEEE Trans. Parallel Distrib. Syst. (TPDS), vol. 17, no. 10, pp. 1097-1109, 2006.
  42. H. Shen, "An efficient and adaptive decentralized file replication al- gorithm in p2p file sharing systems (EAD)," in Eighth International Conference on Peer-to-Peer Computing, 2008.
  43. V. Gopalakrishnan, B. Silaghi, B. Bhattacharjee, and P. Keleher, "Adap- tive replication in peer-to-peer systems," in Proc. 24th International Conference on Distributed Computing Systems (ICDCS). IEEE Com- puter Society, 2004, pp. 360-369.
  44. L. Yin and G. Cao, "Dup: Dynamic-tree based update propagation in peer-to-peer networks," in Proc. 21st International Conference on Data Engineering, ser. ICDE '05. Washington, DC, USA: IEEE Computer Society, 2005, pp. 258-259.
  45. V. Ramasubramanian and E. G. Sirer, "Beehive: O(1) lookup perfor- mance for power-law query distributions in peer-to-peer overlays," in Proc. 1st conference on Symposium on Networked Systems Design and Implementation (NSDI). USENIX Association, 2004, pp. 8-8.
  46. Y. Xia, A. Dobra, and S. C. Han, "Multiple-choice random network for server load balancing," in Proc. IEEE International Conference on Computer Communications (INFOCOM), 2007, pp. 1982-1990.
  47. K.-L. Huang, T.-Y. Huang, and J. C. Y. Chou, "Lesslog: A logless file replication algorithm for peer-to-peer distributed systems," 18th IEEE International Parallel and Distributed Processing Symposium (IPDPS), vol. 1, p. 82b, 2004.
  48. S. Serbu, P. Kropf, and P. Felber, "Fault-tolerant p2p networks: How dependable is greedy routing?" in Workshop on Dependable Application Support in Self-Organising Networks (DASSON), 2007.
  49. S. Serbu, S. Bianchi, P. Kropf, and P. Felber, "Dynamic load sharing in peer-to-peer systems: When some peers are more equal than others," in Proc. 2006 Montreal Conference on eTechnologies (MCETECH), 2006, pp. 149-156.
  50. T. Locher, S. Schmid, and R. Wattenhofer, "equus: A provably robust and locality-aware peer-to-peer system," in Proc. 6th IEEE International Conference on Peer-to-Peer Computing (P2P). Washington, DC, USA: IEEE Computer Society, 2006, pp. 3-11.
  51. M. Schlosser, M. Sintek, S. Decker, and W. Nejdl, "Hypercup - hypercubes, ontologies and efficient search on P2P networks," in 1st Workshop on Agents and P2P Computing Springer (AP2PC), vol. 2530. Springer Heidelberg, Germany, 2002, pp. 133-134.
  52. J. I. Alvarez-Hamelin, A. C. Viana, and M. D. Amorim, "DHT-based functionalities using hypercubes," in Proc. World Computer Congress (IFIP WCC), vol. 212, 2006, pp. 157-176.
  53. S. Serbu, P. Felber, and P. Kropf, "Hypeer: Structured overlay with flexible-choice routing," Computer Networks: The International Journal of Computer and Telecommunications, vol. 55, no. 1, pp. 300-313, 2011.
  54. T. H. Cormen, C. E. Leiserson, R. L. Rivest, and C. Stein, Introduction to Algorithms, 2nd ed. The MIT Press, 2001.
  55. S. C. Han and Y. Xia, "Network load-aware content distribution in overlay networks," Computer Communications, vol. 32, no. 1, pp. 51- 61, 2009.
  56. M. Castro, P. Druschel, Y. C. Hu, and A. Rowstron, "Topology-aware routing in structured peer-to-peer overlay networks," in International Workshop on Future Directions in Distributed Computing (FuDiCo), June 2002.
  57. Z. Xu, M. Mahalingam, and M. Karlsson, "Turning heterogeneity into an advantage in overlay routing," in Proc. IEEE International Conference on Computer Communications (INFOCOM), vol. 2, march-april 2003, pp. 1499-1509.
  58. T. Asano, D. Ranjan, T. Roos, E. Welzl, and P. Widmayer, "Space- filling curves and their use in the design of geometric data structures," Theoretical Computer Science, vol. 181, pp. 3-15, July 1997.
  59. H. Shen and C.-Z. Xu, "Locality-aware randomized load balancing algorithms for DHT networks," in Proc. 2005 International Conference on Parallel Processing (ICPP). Washington, DC, USA: IEEE Computer Society, 2005, pp. 529-536.
  60. H. Shen, C.-Z. Xu, and G. Chen, "Cycloid: A constant-degree and lookup-efficient p2p overlay network," Performance Evaluation, vol. 63, no. 3, pp. 195 -216, 2006, p2P Computing Systems.
  61. F. Dabek, R. Cox, F. Kaashoek, and R. Morris, "Vivaldi: A decentralized network coordinate system," in Proc. ACM Special Interest Group on Data Communications (SIGCOMM), 2004, pp. 15-26.
  62. T. Kojima, M. Asahara, K. Kono, and A. Hayakawa, "Embedding net- work coordinates into the heart of distributed hash tables," in IEEE 9th International Conference on Peer-to-Peer Computing (P2P). Seattle, WA: IEEE Computer Society, 2009, pp. 155 -158.
  63. V. Aggarwal, O. Akonjang, and A. Feldmann, "Improving user and ISP experience through ISP-aided P2P locality," in Proc. 11th IEEE Global Internet Symposium (GI). IEEE Computer Society, Washington, DC, USA, 2008.
  64. Y. Zhu and Y. Hu, "Efficient, proximity-aware load balancing for structured p2p systems," in Proc. 3rd International Conference on Peer- to-Peer Computing (P2P). Washington, DC, USA: IEEE Computer Society, 2003, p. 220.
  65. N. Efthymiopoulos, A. Christakidis, S. Denazis, and O. Koufopavlou, "Enabling locality in a balanced peer-to-peer overlay," in IEEE Global Telecommunications Conference (GLOBECOM), 2006, pp. 1-5.
  66. C. G. Plaxton, R. Rajaraman, and A. W. Richa, "Accessing nearby copies of replicated objects in a distributed environment," in Proc. the 9th annual ACM symposium on Parallel Algorithms and Architectures (SPAA). New York, NY, USA: ACM, 1997, pp. 311-320.