A lightweight, system-wide global termination detection algorithm that enables vertices to decide locally when the overall system has converged, and emphasises the need for coordinated halting in distributed centrality computation.
Abstract
Computing betweenness centrality on large networks is inherently expensive, as it requires aggregating shortest-path dependencies across all pairs of vertices and becomes increasingly difficult to scale as network size grows. Scalable distributed algorithms can facilitate such computations, particularly when centralised processing is not feasible, and message exchanges must be carefully controlled, for example, in bandwidth-limited or very large-scale networks. However, existing distributed betweenness centrality implementations do not integrate a lightweight, system-wide termination detector. As a consequence, this can lead to extra messaging after local convergence or, if misconfigured, premature stops. In this work, a lightweight, system-wide global termination detection algorithm for this task is presented. The proposed method enables vertices to decide locally when the overall system has converged. The method is evaluated against a local stopping strategy in which vertices terminate individually once their own estimates stabilise. To compare these two approaches, namely global termination detection and local stopping, a custom Python simulator is implemented, and both approaches are tested on synthetic (Erdos-Renyi and geometric) and real (Email and Road) network topologies. Our results show that system-wide termination detection lets vertices stop safely after detecting global convergence, as indicated by zero final error in the evaluated networks, rather than stopping independently based only on local convergence. The local stopping approach, on the other hand, results in premature termination and some errors on heterogeneous networks. This work emphasises the need for coordinated halting in distributed centrality computation.
Betweenness centrality quantifies a node's influence on information spread. While classical shortest-path metrics ignore path redundancy, random walk betweenness centrality considers all possible routes but over-emphasizes circuitous ones. To bridge these extremes, interpolated measures offer a tunable continuum betwee...
Ye-Fei Wang, Qiang-sheng Hua, Wenjie Gao et al.· Fall Joint Computer Conferen...· 0 citations
A novel heuristic community detection algorithm, termed CoDeSEG, which identifies communities by minimizing the network's two-dimensional structural entropy within a potential game framework, and introduces a structural entropy-based node overlapping heuristic for detecting overlapping communities, with a near-linear t...
Pu Li, Yantuan Xian, Hao Peng et al.· arXiv.org· 0 citations
This work proposes two scalable greedy algorithms based on gradient-guided edge selection that efficiently approximate marginal gains and prune the candidate edge set and achieves optimization performance comparable to exact greedy strategies while substantially reducing computational time.
Runze Zhang, Gengyu Wang, Zhong-Zhi Zhang· Proceedings of the 32nd ACM...· 0 citations
Experimental results on both synthetic and real-world HoMLN datasets demonstrate that the heuristics achieve accuracy comparable to the ground truth while significantly improving computational efficiency, thereby establishing the scalability and effectiveness of the HoMLN algorithms developed using the decoupling appro...
A. Ayowole-Obi, Abhishek Santra, Sharma Chakravarthy· 0 citations
Experimental results demonstrate that TWJtr-D significantly reduces computation time and outperforms state-of-the-art methods which process in a similar pattern, highlighting the efficiency of TWJtr-D for triangle detection in large-scale networks.
Sarah Balbouzi, Lougmiri Zekri, Kheira Mechach· ITEGAM- Journal of Engineeri...· 0 citations
This paper presents a production-ready framework deployed at TikTok, which integrates three core contributions to address the challenges of large-scale A/B tests on social platforms, and reduces interference rates by 68.8%, correcting a biased treatment effect estimate and enables previously undetectable cross-ecosyste...
Yu-Han Li, Jian-Yu Ni, Ao Li et al.· Annual International ACM SIG...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.