Routing Betweenness Centrality: Under Source-Oblivious Loop-Free Routing, the Betweenness of a Node Sequence Is a Sum over Targets of Chained Pairwise DependenciesResearch Paper
Motivation
Betweenness centrality measures how much of the communication in a network passes through a node. Freeman's original measure (Freeman 1977) counts the fraction of shortest paths between each pair of nodes that pass through it, and Brandes' algorithm (Brandes 2001) made it computable on large graphs. Variants replace shortest paths by maximum flows (Freeman, Borgatti and White 1991), random walks (Newman 2005) or load-splitting rules (Goh, Kahng and Kim 2001), and group variants measure the traffic that passes through a set of nodes (Everett and Borgatti 1999).
Dolev, Elovici and Puzis (technical report 2009, J. ACM 2010) define routing betweenness centrality (RBC): given the actual routing scheme of a communication network and its traffic matrix, the RBC of a node is the expected number of packets that pass through it. Each of the measures above is a special choice of routing scheme. The application is the placement of traffic monitors: the RBC of an ordered sequence of monitors is the expected number of packets sampled by all of them in order, which measures, for example, redundant inspection along a path.
Setting
Let be a finite set of nodes. A routing scheme assigns to every source , current node , next node and target a number , the probability that forwards to a packet with source address and target address . Routing decisions are independent. The scheme is assumed to be
- nonnegative;
- total: every node forwards a packet targeted at with total probability one, , and the target forwards nothing;
- loop-free: for every pair the directed graph with an arc whenever is acyclic;
- source-oblivious where stated: does not depend on .
A route from to is a sequence of nodes from to whose every hop has positive forwarding probability; its probability is the product of the hop probabilities. For nodes and a sequence :
- the pairwise dependency is the total probability of the routes from to that visit ;
- the sequence dependency is the total probability of the routes from to that visit , then , …, then (consecutive repetitions in collapsed).
A traffic matrix gives the number of packets sent from to , and sampling rates give the fraction of passing packets a monitor at samples. The target dependency is , and the RBC of the sequence of distinct nodes is
Formalization targets
Goal: sequence RBC as a sum over targets of chained dependencies
For a source-oblivious scheme and a sequence of distinct nodes, ,
The right side is the value returned by the paper's Algorithm 6. The identity contains no running time and no constant: it states the exact equality the algorithm relies on.
Milestones
- Proposition 1: for a loop-free scheme (not necessarily source-oblivious), two different orderings of the same set of nodes cannot both have positive sequence dependency.
- Lemma 1 (Dependency chaining): for , .
- Eq. (16): for , .
- Eq. (17): .
- Eq. (1) (off the goal's path): and for , the sum over predecessors of .
- Eq. (9) (off the goal's path): for source-oblivious schemes.
Significance
The goal reduces the RBC of a sequence of monitors to arithmetic on precomputed single-node quantities, instead of a pass over the routing graph of every source–target pair. This is what makes repeated evaluation of candidate monitor sequences, as in greedy or search-based placement, affordable on large networks. Eqs. (1) and (9) are the recursions behind the paper's algorithms for the RBC of single nodes; Eq. (9) replaces the loop over all source–target pairs by a loop over targets.
The paper's proof of Lemma 1 is an argument about conditional probabilities of informally described events. A formalization fixes what "the probability that a packet passes through " means, as a sum over a finite set of routes, and checks the factorization against that definition, including the corner cases the prose passes over: sequences with repeated nodes, a first node equal to the source or to the target, and the source in the sum over all sources. No machine-checked version of these identities is known.
Difficulty
Dependency chaining is a Markov property: after the packet reaches , its future does not depend on its past. The obvious argument splits every route through into a prefix ending at and a suffix starting there. Two points need care. First, the suffix must be a route of a packet with source , which is where source-obliviousness enters; for source-dependent routing the lemma is false. Second, the prefix probabilities must sum to while the suffix probabilities sum to one, which requires that no packet is lost: this is where totality of the forwarding probabilities and loop-freeness (every walk reaches the target in at most steps) are needed. The passage from Lemma 1 to the goal then requires the sum over all sources, including , where Lemma 1 does not apply.
Formalization scope
Nodes form a type V with [Fintype V] [DecidableEq V]; probabilities, traffic and sampling rates are real numbers; sequences are Lean lists, indexed from . Routes are repetition-free lists, and every dependency is a finite sum over them; no infinite sums, suprema or measure theory are used. The definitions file bundles the standing assumptions in IsRoutingScheme and source-obliviousness in IsSourceOblivious.
The paper's probabilities are informal. The following readings are explicit:
- every non-target node forwards with total probability one (implicit in the paper; without it Lemma 1 fails);
- the target forwards nothing;
- the paper's convention is not adopted (it contradicts loop-freeness); collapsing consecutive repetitions in reproduces its only use;
- the "don't care" source of Eq. (9) is an arbitrary fixed node, harmless under source-obliviousness;
- the printed index slips in Eqs. (16) and (17) are corrected;
- no sign condition is imposed on ; is kept in the goal as on the page.
Defining by the recursion (3) or the product (16), the target sequence dependency by (17), or the sequence RBC as the sum over targets of the chained product would make the goal true by definition; every dependency here is a sum of route probabilities, and the RBC of a sequence is the double sum of Eq. (4).
The running-time claims of the paper are out of scope. Lemma 2 of the paper (p. 17) is false as printed for a nonempty monitor set and is not posed. Contributions welcome: proofs of the milestones, a general lemma that the total route probability from any node is one under a total loop-free scheme (reusable for absorbing Markov chains on finite DAGs), and the prefix–suffix decomposition of routes.
Selected references
- S. Dolev, Y. Elovici, R. Puzis, Routing Betweenness Centrality, Technical Report #2009-09, Ben-Gurion University of the Negev, 2009; J. ACM 57(4), 2010. https://doi.org/10.1145/1734213.1734219
- L. C. Freeman, A set of measures of centrality based on betweenness, Sociometry 40(1), 1977. https://doi.org/10.2307/3033543
- U. Brandes, A faster algorithm for betweenness centrality, J. Math. Sociology 25(2), 2001. https://doi.org/10.1080/0022250X.2001.9990249
- L. C. Freeman, S. P. Borgatti, D. R. White, Centrality in valued graphs: a measure of betweenness based on network flow, Social Networks 13, 1991. https://doi.org/10.1016/0378-8733(91)90017-N
- M. E. J. Newman, A measure of betweenness centrality based on random walks, Social Networks 27, 2005. https://doi.org/10.1016/j.socnet.2004.11.009
- K.-I. Goh, B. Kahng, D. Kim, Universal behavior of load distribution in scale-free networks, Phys. Rev. Lett. 87, 2001. https://doi.org/10.1103/PhysRevLett.87.278701
- M. G. Everett, S. P. Borgatti, The centrality of groups and classes, J. Math. Sociology 23(3), 1999. https://doi.org/10.1080/0022250X.1999.9990219