论文标题
在非指数工作规模的情况下,具有有限最大队列长度的负载平衡器的性能
Performance of Load Balancers with Bounded Maximum Queue Length in case of Non-Exponential Job Sizes
论文作者
论文摘要
在大规模的分布式系统中,以有效的方式平衡负载对于达到低潜伏期至关重要。最近,已经提出了一些负载平衡策略,这些策略能够在大规模限制中实现有限的最大队列长度。但是,到目前为止,这些政策仅在指数工作规模的情况下才被研究。随着工作规模在实际系统中的变化更大,我们研究了这些策略(尤其是这些范围的价值)的性能如何受工作规模分布的影响。 我们提出了一个统一的分析,该分析可用于计算四个负载平衡策略的相类型分布式作业大小,以计算队列长度上的结合。我们发现,在大多数情况下,最大队列长度上的结合可以以封闭形式表示。此外,我们获得了预期响应时间的工作规模(in)依赖性范围。 我们的方法依赖于空腔过程的使用。也就是说,我们猜测,随着系统大小的增长,空腔过程捕获了实际系统的行为。对于每个策略,我们通过模拟说明了空腔过程的准确性。
In large-scale distributed systems, balancing the load in an efficient way is crucial in order to achieve low latency. Recently, some load balancing policies have been suggested which are able to achieve a bounded maximum queue length in the large-scale limit. However, these policies have thus far only been studied in case of exponential job sizes. As job sizes are more variable in real systems, we investigate how the performance of these policies (and in particular the value of these bounds) is impacted by the job size distribution. We present a unified analysis which can be used to compute the bound on the queue length in case of phase-type distributed job sizes for four load balancing policies. We find that in most cases, the bound on the maximum queue length can be expressed in closed form. In addition, we obtain job size (in)dependent bounds on the expected response time. Our methodology relies on the use of the cavity process. That is, we conjecture that the cavity process captures the behaviour of the real system as the system size grows large. For each policy, we illustrate the accuracy of the cavity process by means of simulation.