论文标题
不受拥挤的超量梯度上升的多目标优化
Multi-objective Optimization by Uncrowded Hypervolume Gradient Ascent
论文作者
论文摘要
进化算法(EAS)是解决黑框多目标优化问题的首选方法,但是当目标函数的梯度可用时,有效利用这些问题并不直接。相比之下,基于梯度的优化已建立了良好的单目标优化。因此,多目标问题的单瞄准性重新重新制作可以提供解决方案。这一目的特别令人感兴趣的是最近引入的不受欢迎的Hypervolume(UHV)指标,该指标考虑到主导的解决方案。在这项工作中,我们表明通常可以计算UHV的梯度,从而可以直接应用梯度上升算法。我们将这种新方法与两种EAS进行了比较,以进行UHV优化以及一种基于梯度的算法,以优化良好的超量。在几个双向目标基准上,我们发现,只要有多个目标功能的确切梯度,并且在较小的评估预算的情况下,基于梯度的算法的表现优于测试的EAS,并且较少的评估。但是,对于较大的预算,EAS的性能类似或更高。我们进一步发现,当使用有限差异来近似多个目标的梯度时,我们新的基于梯度的算法在大多数考虑的基准中仍然与EAS具有竞争力。实施可从https://github.com/scmaree/uncrowded-hypervolume获得。
Evolutionary algorithms (EAs) are the preferred method for solving black-box multi-objective optimization problems, but when gradients of the objective functions are available, it is not straightforward to exploit these efficiently. By contrast, gradient-based optimization is well-established for single-objective optimization. A single-objective reformulation of the multi-objective problem could therefore offer a solution. Of particular interest to this end is the recently introduced uncrowded hypervolume (UHV) indicator, which takes into account dominated solutions. In this work, we show that the gradient of the UHV can often be computed, which allows for a direct application of gradient ascent algorithms. We compare this new approach with two EAs for UHV optimization as well as with one gradient-based algorithm for optimizing the well-established hypervolume. On several bi-objective benchmarks, we find that gradient-based algorithms outperform the tested EAs by obtaining a better hypervolume with fewer evaluations whenever exact gradients of the multiple objective functions are available and in case of small evaluation budgets. For larger budgets, however, EAs perform similarly or better. We further find that, when finite differences are used to approximate the gradients of the multiple objectives, our new gradient-based algorithm is still competitive with EAs in most considered benchmarks. Implementations are available at https://github.com/scmaree/uncrowded-hypervolume.