论文标题
使用Moreau-Yosida正则化稳定双层高参数优化
Stabilizing Bi-Level Hyperparameter Optimization using Moreau-Yosida Regularization
论文作者
论文摘要
这项研究建议使用Moreau-Yosida包膜来稳定双级高参数优化求解器的收敛行为，并引入称为Moreau-Yosida正规化超参数优化（MY-HPO）算法的新算法。还提供了有关My-HPO解决方案正确性和初始收敛分析的理论分析。与最先进的BI级HPO求解器相比，我们的经验结果显示，固定计算预算的损耗值显着提高。
This research proposes to use the Moreau-Yosida envelope to stabilize the convergence behavior of bi-level Hyperparameter optimization solvers, and introduces the new algorithm called Moreau-Yosida regularized Hyperparameter Optimization (MY-HPO) algorithm. Theoretical analysis on the correctness of the MY-HPO solution and initial convergence analysis is also provided. Our empirical results show significant improvement in loss values for a fixed computation budget, compared to the state-of-art bi-level HPO solvers.
