セミナーシリーズ
マクロ経済学セミナー（2025.5.22）（京都大学経済研究所マクロ経済学・経済システム研究会と共催）
John Stachurski（Australian National University）
- 開催日：
- 2025年5月22日（木）15:00～16:30
- 場所：
- 京都大学 吉田キャンパス 経済研究所北館2階 N202
- 言語：
- 英語
- コーディネーター：
- 安井 大真
“Dynamic Programming: From Local Optimality to Global Optimality”
Abstract:
In the theory of dynamic programming, an optimal policy is a policy whose lifetime value dominates that of all other policies from every possible initial condition in the state space. This raises a natural question: when does optimality from a single state imply optimality from every state? Working in a general setting, we provide sufficient conditions for this property that relate to reachability and irreducibility. Our results have significant implications for modern policy-based algorithms used to solve large-scale dynamic programs. We illustrate our findings by applying them to an optimal savings problem via an algorithm that implements gradient ascent in a policy space constructed from neural networks.