A contraction approach to dynamic optimization problems

  1. Sandal, Leif K.
  2. Morán, Manuel
  3. Kvamsdal, Sturla F.
  4. Maroto, José M.
Revista:
PLOS ONE

ISSN: 1932-6203

Any de publicació: 2021

Volum: 16

Número: 11

Pàgines: 1-23

Tipus: Article

DOI: 10.1371/JOURNAL.PONE.0260257 GOOGLE SCHOLAR lock_openAccés obert editor

Altres publicacions en: PLOS ONE

Objectius de Desenvolupament Sostenible

Resum

An infinite-horizon, multidimensional optimization problem with arbitrary yet finite periodicity in discrete time is considered. The problem can be posed as a set of coupled equations. It is shown that the problem is a special case of a more general class of contraction problems that have unique solutions. Solutions are obtained by considering a vector-valued value function and by using an iterative process. Special cases of the general class of contraction problems include the classical Bellman problem and its stochastic formulations. Thus, our approach can be viewed as an extension of the Bellman problem to the special case of nonautonomy that periodicity represents, and our approach thereby facilitates consistent and rigorous treatment of, for example, seasonality in discrete, dynamic optimization, and furthermore, certain types of dynamic games. The contraction approach is illustrated in simple examples. In the main example, which is an infinite-horizon resource management problem with a periodic price, it is found that the optimal exploitation level differs between high and low price time intervals and that the solution time paths approach a limit cycle.

Referències bibliogràfiques

  • Kvamsdal SF, Maroto JM, Morán M, Sandal LK. Bioeconomic modeling of seasonal fisheries. European Journal of Operational Research. 2020;281(2): 332–340. View ArticleGoogle Scholar
  • Maroto JM, Morán M, Sandal LK, Steinshamn SI. Potential collapse in fisheries with increasing returns and stock-dependent costs. Marine Resource Economics. 2012;27: 43–63. View ArticleGoogle Scholar
  • Kvamsdal SF, Maroto JM, Morán M, Sandal LK. A bridge between continuous and discrete-time bioeconomic models: Seasonality in fisheries. Ecological Modelling. 2017;364: 124–131. View ArticleGoogle Scholar
  • Ni Y, Sandal LK. Seasonality matters: A multi-season, multi-state dynamic optimization in fisheries. European Journal of Operational Research. 2019;275(2): 648–658. View ArticleGoogle Scholar
  • Cappers P, Goldman C, Kathan D. Demand response in U.S. electricity markets: Empirical evidence. Energy. 2010;35(4): 1526–1535. View ArticleGoogle Scholar
  • McClain JO, Thomas J. Horizon effects in aggregate production planning with seasonal demand. Management Science. 1977;23(7): 728–736. View ArticleGoogle Scholar
  • Bradley JR, Arntzen BC. The simultaneous planning of production, capacity, and inventory in seasonal demand environments. Operations Research. 1999;47(6): 795–806. View ArticleGoogle Scholar
  • Nagaraja CH, Thavaneswaran A, Appadoo SS. Measuring the bullwhip effect for supply chains with seasonal demand components. European Journal of Operational Research. 2015;242(2): 445–454. View ArticleGoogle Scholar
  • Besbes O, Lobel I. Intertemporal price discrimination: structure and computation of optimal policies. Management Science. 2015;61(1): 92–110. View ArticleGoogle Scholar
  • Liebchen C. The first optimized railway timetable in practice. Transportation Science. 2008;42(4): 420–435. View ArticleGoogle Scholar
  • Smith MD. The new fisheries economics: incentives across many margins. Annual Review of Resource Economics. 2012;4: 379–429. View ArticleGoogle Scholar
  • Huang L, Smith MD. The dynamic efficiency costs of common-pool resource exploitation. The American Economic Review. 2014;104(12): 4071–4103. View ArticleGoogle Scholar
  • Bertsekas DP. Dynamic programming and optimal control. US: Athena Scientific; 2001.
  • Stokey N.L., Lucas R., Prescott E. Recursive methods in economic dynamics. Cambridge, US: Harvard University Press; 1989.
  • Ostrom E, Gardner R, Walker J. Rules, games, & common-pool resources. Ann Arbor, US: The University of Michigan Press; 1994.
  • Holland DS. Optimal intra-annual exploitation of the Maine lobster fishery. Land Economics. 2011;87(4): 699–711. View ArticleGoogle Scholar
  • Birkenbach AM, Cojocaru AL, Asche F, Guttormsen AG, Smith MD. Seasonal harvest patterns in multispecies fisheries. Environmental and Resource Economics. 2020;75: 631–655.