Header menu link for other important links
X
Adaptive System Optimization Using Random Directions Stochastic Approximation
, Bhatnagar S., Fu M., Marcus S.
Published in Institute of Electrical and Electronics Engineers Inc.
2017
Volume: 62
   
Issue: 5
Pages: 2223 - 2238
Abstract
We present new algorithms for simulation optimization using random directions stochastic approximation (RDSA). These include first-order (gradient) as well as second-order (Newton) schemes. We incorporate both continuous-valued as well as discrete-valued perturbations into both types of algorithms. The former are chosen to be independent and identically distributed (i.i.d.) symmetric uniformly distributed random variables (r.v.), while the latter are i.i.d. asymmetric Bernoulli r.v.s. Our Newton algorithm, with a novel Hessian estimation scheme, requires N-dimensional perturbations and three loss measurements per iteration, whereas the simultaneous perturbation Newton search algorithm of [1] requires 2N -dimensional perturbations and four loss measurements per iteration. We prove the asymptotic unbiasedness of both gradient and Hessian estimates and asymptotic (strong) convergence for both first-order and second-order schemes. We also provide asymptotic normality results, which in particular establish that the asymmetric Bernoulli variant of Newton RDSA method is better than 2SPSA of [1]. Numerical experiments are used to validate the theoretical results. © 1963-2012 IEEE.
About the journal
JournalData powered by TypesetIEEE Transactions on Automatic Control
PublisherData powered by TypesetInstitute of Electrical and Electronics Engineers Inc.
ISSN00189286
Open AccessNo