A probabilistic constrained nonlinear optimization framework to optimize RED parameters

Patro, Rajesh Kumar and Bhatnagar, Shalabh (2009) A probabilistic constrained nonlinear optimization framework to optimize RED parameters. In: Performance Evaluation, 66 (2). pp. 81-104.

PDF 9.pdf - Published Version Restricted to Registered users only Download (9MB) | Request a copy

Abstract

The random early detection (RED) technique has seen a lot of research over the years. However, the functional relationship between RED performance and its parameters viz,, queue weight (omega(q)), marking probability (max(p)), minimum threshold (min(th)) and maximum threshold (max(th)) is not analytically availa ble. In this paper, we formulate a probabilistic constrained optimization problem by assuming a nonlinear relationship between the RED average queue length and its parameters. This problem involves all the RED parameters as the variables of the optimization problem. We use the barrier and the penalty function approaches for its Solution. However (as above), the exact functional relationship between the barrier and penalty objective functions and the optimization variable is not known, but noisy samples of these are available for different parameter values. Thus, for obtaining the gradient and Hessian of the objective, we use certain recently developed simultaneous perturbation stochastic approximation (SPSA) based estimates of these. We propose two four-timescale stochastic approximation algorithms based oil certain modified second-order SPSA updates for finding the optimum RED parameters. We present the results of detailed simulation experiments conducted over different network topologies and network/traffic conditions/settings, comparing the performance of Our algorithms with variants of RED and a few other well known adaptive queue management (AQM) techniques discussed in the literature.

Item Type:	Journal Article
Publication:	Performance Evaluation
Publisher:	Elsevier Science
Additional Information:	Copyright of this article belongs to Elsevier Science.
Keywords:	RED;Probabilistic constrained optimization;SPSA;Adaptive four-timescale stochastic approximation;Modified SPSA for second-order parameter updates; Nonlinear optimization; Barrier method; Penalty method; Monte Carlo simulations
Department/Centre:	Division of Electrical Sciences > Computer Science & Automation
Date Deposited:	13 Nov 2009 09:48
Last Modified:	19 Sep 2010 05:29
URI:	http://eprints.iisc.ac.in/id/eprint/19635

Actions (login required)

View Item