Optimal WiFi Sensing via Dynamic Programming

Kumar, Abhinav and Pillai, Sibi Raj B and Vaze, Rahul and Gopalan, Aditya (2015) Optimal WiFi Sensing via Dynamic Programming. In: 13th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt), MAY 25-29, 2015, Mumbai, INDIA, pp. 54-61.

PDF WIOPT_54_2015.pdf - Published Version Restricted to Registered users only Download (167kB) | Request a copy

Abstract

The problem of finding an optimal sensing schedule for a mobile device that encounters an intermittent WiFi access opportunity is considered. At any given time, the WiFi is in any of the two modes, ON or OFF, and the mobile's incentive is to connect to the WiFi in the ON mode as soon as possible, while spending as little sensing energy. We introduce a dynamic programming framework which enables the characterization of an explicit solution for several models, particularly suitable when the OFF periods are exponentially distributed. While the problem for non-exponential OFF periods is ill-posed in general, a usual workaround in literature is to make the mobile device aware if one ON period is completely missed. In this restricted setting, using the DP framework, the deterministic nature of the optimal sensing policy is established, and value iterations are shown to converge to the optimal solution. Finally, we address the blind situation where the distributions of ON and OFF periods are unknown. A continuous bandit based learning algorithm that has vanishing regret (loss compared to the optimal strategy with the knowledge of distributions) is presented, and comparisons with the optimal schemes are provided for exponential ON and OFF periods.

Item Type:	Conference Proceedings
Additional Information:	Copy right for this article belongs to the IEEE, 345 E 47TH ST, NEW YORK, NY 10017 USA
Department/Centre:	Division of Electrical Sciences > Electrical Communication Engineering
Date Deposited:	08 Oct 2016 05:37
Last Modified:	08 Oct 2016 05:37
URI:	http://eprints.iisc.ac.in/id/eprint/54723

Actions (login required)

View Item