Optimal Radio Frequency Energy Harvesting With Limited Energy Arrival Knowledge
Journal article, 2016

We develop optimal sleeping and harvesting policies for radio frequency (RF) energy harvesting devices, formalizing the following intuition: when the ambient RF energy is low, devices consume more energy being awake than what can be harvested and should enter sleep mode; when the ambient RF energy is high, on the other hand, it is essential to wake up and harvest. Toward this end, we consider a scenario with intermittent energy arrivals described by a two-state Gilbert-Elliott Markov chain model. The challenge is that the state of the Markov chain can only be observed during the harvesting action, and not while in sleep mode. Two scenarios are studied under this model. In the first scenario, we assume that the transition probabilities of the Markov chain are known and formulate the problem as a partially observable Markov decision process (POMDP). We prove that the optimal policy has a threshold structure and derive the optimal decision parameters. In the practical scenario where the ratio between the reward and the penalty is neither too large nor too small, the POMDP framework and the threshold-based optimal policies are very useful for finding non-trivial optimal sleeping times. In the second scenario, we assume that the Markov chain parameters are unknown and formulate the problem as a Bayesian adaptive POMDP and propose a heuristic posterior sampling algorithm to reduce the computational complexity. The performance of our approaches is demonstrated via numerical examples.

CHANNELS

DEVICES

NETWORKS

NODES

MARKOV DECISION-PROCESSES

MANAGEMENT POLICIES

TRANSMISSION

partially observable Markov decision process

ambient radio frequency energy

Energy harvesting

Author

Z. H. Zou

Royal Institute of Technology (KTH)

Chalmers, Signals and Systems, Communication, Antennas and Optical Networks

Qamcom Research & Technology

A. Gidmark

Chalmers, Signals and Systems, Communication, Antennas and Optical Networks

Themistoklis Charalambous

Chalmers, Signals and Systems, Communication, Antennas and Optical Networks

Mikael Johansson

Royal Institute of Technology (KTH)

IEEE Journal on Selected Areas in Communications

0733-8716 (ISSN) 15580008 (eISSN)

Vol. 34 12 3528-3539 7543484

Subject Categories

Telecommunications

DOI

10.1109/JSAC.2016.2600364

More information

Latest update

4/5/2022 7