• Journal of Internet Computing and Services
    ISSN 2287 - 1136 (Online) / ISSN 1598 - 0170 (Print)
    https://jics.or.kr/

A Q-learning based channel access scheme for cognitive radios


Young-Doo Lee, In-Soo Koo, Journal of Internet Computing and Services, Vol. 12, No. 3, pp. 77-88, Jun. 2011
Full Text:
Keywords: cognitive radio, channel access, spectrum sensing, Q-learning

Abstract

In distributed cognitive radio networks, cognitive radio devices which perform the channel sensing individually, are seriously affected by radio channel environments such as noise, shadowing and fading such that they can not property satisfy the maximum allowable interference level to the primary user. In the paper, we propose a Q-learning based channel access scheme for cognitive radios so as to satisfy the maximum allowable interference level to the primary user as well as to improve the throughput of cognitive radio by opportunistically accessing on the idle channels. In the proposed scheme, the pattern of channel usage of the primary user will be learned through Q-learning during the pre-play learning step, and then the learned channel usage pattern will be utilized for improving the sensing performance during the Q-learning normal operation step. Through the simulation, it is shown that the proposed scheme can provide bettor performance than the conventional energy detector in terms of the interference level to primary user and the throughput of cognitive radio under both AWGN and Rayleigh fading channels.


Statistics
Show / Hide Statistics

Statistics (Cumulative Counts from November 1st, 2017)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article
[APA Style]
Lee, Y. & Koo, I. (2011). A Q-learning based channel access scheme for cognitive radios. Journal of Internet Computing and Services, 12(3), 77-88.

[IEEE Style]
Y. Lee and I. Koo, "A Q-learning based channel access scheme for cognitive radios," Journal of Internet Computing and Services, vol. 12, no. 3, pp. 77-88, 2011.

[ACM Style]
Young-Doo Lee and In-Soo Koo. 2011. A Q-learning based channel access scheme for cognitive radios. Journal of Internet Computing and Services, 12, 3, (2011), 77-88.