4. Resultater
4.2. Elevmedvirkning i praksis
4.2.1. Hvordan tilrettelegge for- og bruke elevmedvirkning i undervisningen?
As perspectivas de trabalhos futuros são listadas abaixo:
Utilizar a abordagem de Aprendizagem por Reforço em equalização adaptativa; Executar testes com outros algoritmos de controle de potência;
Testar o comportamento do algoritmo AR com outras modulações; Testar o algoritmo CMA-DD com AR e CMA em outros canais. Utilizar ε-adaptativa para a política de escolha das ações;
Realizar o treinamento on-line aperfeiçoado com a política ε-adaptativa.
Referências
Ahmad, F., Zhang, Y., Amin, M. G. Three Dimensional Wideband Beamforming for
Imaging Through a Single Wall, IEEE Geoscience and Remote Sensing Letters,
vol. 5, n.2, pp. 176-179, Abril 2008.
Alves, D. P., Weigang, L., Souza, B. B. de. Using meta-level control with reinforcement
learning to improve the performance of the agents. Em: FSKD, pp. 1109-1112,
2006.
Anitha, M.; Kurahatti, N.G. Neural Fuzzy Inference Based Robust Adaptive
Beamforming. Int. J. Emerg. Technol. Adv. Eng., 3, 641–648, 2013.
Ashmawy, D., Abdel-Raheem, E., Mansour, H., Youssif, M., Mohanna, M. FPGA
Implementation of Blind Adaptive Decision Feedback Equalizer, International
Symposium on Signal Processing and Information Technology (ISSPIT), pp. 495- 500, 2009.
Balanis, C.A. Antenna Theory: Analysis and Design, 3rd ed.; Wiley-Interscience: New York, NY, USA, 2005.
Barton, P. Digital Beam Forming for Radar. IEEE Proceedings Communications, Radar and Signal Processing, v. 127, n. 4, pp. 266-277, Agosto 1980.
Bertsekas, D. Dynamic programming and optimal control. Belmont, MA: Athena Scientific. ISBN 1-886259-08-6, 2001.
Blom, K. C. H., Burgwal, M. D. Van de., Rovers, K. C., Kokkeler, A. B. J., Smit, G. J. M. Angular CMA: A modified Constant Modulus Algorithm providing steering
angle updates. The Seventh International Conference on Wireless and Mobile
Communications (ICWMC), pp. 42-47, June, 2011.
Bond, E. J., Li, X., Hagness, Susan C., Van Veen, B. D. Microwave Imaging via Space-
Time Beamforming for Early Detection of Breast Cancer, IEEE Trans. on Ant.
Prop. Vol. 51, n.8, pp. 1690-1705, Agosto 2003.
Castro, F. C. C de. Desconvolução Autodidata Concorrente para Equalização de
Canais de Comunicações. Tese de doutorado, Faculdade de Engenharia Elétrica e
Chang, Y., Pao, W. Symmetry-Constrained Concurrent CMA and DD Algorithm for
Adaptive Multi-Antenna System, IEEE 78th Vehicular Technology Conference,
pp. 1-5, September, 2013.
Chen, S., Yao, W., Hanzo, L. CMA and Soft Decision-Directed Scheme for Semi-Blind
Beamforming of QAM Systems, IEEE 68th Vehicular Technology Conference, pp.
1-5, September, 2008.
Chen, S., Yao, W., Hanzo, L. Semi-blind Adaptive Beamforming for High-throughput
Quadrature Amplitude Modulation Systems, International Journal of Automation
and Computing, pp. 565 – 570, November 2010.
Chi, C. Y., Feng, C. C., Chen, C. H., Chen, C. Y. Blind Equalization and System
Identification: Batch Processing Algorithms, Performance and Applications.
Springer-Verlag Inc., Secaucus, NJ, USA, 2006.
Ernst, D., Stan, G. B., Gonçalves, J., Wehenkel, L. Clinical data based optimal STI
strategies for HIV: a reinforcement learning approach. In: Proceedings of the
Machine Learning Conference of Belgium and the Netherlands (Benelearn), pp. 65-72, 2006.
Fan, L. Decision Feedback Equalizer Based on CMA 1-2 and DD Algorithm, International Conference on Test and Measurement, 2009.
Fares, S. A., Denidni, T. A., Affes, S. Sequential Blind Beamforming Algorithm Using
Combined CMA/LMS for Wireless Underground Communications, IEEE 60th
Vehicular Technology Conference, Vol. 5, pp. 3600-3604, 2004.
Fatadin, I., Ives, D., Savory, S. J. Blind Equalization and Carrier Phase Recovery in a
16-QAM Optical Coherent System. Journal of Lightwave Technology, Vol. 27,
No. 15, August, 2009.
Fonteneau, R., Wehenkel, L., Ernst, D. Variable selection for dynamic treatment
regimes: a reinforcement learning approach. In: Proceedings of the European
Workshop on Reinforcement Learning (EWRL’08), Lille, France, pp. 312-319,
2008.
Garcia, F.A.C. Estimation of doa for a smart antenna using a front-end based in fpga
foreseeing a sdr arquitecture. In: The first European Conference on Antennas and
Propagation EuCAP 2006.
Gedson, F., Romero, R. F. Explorando o potencial de algoritmos de aprendizado com
reforço em robôs móveis. Proceedings of the IV Brazilian Conference on Neural
Networks – IV Congresso Brasileiro de Redes Neurais, ITA, São José dos Campos, SP, Brazil, pp. 237-242, 1999.
Ghosh, M. Blind decision feedback equalization for terrestrial television receivers. Proceedings of the IEEE, 86(10): 2070 – 2081, October 1998.
Godard, D. N. Self-Recovering Equalization and Carrier Tracking in Two-Dimensional
Data Communication Systems, IEEE Transactions on Communications, vol.
COM-28, no. 11, Novembro 1980.
Gu, J.F.; Chan, S.C.; Zhu, W.P.; Swamy, M.N.S. Joint DOA estimation and source
tracking with kalman filetring and regularized QRD RLS algorithm. IEEE Trans.
Circuits Syst. II Express Briefs, 60, 46–50,2013.
Guelpeli, M. V. C., Ribeiro, C. H. C., Omar, N. Utilização de Aprendizagem por
Reforço para modelagem autônoma do aprendiz em um tutor inteligente. Revista
Brasileira de Informática na Educação. SBC 12 (II), pp. 69-77, 2004.
Gupta, N.; Reddy, A.L.N. Adaptive antenna using Fuzzy Logic Control. In Proceedings of the IEEE Applied Electromagnetics Conference (AEMC), Kolkata, India, pp. 1–4, 19–20 December 2007.
Hauskrecht, M. Planning and control in stochastic domains with imperfect information. Tese (Doutorado)— EECS, Massachussets Institute of Technology, 1997.
Haykin, S. Adaptive Filter Theory, 4th ed. Prentice Hall, 2001.
Hu, C.; Wang, F.; Wang, W. Joint beamforming and power control optimization by
second-order cone programming approximation. In Proceedings of the 12th IEEE
International Conference on Communication technology (ICCT), Nanjing, China, pp. 147–150, 11–14 November 2010.
Huang, Y.; Tan, C.W.; Rao, B.D. Joint beamforming and power control in coordinated
multicell: Max-min duality, effective network and large system transition. IEEE
Trans. Wirel. Commun., 12, 2730–2742, 2013.
Hung, J.-C. An adaptive robust fuzzy beamformer for steering vector mismatch and
reducing interference and noise. Inf. Sci., 266, 160–170, 2014.
Khandaker, M.R.A.; Rong, Y. Joint power control and beamforming for peer-to-peer
MIMO relay systems. In Proceedings of the 2011 International Conference on
Wireless Communications Signal Processing (WCSP), Nanjing, China, 9–11 November 2011.
Ktshigami, T. Fukagawa, T., Hasegawa, M., Asanuma, T. Ikeda, H. A study on the
experimental sector switched antenna by doa estimation for mobile video transmission. In: IEEE, p. 1040-1044, 2000.
Larson, R. E. Casti, J. L. Principles of dynamic programming - Part I, II, III, - Marcel Dekker, INC, New York, 1978.
Li, J.; Stoica, P. Robust Adaptive Beamforming, John Wiley & Sons, Inc., Hoboken, NJ, USA, 2006.
Li, Z.; Yin. C.; Yue, G. A novel approach to joint beamforming and power control for
the coordinated multicell multi-antenna system. In Proceedings of the 8th
International Conference on Wireless Communications, Networking and Mobile
Computing (WiCOM), Shanghai, China, pp. 1–4,
21–23 September 2012.
Liberti, J. C., Rappaport, T. S. Smart Antennas for Wireless Communications: IS-95 and Third Generation CDMA Applications. Prentice-Hall PTR, 1990.
Lima Júnior, F. C. de. Algoritmo Q-learning como Estratégia de Exploração e/ou
Explotação para as Metaheurísticas GRASP e Algoritmo Genético. Tese de
doutorado, Universidade Federal do Rio Grande do Norte (UFRN), Natal, RN, 2009.
Liu, Y.; Zhang, P.; Hain, T. Using neural network front-ends on far field multiple
microphones based speech recognition. In Proceedings of the IEEE International
Conference on Acoustic, Speech and Signal Processing (ICASSP), Florence, Italy, pp. 5542–5546, 4–9 May 2014.
Lu, X.; Li, W.; Tolli, A.; Juntti, M.; Kunnari, E.; Piirainen, O. Joint power control,
receiver beamforming and adaptive multi base station coordination for uplink wireless communications. In Proceedings of the 21st IEEE International
Symposium on Personal, Indoor and Mobile radio Communications Workshops, Istanbul, Turkey, , pp. 446–450, 26–30 September 2010.
Lucky, R. W. Techniques for Adaptive Equalization of Digital Communication System. The Bell System Technical Journal, pages 256-286, February 1966.
Macchi, O., Eweda, E. Convergence Analysis of Self – Adaptive Equalizers, IEEE Transactions on Information Theory, vol. IT – 30, no. 2, 1984.
Nguyen, T., Ding, Z. Blind CMA Beamforming for Narrowband Signals with Multipath
Arrivals, International Journal of Adptive Control and Signal Processing, Vol. 12,
pp. 157-172, 1998.
Noori, N.; Razavizadeh, S.M.; Attar, A. Joint beamforming and power control in MIMO
cognitive radio networks. IEICE Electonics Express, 7, 203–208, 2010.
Oliveira, A. G. de. Otimização de Estratégias de Produção em Campos de Petróleo. Dissertação de Mestrado. Universidade Federal do Rio Grande do Norte (UFRN), Natal, RN, 2010.
Olson, D. K. Learning to play games from experience: An application of artificial
neural networks and temporal difference learning. Dissertação de mestrado.
Washington USA. 1993.
Ortolan, L., Santos, T., DeCastro, M., DeCastro, F. Blind concurrent beamformer. Electronics Letters, vol. 43, no.1, pp.5-6, Jan 2007.
Pitz, C.A.; Vanti, M.G.; Tobias, O.J.; Seara, R. Adaptive Beamforming for Antenna
Arrays in Cellular Systems Based on a Duality Between Uplink and Downlink Channels. In Proceedings of the 7th International Telecommnications Symposium (ITS), Manaus, September, 2010.
Proakis, J. G. Digital Communications, McGraw-Hill Science/Engineering/Math, 2000.
Puterman, M. L., Markov Decision Processes: Discrete Stochastic Dynamic
Programming, 1a edição, Wiley-Interscience, 2005.
Puttini, S. B. Emprego de Antenas Adaptativas Para Estimação de Dados em Ambientes
CDMA. Dissertação de Mestrado em Engenharia Elétrica, Departamento de
Engenharia Elétrica, Universidade de Brasília, Brasília, DF, 2006.
Rambach, K.; Yang, B. Direction of arrival estimation of two moving targets using a
time division multiplexed colocated MIMO radar. In Proceedings of the 2014 IEEE
Radar Conference, Cincinnati, OH, USA,; pp. 1118–1123, 19–23 May 2014. Rao, W., Xia, F., Liu, Y., Tan, W., Xu, H., Yuan, K., Liu, J. A New Decision-Feedback
Equalizer Based on a Mixed Blind Equalization Algorithm, IITA International
Conference on Services Science, Management and Engineering, 2009.
Rashid-Farrokhi, F.; Ray Liu, K.J.; Tassiulas, L. Transmit beamforming and power
control for cellular wireless systems. IEEE J. Sel. Areas Commun., 16, 1437–
1450, 1998a.
Rashid-Farrokhi, F.; Tassiulas, L.; Ray Liu, K.J. Joint optimal power control and
beamforming in wireless networks using antenna arrays. IEEE Trans. Commun., 46, 1313–1324, 1998b.
Rayleigh, G. G., Cioffi, J. M. Spatial-Temporal Coding of Wireless Comunications. IEEE Trans. on Communications, v. 46, pp. 357-366, Março 1998.
Ribeiro, C. H. C. Aprendizado por reforço. V Escola de Redes Neurais: Conselho Nacional de Redes Neurais, ITA, pp. c028-c072, 1999.
Sato, Y. A method of self-recovering equalization for multilevel amplitude-modulation
systems. IEEE Transactions on Communication, 23: 679-68, 1975.
Schmidt, J.F.; Lopez-Valcarce, R. Antenna competition to boost active interference
cancellation in cognitive MIMO-OFDM. In Proceedings of the 8th Sensor Array
and Multichannel Signal Processing Workshop (SAM), A Coruna, Spain,; pp. 269–272, 22–25 June 2014.
Shalvi, O., Weinstein, E. New criteria for blind deconvolution of nonminimum phase
systems (channels). Information Theory, IEEE Transactions on, vol. 36, no. 2, pp.
Smolders, B., Hampson, G. Deterministic RF Nulling in Phased Arrays for Next
Generation of Radio Telescopes. IEEE Ant. Prop. , vol 44, n. 4, pp. 13-22, Agosto
2002.
Song, X.; Wang, J.; Niu, X. Robust adaptive beamforming algorithm based on neural
network. In Proceedings of the IEEE International Conference on Automation and
Logistics, Qingdao, China, 1–3 September 2008.
Sutton, R. S., Barto, A. G. Reinforcement Learning: an introduction. MIT Press, 1998.
Terabayashi, K.; Hirose, A. Ultra-short-pulse acoustic imaging using complex-valued
spatio-temporal neural-network for null-steering: Experimental results. In
Proceedings of the International Joint Conference on Neural Networks (IJCNN), Beijing, China, pp. 3410–3413, 6–11 July 2014.
Treichler, J. R. Practical blind demodulators for high-order QAM signals. Signal Process, 67 (3): 331-344, 1998.
Visotsky, E.; Madhow, U. Optimum beamforming using transmit antenna arrays. In Proceedings of the 49th IEEE Vehicular Technology Conference, Houston, TX, USA, , Volume 1, pp. 851-856, 16 May 1999.
Watkins, C. J. C. H. Learning from Delayed Rewards, Phd thesis. University of Cambridge, 1989.
Widrow, B.; Mantey, P.E.; Griffiths, L.J.; Goode, B.B. Adaptive antenna systems. In Proceedings of IEEE : California, EUA, December, Volume 55, pp. 2143–2159, 1967.
Wiering, M. Multi-agent reinforcement learning for traffic light control. Em: Proc. 17th International Conf. On Machine Learning, Morgan Kaufmann, San Francisco, CA, pp. 1151-1158, 2000.
Wu, H., Xu, D. Novel Efficient Blind Beamforming Algorithm Using Cumulant
Optimization, IEEE Symposium International Antennas and Propagation Society,
Vol. 4B, pp. 85-88, July 2005.
Yoshida, J.; Hirose, A. Beamforming for impulse-radio UWB communication systems
based on complex-valued spatio-temporal neural networks. In Proceedings of the
International Symposium on Electromagnetic Theory, Hiroshima, Japan, pp. 848– 851, 20–24 May 2013.
You, S.; Noh, G.; Lee, J.; Wang, H.; Hong, D. Joint beamforming and power control
algorithm for cognitive radio network with the multi-antenna base station. In
Proceedings of the IEEE Communications and Network Conference (WCNC), Sydney, Australia, pp. 1–618–21, April 2010.
Yu, W.; Lan, T. Downlink beamforming with per-antenna power constraints. In Proceedings of the 6th IEEE Workshop on Signal Processing Advances in
Wireless Communications, New York, NY, USA,; pp. 1058–1062, 5–8 June 2005.
Yuen, N.; Friedlander, B. Doa estimation in multipath: An approach using fourth-order
cumulants. In: IEEE Transactions on Signal Processing, 1997.
Zaharis, Z.D.; Skeberies, C.; Xenos, T.D.; Lazaridis, P.I.; Cosmas, J. Design of a novel
antenna array beamformer using neural networks trained by modified adaptive dispersion invasive weed optimization based data. IEEE Trans. Broadcast, 59,
455–460, 2013.
Zelenovsky, R. Emprego de arranjo de antenas na recuperação de dados digitais em
ambiente CDMA. Tese (Doutorado) – Pontifícia Universidade Católica do Rio de
Janeiro, Rio de Janeiro, 2001.
Zeydan, E.; Kivanc-Tureli, D.; Tureli, U. Iterative beamforming and power control for
MIMO ad hoc networks. In Proceedings of the IEEE Global Telecommunications
Conference (GLOBECOM), Miami, FL, USA, pp. 1–5, 6–10 December 2010. Zhang, W.; Liu, W.; Wu, S. Joint transmission and reception diversity smoothing for
direction finding of coherent targets in MIMO radar. IEEE J. Sel. Top. Signal Process., 9, 115–124, 2014.