An Extended Version of the Proportional Adaptive Algorithm Based on Kernel Methods for Channel Identification with Binary Measurements

Authors

DOI:

https://doi.org/10.26636/jtit.2022.161122

Keywords:

binary measurement, BRAN channel identification, kernel methods, PNLMS, phase estimation

Abstract

In recent years, kernel methods have provided an important alternative solution, as they offer a simple way of expanding linear algorithms to cover the non-linear mode as well. In this paper, we propose a novel recursive kernel approach allowing to identify the finite impulse response (FIR) in non-linear systems, with binary value output observations. This approach employs a kernel function to perform implicit data mapping. The transformation is performed by changing the basis of the data in a high-dimensional feature space in which the relations between the different variables become linearized. To assess the performance of the proposed approach, we have compared it with two other algorithms, such as proportionate normalized least-mean-square (PNLMS) and improved PNLMS (IPNLMS). For this purpose, we used three measurable frequency-selective fading radio channels, known as the broadband radio access network (BRAN C, BRAN D, and BRAN E), which are standardized by the European Telecommunications Standards Institute (ETSI), and one theoretical frequency selective channel, known as the Macchi’s channel. Simulation results show that the proposed algorithm offers better results, even in high noise environments, and generates a lower mean square error (MSE) compared with PNLMS and IPNLMS.

Downloads

Download data is not yet available.

References

[1] S. Haykin, Adaptive Filter Theory, 4th ed. Delhi: Prentice Hall, 2002 (ISBN: 9780130901262).
View in Google Scholar

[2] M. M. Sondhi, “The history of echo cancellation”, IEEE Signal Processing Magazine, vol. 23, no. 5, pp. 95–102, 2006.
View in Google Scholar

[3] A. H. Sayed, Fundamentals of Adaptive Filtering. Wiley, 2003 (ISBN: 9780471461265).
View in Google Scholar

[4] P. S. R. Diniz, Adaptive Filtering: Algorithms and Practical Implementation. Springer, 2008.
View in Google Scholar

[5] L. Ljung, System Identification: Theory for the User. Upper Saddle River, NJ: Prentice Hall PTR, 1999.
View in Google Scholar

[6] E. Ferrara, “Fast implementations of LMS adaptive filters”, IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 28, no. 4, pp. 474–475, 1980.
View in Google Scholar

[7] B. Widrow and S. D. Stearns, Adaptive Signal Processing. Upper Saddle River: Prentice-Hall, 1985 (ISBN: 9780130040299).
View in Google Scholar

[8] R. Martinek, J. Žídek, R. Jaroš, P. Bilík, and M. Ladrová, “Least mean squares and recursive least squares algorithms for total harmonic distortion reduction using shunt active power filter control”, Energies, vol. 12, no. 8, Article no. 1545, 2019.
View in Google Scholar

[9] D. Etter, “Identification of sparse impulse response systems using an adaptive delay filter”, in Proc. 1985 IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 1985, vol. 10, pp. 1169–1172.
View in Google Scholar

[10] D. L. Duttweiler, “Proportionate normalized least-mean-squares adaptation in echo cancelers”, IEEE Transactions on Speech and Audio Processing, vol. 8, no. 5, pp. 508–518, 2000.
View in Google Scholar

[11] J. Benesty and S. L. Gay, “An improved PNLMS algorithm”, in Proc. 2002 IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP), 2002, vol. 2, pp. II-1881–II-1884.
View in Google Scholar

[12] H. Deng and M. Doroslovački, “Improving convergence of the PNLMS algorithm for sparse impulse response identification”, IEEE Signal Processing Letters, vol. 12, no. 3, pp. 181–184, 2005.
View in Google Scholar

[13] P. A. Naylor, J. Cui, and M. Brookes, “Adaptive algorithms for sparse echo cancellation”, Signal Processing, vol. 86, no. 6, pp. 1182–1192, 2006.
View in Google Scholar

[14] L. Liu, M. Fukumoto, and S. Saiki, “An improved µ-law proportionate NLMS algorithm”, in Proc. 2008 IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), 2008, pp. 3797–3800.
View in Google Scholar

[15] Y. Gu, J. Jin, and S. Mei, “l0 norm constraint LMS algorithm for sparse system identification”, IEEE Signal Processing Letters, vol. 16, no. 9, pp. 774–777, 2009.
View in Google Scholar

[16] Z. Jin, X. Ding, Z. Jiang, and Y. Li, “An improved µ-law proportionate NLMS algorithm for estimating block-sparse systems”, in Proc. 2019 IEEE 2nd Int. Conf. on Electronic Information and Communication Technology (ICEICT), 2019, pp. 205–209.
View in Google Scholar

[17] Y. Chen, Y. Gu, and A. O. Hero, “Sparse LMS for system identification”, in Proc. 2009 IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2009, pp. 3125–3128.
View in Google Scholar

[18] Y. Li and M. Hamamura, “Zero-attracting variable-step-size least mean square algorithms for adaptive sparse channel estimation”, International Journal of Adaptive Control and Signal Processing, vol. 29, no. 9, pp. 1189–1206, 2015.
View in Google Scholar

[19] Y. Li, Y. Wang, F. Albu, and J. Jiang, “A general zero attraction proportionate normalized maximum correntropy criterion algorithm for sparse system identification”, Symmetry, vol. 9, no. 10, Article no. 229, 2017.
View in Google Scholar

[20] O. Nelles, Nonlinear System Identification: From Classical Approaches to Neural Networks, Fuzzy Models, and Gaussian Processes. Springer Nature, 2020.
View in Google Scholar

[21] S. A. Billings and S. Chen, “Identification of non-linear rational systems using a prediction-error estimation algorithm”, International Journal of Systems Science, vol. 20, no. 3, pp. 467–494, 1989.
View in Google Scholar

[22] F. Ding, X. P. Liu, and G. Liu, “Identification methods for Hammerstein nonlinear systems”, Digital Signal Processing, vol. 21, no. 2, pp. 215–238, 2011.
View in Google Scholar

[23] R. Fateh, A. Darif, and S. Safi, “Performance evaluation of MC-CDMA systems with single user detection technique using kernel and linear adaptive method”, Journal of Telecommunications and Information Technology, no. 4, pp. 1–11, 2021.
View in Google Scholar

[24] R. Fateh and A. Darif, “Mean square convergence of reproducing kernel for channel identification: Application to BRAN D channel impulse response”, in Proc. Int. Conf. on Business Intelligence, 2021, pp. 284–293.
View in Google Scholar

[25] R. Fateh, A. Darif, and S. Safi, “Channel identification of non-linear systems with binary-valued output observations based on positive definite kernels”, E3S Web of Conferences, EDP Sciences, vol. 297, 2021.
View in Google Scholar

[26] M. Zidane, S. Safi, and M. Sabri, “Compensation of fading channels using partial combining equalizer in MC-CDMA systems”, J. of Telecommun. and Inform. Technol., no. 1, pp. 5–11, 2017 [Online]. Available: http://dlibra.itl.waw.pl/dlibra-webapp/Content/1962/ISSN_1509-4553_1_2017_5.pdf.
View in Google Scholar

[27] S. Safi, M. Frikel, A. Zeroual, and M. M’Saad, “Higher-order cumulants for identification and equalization of multicarrier spreading spectrum systems”, J. of Telecommun. and Inform. Technol., no. 2, pp. 74–84, 2011 [Online]. Available: https://www.itl.waw.pl/czasopisma/JTIT/2011/2/74.pdf.
View in Google Scholar

[28] R. Fateh, A. Darif, and S. Safi, “Kernel and linear adaptive methods for the BRAN channels identification”, in Proc. Int. Conf. on Advanced Intelligent Systems for Sustainable Development, 2020, pp. 579–591.
View in Google Scholar

[29] R. Fateh, A. Darif, and S. Safi, “Identification of the linear dynamic parts of Wiener model using kernel and linear adaptive”, in Proc. Int. Conf. on Advanced Intelligent Systems for Sustainable Development, 2020, pp. 387–400.
View in Google Scholar

[30] E. Eskinat, S. H. Johnson, and W. L. Luyben, “Use of Hammerstein models in identification of nonlinear systems”, AIChE Journal, vol. 37, no. 2, pp. 255–268, 1991.
View in Google Scholar

[31] S. A. Billings, “Identification of nonlinear systems – a survey”, IEE Proceedings D – Control Theory and Applications, vol. 127, no. 6, pp. 272–285, 1980.
View in Google Scholar

[32] A. Stenger and R. Rabenstein, “Adaptive Volterra filters for nonlinear acoustic echo cancellation”, in Proc. IEEE Workshop on Nonlinear Signal and Image Process. (NSIP), 1999, vol. 2, pp. 679–683 [Online]. Available: http://www.eurasip.org/Proceedings/Ext/NSIP99/Nsip99/papers/146.pdf.
View in Google Scholar

[33] L. Janjanam, S. K. Saha, R. Kar, and D. Mandal, “Volterra filter modelling of non-linear system using artificial electric field algorithm assisted Kalman filter and its experimental evaluation”, ISA Transactions, 2020.
View in Google Scholar

[34] T. Ogunfunmi, Adaptive Nonlinear System Identification: The Volterra and Wiener Model Approaches. Springer, 2007 (ISBN: 9780387263281).
View in Google Scholar

[35] S. Haykin, Neural Networks and Learning Machines. Englewood Cliffs: Prentice-Hall, 2009 (ISBN: 9780131471399).
View in Google Scholar

[36] N. Aronszajn, “Theory of reproducing kernels”, Transactions of the American Mathematical Society, vol. 68, no. 3, pp. 337–404, 1950.
View in Google Scholar

[37] J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge University Press, 2004.
View in Google Scholar

[38] W. Liu, J.C. Principe, and S. Haykin, Kernel Adaptive Filtering: A Comprehensive Introduction. Wiley, 2011 (ISBN: 9780470447536).
View in Google Scholar

[39] G. Camps-Valls and L. Bruzzone, Kernel Methods for Remote Sensing Data Analysis. Wiley, 2009.
View in Google Scholar

[40] C. Cortes and V. Vapnik, “Support-vector networks”, Machine Learning, vol. 20, no. 3, pp. 273–297, 1995.
View in Google Scholar

[41] B. Schölkopf and A. J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, 2001 [Online]. Available: https://alex.smola.org/papers/2001/SchHerSmo01.pdf.
View in Google Scholar

[42] Z. Momani, M. Al-Shridah, O. A. Arqub, M. Al-Momani, and S. Momani, “Modeling and analyzing neural networks using reproducing kernel Hilbert space algorithm”, Appl. Math. Inf. Sci., vol. 12, pp. 89–99, 2018.
View in Google Scholar

[43] O. A. Arqub and H. Rashaideh, “The RKHS method for numerical treatment for integro-differential algebraic systems of temporal two-point BVPs”, Neural Computing and Applications, vol. 30, no. 8, pp. 2595–2606, 2018.
View in Google Scholar

[44] H. Sun, “Mercer theorem for RKHS on noncompact sets”, Journal of Complexity, vol. 21, no. 3, pp. 337–349, 2005.
View in Google Scholar

[45] W. Liu, P. P. Pokharel, and J. C. Príncipe, “The kernel least-mean-square algorithm”, IEEE Transactions on Signal Processing, vol. 56, no. 2, pp. 543–554, 2008.
View in Google Scholar

[46] Y. Engel, S. Mannor, and R. Meir, “The kernel recursive least-squares algorithm”, IEEE Transactions on Signal Processing, vol. 52, no. 8, pp. 2275–2285, 2004.
View in Google Scholar

[47] W. Liu and J. C. Príncipe, “Kernel affine projection algorithms”, EURASIP Journal on Advances in Signal Processing, vol. 2008, pp. 1–12, 2008.
View in Google Scholar

[48] R. Castro Garcia, “Structured nonlinear system identification using kernel-based methods”, Ph.D. dissertation, Faculty of Engineering Science, KU Leuven, 2017 [Online]. Available: https://lirias.kuleuven.be/retrieve/473580.
View in Google Scholar

[49] B. Chen, S. Zhao, P. Zhu, and J. C. Príncipe, “Quantized kernel least mean square algorithm”, IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 1, pp. 22–32, 2011.
View in Google Scholar

[50] B. Chen, S. Zhao, P. Zhu, and J. C. Príncipe, “Quantized kernel recursive least squares algorithm”, IEEE Transactions on Neural Networks and Learning Systems, vol. 24, no. 9, pp. 1484–1491, 2013.
View in Google Scholar

[51] S. Wang, Y. Zheng, and C. Ling, “Regularized kernel least mean square algorithm with multiple-delay feedback”, IEEE Signal Processing Letters, vol. 23, no. 1, pp. 98–101, 2015.
View in Google Scholar

[52] B. Chen, J. Liang, N. Zheng, and J. C. Príncipe, “Kernel least mean square with adaptive kernel size”, Neurocomputing, vol. 191, pp. 95–106, 2016.
View in Google Scholar

[53] W. Liu, I. Park, Y. Wang, and J. C. Príncipe, “Extended kernel recursive least squares algorithm”, IEEE Transactions on Signal Processing, vol. 57, no. 10, pp. 3801–3814, 2009.
View in Google Scholar

[54] H. Zhou, J. Huang, and F. Lu, “Reduced kernel recursive least squares algorithm for aero-engine degradation prediction”, Mechanical Systems and Signal Processing, vol. 95, pp. 446–467, 2017.
View in Google Scholar

[55] M. Zidane and R. Dinis, “A new combination of adaptive channel estimation methods and TORC equalizer in MC-CDMA systems”, International Journal of Communication Systems, vol. 33, no. 11, Article no. e4429, 2020.
View in Google Scholar

[56] C. J. Burges, “A tutorial on support vector machines for pattern recognition”, Data Mining and Knowledge Discovery, vol. 2, no. 2, pp. 121–167, 1998.
View in Google Scholar

[57] A. Sánchez and V. David, “Advanced support vector machines and kernel methods”, Neurocomputing, vol. 55, no. 1–2, pp. 5–20, 2003.
View in Google Scholar

[58] U. Soverini and T. Söderström, “Frequency domain identification of FIR models in the presence of additive input-output noise”, Automatica, vol. 115, Article no. 108879, 2020.
View in Google Scholar

[59] H. Zhang, T. Wang, and Y. Zhao, “Asymptotically efficient recursive identification of FIR systems with binary-valued observations”, IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 51, no. 5, pp. 2687–2700, 2019.
View in Google Scholar

[60] J. Guo, Y. Zhao, C. Y. Sun, and Y. Yu, “Recursive identification of FIR systems with binary-valued outputs and communication channels”, Automatica, vol. 60, pp. 165–172, 2015.
View in Google Scholar

[61] T. Yuan, Q. Liu, and J. Guo, “Identification of FIR systems with quantized input and binary-valued observations under a priori parameter constraint”, in Proc. 39th Chinese Control Conf. (CCC), 2020, pp. 1099–1104.
View in Google Scholar

[62] M. Pouliquen, T. Ménard, E. Pigeon, O. Gehan, and A. Goudjil, “Recursive system identification algorithm using binary measurements”, in Proc. 2016 European Control Conf. (ECC), 2016, pp. 1353–1358.
View in Google Scholar

[63] C. J. Burges, “A tutorial on support vector machines for pattern recognition”, Data Mining and Knowledge Discovery, vol. 2, no. 2, pp. 121–167, 1998.
View in Google Scholar

[64] O. Macchi, C. A. Faria da Rocha, and J. M. Travassos-Romano, “Égalisation adaptative autodidacte par rétroprédiction et prédiction”, in Proc. XIV Colloque GRETSI, 1993, pp. 491–493 [Online]. Available: http://www.gretsi.fr/data/colloque/pdf/1993_017-0005_11877.pdf (in French).
View in Google Scholar

[65] ETSI, “Broadband Radio Access Networks (BRAN); HIPERLAN Type 2; Physical (PHY) layer”, Technical Specification, 2001 [Online]. Available: https://www.etsi.org/deliver/etsi_ts/101400_101499/101475/01.02.02_60/ts_101475v010202p.pdf.
View in Google Scholar

[66] ETSI, “Broadband Radio Access Networks (BRAN); HIPERLAN Type 2; Requirements and architectures for wireless broadband access”, 1999 [Online]. Available: https://www.etsi.org/deliver/etsi_tr/101000_101099/101031/02.02.01_60/tr_101031v020201p.pdf.
View in Google Scholar

Downloads

Published

2022-09-30

Issue

Section

RESEARCH ARTICLES

How to Cite

[1]
R. Fateh, A. Darif, and S. Safi, “An Extended Version of the Proportional Adaptive Algorithm Based on Kernel Methods for Channel Identification with Binary Measurements”, JTIT, vol. 89, no. 3, pp. 47–58, Sep. 2022, doi: 10.26636/jtit.2022.161122.

Most read articles by the same author(s)

1 2 > >>