A Novel Kernel Algorithm for Finite Impulse Response Channel Identification
DOI:
https://doi.org/10.26636/jtit.2023.169823Keywords:
finite impulse response, kernel adaptive filtering, kernel recursive projection identification, nonlinear system identificationAbstract
Over the last few years, kernel adaptive filters have gained in importance as the kernel trick started to be used in classic linear adaptive filters in order to address various regression and time-series prediction issues in nonlinear environments.In this paper, we study a recursive method for identifying finite impulse response (FIR) nonlinear systems based on binary-value observation systems. We also apply the kernel trick to the recursive projection (RP) algorithm, yielding a novel recursive algorithm based on a positive definite kernel. For purposes, our approach is compared with the recursive projection (RP) algorithm in the process of identifying the parameters of two channels, with the first of them being a frequency-selective fading channel, called a broadband radio access network (BRAN B) channel, and the other being a a theoretical frequency-selective channel, known as the Macchi channel. Monte Carlo simulation results are presented to show the performance of the proposed algorithm.
Downloads
References
S. Haykin, Adaptive Filter Theory, 4th ed. Prentice Hall, Delhi, 2002 (ISBN: 9780130901262).
View in Google Scholar
M.M. Sondhi, "The history of echo cancellation", IEEE Signal Processing Magazine, vol. 23, no. 5, pp. 95–102, 2006 https://doi.org/10.1109/MSP.2006.1708416 DOI: https://doi.org/10.1109/MSP.2006.1708416
View in Google Scholar
A.H. Sayed, Fundamentals of Adaptive Filtering. New York: John Wiley & Sons, 824 p., 2003 (ISBN: 9780471461265).
View in Google Scholar
P.S.R. Diniz, Adaptive Filtering: Algorithms and Practical Implementations, 3rd ed. New York: Springer, 495 p., 2008 https://doi.org/10.1007/978-3-030-29057-3 DOI: https://doi.org/10.1007/978-0-387-68606-6_13
View in Google Scholar
R. Fateh, A. Darif, and S. Safi, "Kernel and linear adaptive methods for the BRAN channels identification", AI2SD: International Conference on Advanced Intelligent Systems for Sustainable Development, vol. 2, pp. 579–591, 2020 https://doi.org/10.1007/978-3-030-90633-7 DOI: https://doi.org/10.1007/978-3-030-90639-9_47
View in Google Scholar
R. Fateh, A. Darif, and S. Safi, "Identification of the linear dynamic parts of wiener model using kernel and linear adaptive", AI2SD: International Conference on Advanced Intelligent Systems for Sustainable Development, vol. 2, pp. 387–400, 2020 https://doi.org/10.1007/978-3-030-90633-7 DOI: https://doi.org/10.1007/978-3-030-90639-9_31
View in Google Scholar
E. Ferrara, "Fast implementations of LMS adaptive filters", IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 28, no. 4, pp. 474–475, 1980 https://doi.org/10.1109/tassp.1980.1163432 DOI: https://doi.org/10.1109/TASSP.1980.1163432
View in Google Scholar
M. Zidane and R. Dinis, "A new combination of adaptive channel estimation methods and TORC equalizer in MC-CDMA systems", International Journal of Communication Systems, vol. 33, no. 11, e4429, 2020 https://doi.org/10.1002/dac.4429 DOI: https://doi.org/10.1002/dac.4429
View in Google Scholar
M. Zidane, S. Safi, and M. Sabri, "Measured and estimated data of nonlinear BRAN channels using HOS in 4G wireless communications", Data in Brief, vol. 17, pp. 1136–1148, 2018 https://doi.org/10.1016/j.dib.2018.02.005 DOI: https://doi.org/10.1016/j.dib.2018.02.005
View in Google Scholar
R. Fateh, A. Darif, and S. Safi, "Performance Evaluation of MC-CDMA Systems with Single User Detection Technique using Kernel and Linear Adaptive Method", Journal of Telecommunications and Information Technology, no. 4, pp. 1–11 2021 https://doi.org/10.26636/jtit.2021.151621 DOI: https://doi.org/10.26636/jtit.2021.151621
View in Google Scholar
M. Zidane, S. Safi, and M. Sabri, "Compensation of fading channel using partial combining equalizer in MC-CDMA systems", Journal of Telecommunications and Information Technology, no. 1, pp. 5–11, 2017 [Online]. Available: https://www.il-pib.pl/czasopisma/JTIT/2017/1/5.pdf
View in Google Scholar
S. Safi, M. Frikel, A. Zeroual, and M. M’Saad, "Higher order cumulants for identification and equalization of multicarrier spreading spectrum systems", Journal of Telecommunications and Information Technology, no. 2, pp. 74–84, 2011 [Online]. Available: https://www.il-pib.pl/czasopisma/JTIT/2011/2/74.pdf
View in Google Scholar
L. Ljung, System Identification: Theory for the User. Upper Saddle River (NJ): Prentice Hall PTR, 1999 (ISBN: 9780136566953).
View in Google Scholar
F. Ding, System Identification – Performances Analysis for Identification Methods. Beijing, China: Science Press, pp. 1–12, 2014 [in Chinese].
View in Google Scholar
X. Zhang, F. Ding, F.E. Alsaadi, and T. Hayat, "Recursive parameter identification of the dynamical models for bilinear state space systems", Nonlinear Dynamics, vol. 89, no. 4, pp. 2415–2429, 2017 https://doi.org/10.1007/S11071-017-3594-Y DOI: https://doi.org/10.1007/s11071-017-3594-y
View in Google Scholar
L. Xu, "Application of the Newton iteration algorithm to the parameter estimation for dynamical systems", Journal of Computational and Applied Mathematics, vol. 288, pp. 33–43, 2015 https://doi.org/10.1016/j.cam.2015.03.057 DOI: https://doi.org/10.1016/j.cam.2015.03.057
View in Google Scholar
Q. Song, "Recursive identification of systems with binary-valued out-puts and with ARMA noises", Automatica, vol. 93, pp. 106–113, 2018 https://doi.org/10.1016/j.automatica.2018.03.059 DOI: https://doi.org/10.1016/j.automatica.2018.03.059
View in Google Scholar
J. Guo, X. Wang, W. Xue, and Y. Zhao, "System identification with binary-valued observations under data tampering attacks", IEEE Transactions on Automatic Control, vol. 66, no. 8, pp. 3825–3832, 2020 https://doi.org/10.1109/TAC.2020.3029325 DOI: https://doi.org/10.1109/TAC.2020.3029325
View in Google Scholar
R. Fateh, A. Darif, and S. Safi, "Channel identification of non-linear systems with binary-valued output observations based on positive definite kernels", E3S Web of Conferences, vol. 297, 2021 https://doi.org/10.1051/e3sconf/202129701020 DOI: https://doi.org/10.1051/e3sconf/202129701020
View in Google Scholar
L. Li, F. Wang, H. Zhang, and X. Ren, "A novel recursive learning estimation algorithm of Wiener systems with quantized observations", ISA Transactions, vol. 112, pp. 23–34, 2021 https://doi.org/10.1016/j.isatra.2020.11.032 DOI: https://doi.org/10.1016/j.isatra.2020.11.032
View in Google Scholar
L. Zhang, Y. Zhao, and L. Guo, "Identification and adaptation with binary-valued observations under non-persistent excitation condition", Automatica, vol. 138, 2022 https://doi.org/10.48550/arXi v.2107.03588 DOI: https://doi.org/10.1016/j.automatica.2022.110158
View in Google Scholar
R. Fateh and A. Darif, "Mean square convergence of reproducing kernel for channel identification: Application to Bran D Channel impulse response", in International Conference on Business Intelligence, vol. 416, pp. 284–293, 2021 https://doi.org/10.1007/978-3-030-76508-8_20 DOI: https://doi.org/10.1007/978-3-030-76508-8_20
View in Google Scholar
J.F. Zhang and G.G. Yin, "System identification using binary sensors", IEEE Transactions on Automatic Control, vol. 48, no. 11, pp. 1892–1907, 2003 https://doi.org/10.1109/TAC.2003.819073 DOI: https://doi.org/10.1109/TAC.2003.819073
View in Google Scholar
L.Y. Wang, G.G. Yin, and J.F. Zhang, "Joint identification of plant rational models and noise distribution functions using binary-valued observations", Automatica, vol. 42, no. 4, pp. 535–547, 2006 https://doi.org/10.1016/j.automatica.2005.12.004 DOI: https://doi.org/10.1016/j.automatica.2005.12.004
View in Google Scholar
J. Guo, Y. Zhao, C.Y. Sun, and Y. Yu, "Recursive identification of FIR systems with binary-valued outputs and communication channels", Automatica, vol. 60, pp. 165–172, 2015 https://doi.org/10.1016/j.automatica.2015.06.030 DOI: https://doi.org/10.1016/j.automatica.2015.06.030
View in Google Scholar
J. Guo and Y. Zhao, "Recursive projection algorithm on FIR system identification with binary-valued observations", Automatica, vol. 49, no. 11, pp. 3396–3401, 2013 https://doi.org/10.1016/j.automatica.2013.08.011 DOI: https://doi.org/10.1016/j.automatica.2013.08.011
View in Google Scholar
M. Pouliquen, E. Pigeon, O. Gehan, A. Goudjil, and R. Auber, "Impulse response identification from input/output binary measurements", Automatica, vol. 123, art. no. 109307, 2021 https://doi.org/10.1016/j.automatica.2020.109307 DOI: https://doi.org/10.1016/j.automatica.2020.109307
View in Google Scholar
M. Pouliquen, E. Pigeon, O. Gehan, and A. Goudjil, "Identification using binary measurements for IIR systems", IEEE Transactions on Automatic Control, vol. 65, no. 2, pp. 786–793, 2019 https://doi.org/10.1109/TAC.2019.2921657 DOI: https://doi.org/10.1109/TAC.2019.2921657
View in Google Scholar
J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis. Cambridge University Press, 2004 https://doi.org/10.1017/CBO9780511809682 DOI: https://doi.org/10.1017/CBO9780511809682
View in Google Scholar
W. Liu, J.C. Principe, and S. Haykin, Kernel Adaptive Filtering: A Comprehensive Introduction. John Wiley & Sons, 240 p., 2011 (ISBN: 9780470447536). DOI: https://doi.org/10.1002/9780470608593
View in Google Scholar
R. Fateh, A. Darif and S. Safi, "Hyperbolic functions impact evaluation on channel identification based on recursive kernel algorithm", 2022 8th International Conference on Optimization and Applications (ICOA), Genoa, Italy, pp. 1–6, 2022 https://doi.org/10.1109/ICOA55659.2022.9934118 DOI: https://doi.org/10.1109/ICOA55659.2022.9934118
View in Google Scholar
J.W. Xu, A.R. Paiva, M. Park, and J.C. Principe, "A reproducing kernel Hilbert space framework for information-theoretic learning", IEEE Transactions on Signal Processing, vol. 56, no. 12, pp. 5891–5902, 2008 https://doi.org/10.1109/TSP.2008.2005085 DOI: https://doi.org/10.1109/TSP.2008.2005085
View in Google Scholar
F. Girosi, M. Jones, and T. Poggio, "Regularization theory and neural networks architectures", Neural Computation, vol. 7, no. 2, pp. 219–269, 1995 https://doi.org/10.1162/neco.1995.7.2.219 DOI: https://doi.org/10.1162/neco.1995.7.2.219
View in Google Scholar
C.K.I. Williams and C.E. Rasmussen, Gaussian Processes for Machine Learning. Cambridge: MIT Press, 2005 https://doi.org/10.7551/mitpress/3206.001.0001 DOI: https://doi.org/10.7551/mitpress/3206.001.0001
View in Google Scholar
C. Cortes, and V. Vapnik, "Support-vector networks", Machine Learning, vol. 20, no. 3, pp. 273–297, 1995 https://doi.org/10.1007/bf00994018 DOI: https://doi.org/10.1007/BF00994018
View in Google Scholar
W. Liu, J.C. Principe, "Kernel affine projection algorithms", EURASIP Journal on Advances in Signal Processing, no. 1, pp. 1–12, 2008 https://doi.org/10.1155/2008/784292 DOI: https://doi.org/10.1155/2008/784292
View in Google Scholar
B. Scholkopf, A. Smola, and K.R. Muller, "Kernel principal component analysis", in International Conference on Artificial Neural Networks (ICANN), Lausanne, Switzerland, pp. 583–588, 1997 https://doi.org/10.1007/BFb0020217 DOI: https://doi.org/10.1007/BFb0020217
View in Google Scholar
W. Liu, P. P. Pokharel, and J. C. Principe, "The kernel least-mean square algorithm", IEEE Transactions on Signal Processing, vol. 56, no. 2, pp. 543–554, 2008 https://doi.org/10.1109/tsp.2007.907881 DOI: https://doi.org/10.1109/TSP.2007.907881
View in Google Scholar
Y. Engel, S. Mannor, and R. Meir, "The kernel recursive least-squares algorithm", IEEE Transactions on Signal Processing, vol. 52, no. 8, pp. 2275–2285, 2004 https://doi.org/10.1109/TSP.2004.830985 DOI: https://doi.org/10.1109/TSP.2004.830985
View in Google Scholar
B. Chen, S. Zhao, P. Zhu, and J.C. Principe, "Quantized kernel recursive least squares algorithm", IEEE Transactions on Neural Networks and Learning Systems, vol. 24, no. 9, pp. 1484–1491, 2013 https://doi.org/10.1109/tnnls.2013.2258936 DOI: https://doi.org/10.1109/TNNLS.2013.2258936
View in Google Scholar
B. Chen, S. Zhao, P. Zhu, and J.C. Principe, "Quantized kernel least mean square algorithm", IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 1, pp. 22–32, 2011 https://doi.org/10.1109/tnnls.2011.2178446 DOI: https://doi.org/10.1109/TNNLS.2011.2178446
View in Google Scholar
W. Liu, I. Park, Y. Wang, and J.C. Principe, "Extended kernel recursive least squares algorithm", IEEE Transactions on Signal Processing, vol. 57, no. 10, pp. 3801–3814, 2009 https://doi.org/10.1109/tsp.2009.2022007 DOI: https://doi.org/10.1109/TSP.2009.2022007
View in Google Scholar
B. Chen, J. Liang, N. Zheng, and J.C. Príncipe, "Kernel least mean square with adaptive kernel size", Neurocomputing, vol. 191, pp. 95–106, 2016 https://doi.org/10.1016/j.neucom.2016.01.004 DOI: https://doi.org/10.1016/j.neucom.2016.01.004
View in Google Scholar
Z. Qin, B. Chen, and N. Zheng, "Random Fourier feature kernel recursive least squares", in 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA, pp. 2881–2886, 2017 https://doi.org/10.1109/IJCNN.2017.7966212 DOI: https://doi.org/10.1109/IJCNN.2017.7966212
View in Google Scholar
Q. Wu, Y. Li, Y.V. Zakharov, and W. Xue, "Quantized kernel Least lncosh algorithm", Signal Processing, vol. 189, art. no. 108255, 2021 https://doi.org/10.1016/j.sigpro.2021.108255 DOI: https://doi.org/10.1016/j.sigpro.2021.108255
View in Google Scholar
R. Fateh, A. Darif, and S. Safi, "An extended version of the proportional adaptive algorithm based on kernel methods for channel identification with binary measurements", Journal of Telecommunications and Information Technology, no. 3, pp. 47–58, 2022 https://doi.org/10.26636/jtit.2022.161122 DOI: https://doi.org/10.26636/jtit.2022.161122
View in Google Scholar
J. Guo and Y. Zhao, "Identification of the gain system with quantized observations and bounded persistent excitations", Science China Information Sciences, vol. 57, no. 1, pp. 1–15, 2014 https://doi.org/10.1007/s11432-012-4761-x DOI: https://doi.org/10.1007/s11432-012-4761-x
View in Google Scholar
J.D. Diao, J. Guo, C.Y. Sun, "Event-triggered identification of FIR systems with binary-valued output observations", Automatica, vol. 98, pp. 95–102, 2018 https://doi.org/10.1016/j.automatica.2018.09.024 DOI: https://doi.org/10.1016/j.automatica.2018.09.024
View in Google Scholar
N. Aronszajn, "Theory of reproducing kernels", Transactions of the American Mathematical Society, vol. 68, no. 3, pp. 337–404, 1950 https://doi.org/10.2307/1990404 DOI: https://doi.org/10.1090/S0002-9947-1950-0051437-7
View in Google Scholar
C.J.C. Burges, "A tutorial on support vector machines for pattern recognition", Data Mining and Knowledge Discovery, vol. 2, no. 2, pp. 121–167, 1998 https://doi.org/10.1023/a:1009715923555 DOI: https://doi.org/10.1023/A:1009715923555
View in Google Scholar
ETSI. Broadband Radio Access Network (BRAN); Hiperlan type 2; Physical (PHY) layer, Technical Report, December 2001.
View in Google Scholar
ETSI. Broadband Radio Access Network (BRAN); Hiperlan type 2; Requirements and architectures for wireless broadband access, January, 1999.
View in Google Scholar
O. Macchi, C.A. Fariada Rocha, and J.M. Travassos-Romano, "Égalisation adaptative autodidacte par rétroprédiction et prédiction", XIV Colloque GRETSI, pp. 491–493, 1993 [in French].
View in Google Scholar
Downloads
Published
Issue
Section
License
Copyright (c) 2023 Journal of Telecommunications and Information Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
