Machine Learning Based System Identification with Binary Output Data Using Kernel Methods
DOI:
https://doi.org/10.26636/jtit.2024.1.1430Keywords:
finite impulse response, kernel adaptive filtering, nonlinear systems identification, Proakis C channelAbstract
Within the realm of machine learning, kernel methods stand out as a prominent class of algorithms with widespread applications, including but not limited to classification, regression, and identification tasks. Our paper addresses the challenging problem of identifying the finite impulse response (FIR) of single-input single-output nonlinear systems under the influence of perturbations and binary-valued measurements. To overcome this challenge, we exploit two algorithms that leverage the framework of reproducing kernel Hilbert spaces (RKHS) to accurately identify the impulse response of the Proakis C channel. Additionally, we introduce the application of these kernel methods for estimating binary output data of nonlinear systems. We showcase the effectiveness of kernel adaptive filters in identifying nonlinear systems with binary output measurements, as demonstrated through the experimental results presented in this study.
Downloads
References
S. Haykin, Adaptive Filter Theory, 4th ed., Hoboken: Prentice Hall, 920 p., 2002 (ISBN: 9780130901262).
View in Google Scholar
M.M. Sondhi, "The History of Echo Cancellation", IEEE Signal Processing Magazine, vol. 23, no. 5, pp. 95-102, 2006 (https//doi.org/10.1109/MSP.2006.1708416).
View in Google Scholar
A.H. Sayed, Fundamentals of Adaptive Filtering, Hoboken: John Wiley & Sons, 1168 p., 2003 (ISBN: 9780471461265).
View in Google Scholar
P.S.R. Diniz, Adaptive Filtering: Algorithms and Practical Implementations, 3rd ed., New York: Springer, 652 p., 2008.
View in Google Scholar
R. Fateh, A. Darif, and S. Safi, "Kernel and Linear Adaptive Methods for the BRAN Channels Identification", in: International Conference on Advanced Intelligent Systems for Sustainable Development, Tangier, Morocco, pp. 579-591, 2020.
View in Google Scholar
R. Fateh, A. Darif, and S. Safi, "Identification of the Linear Dynamic Parts of Wiener Model Using Kernel and Linear Adaptive", in: International Conference on Advanced Intelligent Systems for Sustainable Development, Tangier, Morocco, pp. 387-400, 2020.
View in Google Scholar
E. Ferrara, "Fast Implementations of LMS Adaptive Filters", IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 28, no. 4, pp. 474-475, 1980.
View in Google Scholar
S. Sanei and J.A. Chambers, EEG Signal Processing, Hoboken: John Wiley & Sons, 289 p., 2013.
View in Google Scholar
M. Krstic, I. Kanellakopoulos, and P.V. Kokotovic, Nonlinear and Adaptive Control Design, Hoboken: John Wiley & Sons, 592 p., 1995 (ISBN: 9780471127321).
View in Google Scholar
R. Fateh, A. Darif, and S. Safi, "Channel Identification of Non-linear Systems with Binary-Valued Output Observations Based on Positive Definite Kernels", E3S Web of Conferences, vol. 297, art. no. 01020, 2021.
View in Google Scholar
R. Fateh, A. Darif, and S. Safi, "Hyperbolic Functions Impact Evaluation on Channel Identification Based on Recursive Kernel Algorithm", 2022 8th International Conference on Optimization and Applications (ICOA), Genoa, Italy, 2022.
View in Google Scholar
J.W. Xu, A.R. Paiva, I. Park, and J.C. Principe, "A Reproducing Kernel Hilbert Space Framework for Information-theoretic Learning", IEEE Transactions on Signal Processing, vol. 56, no. 12, pp. 5891-5902, 2008.
View in Google Scholar
W. Liu, J.C. Principe, and S. Haykin, Kernel Adaptive Filtering: A Comprehensive Introduction, Hoboken: John Wiley & Sons, 240 p., 2010 (ISBN: 9780470447536).
View in Google Scholar
J. Shawe-Taylor and N. Cristianini, Kernel Methods for Pattern Analysis, Cambridge University Press, 462 p., 2004.
View in Google Scholar
N. Aronszajn, "Theory of Reproducing Kernels", Transactions of the American Mathematical Society, vol. 68, no. 3, pp. 337-404, 1950.
View in Google Scholar
B. Scholkopf and A. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, Cambridge: MIT Press, 2002.
View in Google Scholar
C. Cortes and V. Vapnik, "Support-vector Networks", Machine Learning, vol. 20, no. 3, pp. 273-297, 1995.
View in Google Scholar
B. Scholkopf, A. Smola, and K.R. Muller, "Kernel Principal Component Analysis", in: International Conference on Artificial Neural Networks (ICANN), Lausanne, Switzerland, pp. 583-588, 1997.
View in Google Scholar
M.A. Hearst, S.T. Dumais, E. Osuna, J. Platt, and B. Scholkopf, "Support Vector Machines", IEEE Intelligent Systems and Their Applications, vol. 13, no. 4, pp. 18-28, 1998.
View in Google Scholar
M. Zidane and R. Dinis, "A New Combination of Adaptive Channel Estimation Methods and TORC Equalizer in MC-CDMA Systems", International Journal of Communication Systems, vol. 33, no. 11, art. no. 4429, 2020.
View in Google Scholar
M. Zidane, S. Safi, and M. Sabri, "Measured and Estimated Data of Non-linear BRAN Channels Using HOS in 4G Wireless Communications", Data in Brief, vol. 17, pp. 1136-1148, 2018.
View in Google Scholar
R. Fateh, A. Darif, and S. Safi, "Performance Evaluation of MC-CDMA Systems with Single User Detection Technique using Kernel and Linear Adaptive Method", Journal of Telecommunications and Information Technology, no. 4, pp. 1-11, 2021.
View in Google Scholar
M. Zidane, S. Safi, and M. Sabri, "Compensation of Fading Channels Using Partial Combining Equalizer in MC-CDMA Systems", Journal of Telecommunications and Information Technology, no. 1, pp. 5-11, 2017 (http://dlibra.itl.waw.pl/dlibra-webapp/Content/1962/ISSN_1509-4553_1_2017_5.pdf).
View in Google Scholar
S. Safi, M. Frikel, A. Zeroual, and M. M’Saad, "Higher Order Cumulants for Identification and Equalization of Multicarrier Spreading Spectrum Systems", Journal of Telecommunications and Information Technology, no. 1, pp. 74-84, 2011.
View in Google Scholar
W. Liu, P.P. Pokharel, and J.C. Principe, "The Kernel Least-mean-square Algorithm", IEEE Transactions on Signal Processing, vol. 56, no. 2, pp. 543-554, 2008.
View in Google Scholar
C. Richard, J. Bermudez, and P. Honeine, "Online Prediction of Time Series Data with Kernels", IEEE Transactions on Signal Processing, vol. 57, no. 3, pp. 1058-1067, 2009.
View in Google Scholar
R. Fateh, A. Darif, and S. Safi, "An Extended Version of the Proportional Adaptive Algorithm Based on Kernel Methods for Channel Identification with Binary Measurements", Journal of Telecommunications and Information Technology, no. 3, pp. 47-58, 2022.
View in Google Scholar
S. Ciochina, C. Paleologu, and J. Benesty, "An Optimized NLMS Algorithm for System Identification", Signal Processing, vol. 118, pp. 115-121, 2016.
View in Google Scholar
L. Ljung, System Identification: Theory for the User, 2nd ed., Hoboken: Prentice Hall, 640 p., 1999 (ISBN: 9780136566953).
View in Google Scholar
F. Ding, System Identification-Performances Analysis for Identification Methods, Beijing: Science Press, 2014.
View in Google Scholar
X. Zhang, F. Ding, F.E. Alsaadi, and T. Hayat, "Recursive Parameter Identification of the Dynamical Models for Bilinear State Space Systems", Nonlinear Dynamics, vol. 89, pp. 2415-2429, 2017.
View in Google Scholar
L. Xu, "Application of the Newton Iteration Algorithm to the Parameter Estimation for Dynamical Systems", Journal of Computational and Applied Mathematics, vol. 288, pp. 33-43, 2015.
View in Google Scholar
Q. Song, "Recursive Identification of Systems with Binary-valued Outputs and with ARMA Noises", Automatica, vol. 93, pp.106-113, 2018.
View in Google Scholar
J. Guo, X. Wang, W. Xue, and Y. Zhao, "System Identification with Binary-valued Observations under Data Tampering Attacks", IEEE Transactions on Automatic Control, vol. 66, no. 8, pp. 3825-3832, 2020.
View in Google Scholar
L. Li, F. Wang, H. Zhang, and X. Ren, "A Novel Recursive Learning Estimation Algorithm of Wiener Systems with Quantized Observations", ISA Transactions, vol. 112, pp. 23-34, 2021.
View in Google Scholar
L. Zhang, Y. Zhao, and L. Guo, "Identification and Adaptation with Binary-valued Observations under Non-persistent Excitation Condition", Automatica, vol. 138, art. no. 110158, 2022.
View in Google Scholar
R. Fateh and A. Darif, "Mean Square Convergence of Reproducing Kernel for Channel Identification: Application to Bran D Channel Impulse Response", in: International Conference on Business Intelligence, Beni-Mellal, Morocco, 2021.
View in Google Scholar
W. Liu and J.C. Principe, "Kernel Affine Projection Algorithms", EURASIP Journal on Advances in Signal Processing, vol. 2008, art. no. 784292, 2008.
View in Google Scholar
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Rachid Fateh, Hicham Oualla, Es-said Azougaghe, Anouar Darif, Ahmed Boumezzough, Said Safi, Mathieu Pouliquen, Miloud Frikel
This work is licensed under a Creative Commons Attribution 4.0 International License.
