Open Access
CFM-BD: a distributed rule induction algorithm for building compact fuzzy models in Big Data classification problems
(IEEE, 2020) Elkano Ilintxeta, Mikel; Sanz Delgado, José Antonio; Barrenechea Tartas, Edurne; Bustince Sola, Humberto; Galar Idoate, Mikel; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Estadística, Informática y Matemáticas
Interpretability has always been a major concern for fuzzy rule-based classifiers. The usage of human-readable models allows them to explain the reasoning behind their predictions and decisions. However, when it comes to Big Data classification problems, fuzzy rule based classifiers have not been able to maintain the good tradeoff between accuracy and interpretability that has characterized these techniques in non-Big-Data environments. The most accurate methods build models composed of a large number of rules and fuzzy sets that are too complex, while those approaches focusing on interpretability do not provide state-of-the-art discrimination capabilities. In this paper, we propose a new distributed learning algorithm named CFM-BD to construct accurate and compact fuzzy rule-based classification systems for Big Data. This method has been specifically designed from scratch for Big Data problems and does not adapt or extend any existing algorithm. The proposed learning process consists of three stages: Preprocessing based on the probability integral transform theorem; rule induction inspired by CHI-BD and Apriori algorithms; and rule selection by means of a global evolutionary optimization. We conducted a complete empirical study to test the performance of our approach in terms of accuracy, complexity, and runtime. The results obtained were compared and contrasted with four state-of-the-art fuzzy classifiers for Big Data (FBDT, FMDT, Chi-Spark-RS, and CHI-BD). According to this study, CFM-BD is able to provide competitive discrimination capabilities using significantly simpler models composed of a few rules of less than three antecedents, employing five linguistic labels for all variables.
Open Access
General grouping functions
(Springer, 2020) Santos, Helida; Pereira Dimuro, Graçaliz; Da Cruz Asmus, Tiago; Sanz Delgado, José Antonio; Fernández Fernández, Francisco Javier; Bustince Sola, Humberto; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Estadística, Informática y Matemáticas
Some aggregation functions that are not necessarily associative, namely overlap and grouping functions, have called the attention of many researchers in the recent past. This is probably due to the fact that they are a richer class of operators whenever one compares with other classes of aggregation functions, such as t-norms and t-conorms, respectively. In the present work we introduce a more general proposal for disjunctive n-ary aggregation functions entitled general grouping functions, in order to be used in problems that admit n dimensional inputs in a more flexible manner, allowing their application in different contexts. We present some new interesting results, like the characterization of that operator and also provide different construction methods.
Open Access
Pre-aggregation functions: construction and an application
(IEEE, 2015) Lucca, Giancarlo; Sanz Delgado, José Antonio; Pereira Dimuro, Graçaliz; Bedregal, Benjamin; Mesiar, Radko; Kolesárová, Anna; Bustince Sola, Humberto; Automática y Computación; Automatika eta Konputazioa
In this work we introduce the notion of preaggregation function. Such a function satisfies the same boundary conditions as an aggregation function, but, instead of requiring monotonicity, only monotonicity along some fixed direction (directional monotonicity) is required. We present some examples of such functions. We propose three different methods to build pre-aggregation functions. We experimentally show that in fuzzy rule-based classification systems, when we use one of these methods, namely, the one based on the use of the Choquet integral replacing the product by other aggregation functions, if we consider the minimum or the Hamacher product t-norms for such construction, we improve the results obtained when applying the fuzzy reasoning methods obtained using two classical averaging operators like the maximum and the Choquet integral.
Open Access
Enhancing the efficiency of the interval-valued fuzzy rule-based classifier with tuning and rule selection
(Springer, 2020) Sanz Delgado, José Antonio; Da Cruz Asmus, Tiago; Osa Hernández, Borja de la; Bustince Sola, Humberto; Institute of Smart Cities - ISC; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa, PJUPNA1926
Interval-Valued fuzzy rule-based classifier with TUning and Rule Selection, IVTURS, is a state-of-the-art fuzzy classifier. One of the key point of this method is the usage of interval-valued restricted equivalence functions because their parametrization allows one to tune them to each problem, which leads to obtaining accurate results. However, they require the application of the exponentiation several times to obtain a result, which is a time demanding operation implying an extra charge to the computational burden of the method. In this contribution, we propose to reduce the number of exponentiation operations executed by the system, so that the efficiency of the method is enhanced with no alteration of the obtained results. Moreover, the new approach also allows for a reduction on the search space of the evolutionary method carried out in IVTURS. Consequently, we also propose four different approaches to take advantage of this reduction on the search space to study if it can imply an enhancement of the accuracy of the classifier. The experimental results prove: 1) the enhancement of the efficiency of IVTURS and 2) the accuracy of IVTURS is competitive versus that of the approaches using the reduced search space.
Open Access
N-dimensional admissibly ordered interval-valued overlap functions and its influence in interval-valued fuzzy rule-based classification systems
(IEEE, 2021) Da Cruz Asmus, Tiago; Sanz Delgado, José Antonio; Pereira Dimuro, Graçaliz; Bedregal, Benjamin; Fernández Fernández, Francisco Javier; Bustince Sola, Humberto; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Estadística, Informática y Matemáticas
Overlap functions are a type of aggregation functions that are not required to be associative, generally used to indicate the overlapping degree between two values. They have been successfully used as a conjunction operator in several practical problems, such as fuzzy rulebased classification systems (FRBCSs) and image processing. Some extensions of overlap functions were recently proposed, such as general overlap functions and, in the interval-valued context, n-dimensional interval-valued overlap functions. The latter allow them to be applied in n-dimensional problems with interval-valued inputs, like interval-valued classification problems, where one can apply interval-valued FRBCSs (IV-FRBCSs). In this case, the choice of an appropriate total order for intervals, like an admissible order, can play an important role. However, neither the relationship between the interval order and the n-dimensional interval-valued overlap function (which may or may not be increasing for that order) nor the impact of this relationship in the classification process have been studied in the literature. Moreover, there is not a clear preferred n-dimensional interval-valued overlap function to be applied in an IV-FRBCS. Hence, in this paper we: (i) present some new results on admissible orders, which allow us to introduce the concept of n-dimensional admissibly ordered interval-valued overlap functions, that is, n-dimensional interval-valued overlap functions that are increasing with respect to an admissible order; (ii) develop a width-preserving construction method for this kind of function, derived from an admissible order and an n-dimensional overlap function, discussing some of its features; (iii) analyze the behaviour of several combinations of admissible orders and n-dimensional (admissibly ordered) interval-valued overlap functions when applied in IV-FRBCSs. All in all, the contribution of this paper resides in pointing out the effect of admissible orders and n-dimensional admissibly ordered interval-valued overlap functions, both from a theoretical and applied points of view, the latter when considering classification problems.
Open Access
Extensions of fuzzy sets in image processing: an overview
(EUSFLAT, 2011) Pagola Barrio, Miguel; Barrenechea Tartas, Edurne; Bustince Sola, Humberto; Fernández Fernández, Francisco Javier; Galar Idoate, Mikel; Jurío Munárriz, Aránzazu; López Molina, Carlos; Paternain Dallo, Daniel; Sanz Delgado, José Antonio; Couto, Pedro; Melo-Pinto, Pedro; Automática y Computación; Automatika eta Konputazioa
This work presents a valuable review for the interested reader of the recent Works using extensions of fuzzy sets in image processing. The chapter is divided as follows: first we recall the basics of the extensions of fuzzy sets, i.e. Type 2 fuzzy sets, interval-valued fuzzy sets and Atanassov’s intuitionistic fuzzy sets. In sequent sections we review the methods proposed for noise removal (sections 3), image enhancement (section 4), edge detection (section 5) and segmentation (section 6). There exist other image segmentation tasks such as video de-interlacing, stereo matching or object representation that are not described in this work.
Open Access
Evolution in time of L-fuzzy context sequences
(Elsevier, 2016) Alcalde, Cristina; Burusco Juandeaburre, Ana; Bustince Sola, Humberto; Jurío Munárriz, Aránzazu; Sanz Delgado, José Antonio; Automatika eta Konputazioa; Institute of Smart Cities - ISC; Automática y Computación; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa
In this work, we consider a complete lattice L and we study L-fuzzy context sequences which represent the evolution in time of an L-fuzzy context. To carry out this study, in the first part of the paper, we consider n-ary OWA operators in complete lattices, which enable us to make a general analysis and a temporal analysis at any moment in time of L-fuzzy context sequences. After that, evolution in time of the relationship between the objects and the attributes is considered. In particular, we analyze the concepts of Trend and Persistent formal contexts. Finally, we illustrate our results with an example where we consider the particular lattice L = J ([0, 1]).
Open Access
Multimodal fuzzy fusion for enhancing the motor-imagery-based brain computer interface
(IEEE, 2019) Ko, Li-Wei; Lu, Yi-Chen; Bustince Sola, Humberto; Chang, Yu-Cheng; Chang, Yang; Fernández Fernández, Francisco Javier; Wang, Yu-Kai; Sanz Delgado, José Antonio; Pereira Dimuro, Graçaliz; Lin, Chin-Teng; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Estadística, Informática y Matemáticas
Brain–computer interface technologies, such as steady-state visually evoked potential, P300, and motor imagery are methods of communication between the human brain and the external devices. Motor imagery–based brain–computer interfaces are popular because they avoid unnecessary external stimulus. Although feature extraction methods have been illustrated in several machine intelligent systems in motor imagery-based brain–computer interface studies, the performance remains unsatisfactory. There is increasing interest in the use of the fuzzy integrals, the Choquet and Sugeno integrals, that are appropriate for use in applications in which fusion of data must consider possible data interactions. To enhance the classification accuracy of brain-computer interfaces, we adopted fuzzy integrals, after employing the classification method of traditional brain–computer interfaces, to consider possible links between the data. Subsequently, we proposed a novel classification framework called the multimodal fuzzy fusion-based brain-computer interface system. Ten volunteers performed a motor imagery-based brain-computer interface experiment, and we acquired electroencephalography signals simultaneously. The multimodal fuzzy fusion-based brain-computer interface system enhanced performance compared with traditional brain–computer interface systems. Furthermore, when using the motor imagery-relevant electroencephalography frequency alpha and beta bands for the input features, the system achieved the highest accuracy, up to 78.81% and 78.45% with the Choquet and Sugeno integrals, respectively. Herein, we present a novel concept for enhancing brain–computer interface systems that adopts fuzzy integrals, especially in the fusion for classifying brain–computer interface commands.
Open Access
A fuzzy association rule-based classifier for imbalanced classification problems
(Elsevier, 2021) Sanz Delgado, José Antonio; Sesma Sara, Mikel; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa
Imbalanced classification problems are attracting the attention of the research community because they are prevalent in real-world problems and they impose extra difficulties for learning methods. Fuzzy rule-based classification systems have been applied to cope with these problems, mostly together with sampling techniques. In this paper, we define a new fuzzy association rule-based classifier, named FARCI, to tackle directly imbalanced classification problems. Our new proposal belongs to the algorithm modification category, since it is constructed on the basis of the state-of-the-art fuzzy classifier FARC–HD. Specifically, we modify its three learning stages, aiming at boosting the number of fuzzy rules of the minority class as well as simplifying them and, for the sake of handling unequal fuzzy rule lengths, we also change the matching degree computation, which is a key step of the inference process and it is also involved in the learning process. In the experimental study, we analyze the effectiveness of each one of the new components in terms of performance, F-score, and rule base size. Moreover, we also show the superiority of the new method when compared versus FARC–HD alongside sampling techniques, another algorithm modification approach, two cost-sensitive methods and an ensemble.
Open Access
A first study on the use of interval-valued fuzzy sets with genetic tuning for classification with imbalanced data sets
(Springer, 2009) Sanz Delgado, José Antonio; Fernández, Alberto; Bustince Sola, Humberto; Herrera, Francisco; Automática y Computación; Automatika eta Konputazioa
Classification with imbalanced data-sets is one of the recent challenging problems in Data Mining. In this framework, the class dis- tribution is not uniform and the separability between the classes is often difficult. From the available techniques in the Machine Learning field, we focus on the use of Fuzzy Rule Based Classification Systems, as they provide an interpretable model for the end user by means of linguistic variables. The aim of this work is to increase the performance of fuzzy modeling by adding a higher degree of knowledge by means of the use of Interval- valued Fuzzy Sets. Furthermore, we will contextualize the Interval-valued Fuzzy Sets with a post-processing genetic tuning of the amplitude of their upper bounds in order to enhance the global behaviour of this methodology.