Open Access
A fuzzy association rule-based classifier for imbalanced classification problems
(Elsevier, 2021) Sanz Delgado, José Antonio; Sesma Sara, Mikel; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa
Imbalanced classification problems are attracting the attention of the research community because they are prevalent in real-world problems and they impose extra difficulties for learning methods. Fuzzy rule-based classification systems have been applied to cope with these problems, mostly together with sampling techniques. In this paper, we define a new fuzzy association rule-based classifier, named FARCI, to tackle directly imbalanced classification problems. Our new proposal belongs to the algorithm modification category, since it is constructed on the basis of the state-of-the-art fuzzy classifier FARC–HD. Specifically, we modify its three learning stages, aiming at boosting the number of fuzzy rules of the minority class as well as simplifying them and, for the sake of handling unequal fuzzy rule lengths, we also change the matching degree computation, which is a key step of the inference process and it is also involved in the learning process. In the experimental study, we analyze the effectiveness of each one of the new components in terms of performance, F-score, and rule base size. Moreover, we also show the superiority of the new method when compared versus FARC–HD alongside sampling techniques, another algorithm modification approach, two cost-sensitive methods and an ensemble.
Open Access
N-dimensional admissibly ordered interval-valued overlap functions and its influence in interval-valued fuzzy rule-based classification systems
(IEEE, 2021) Da Cruz Asmus, Tiago; Sanz Delgado, José Antonio; Pereira Dimuro, Graçaliz; Bedregal, Benjamin; Fernández Fernández, Francisco Javier; Bustince Sola, Humberto; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Estadística, Informática y Matemáticas
Overlap functions are a type of aggregation functions that are not required to be associative, generally used to indicate the overlapping degree between two values. They have been successfully used as a conjunction operator in several practical problems, such as fuzzy rulebased classification systems (FRBCSs) and image processing. Some extensions of overlap functions were recently proposed, such as general overlap functions and, in the interval-valued context, n-dimensional interval-valued overlap functions. The latter allow them to be applied in n-dimensional problems with interval-valued inputs, like interval-valued classification problems, where one can apply interval-valued FRBCSs (IV-FRBCSs). In this case, the choice of an appropriate total order for intervals, like an admissible order, can play an important role. However, neither the relationship between the interval order and the n-dimensional interval-valued overlap function (which may or may not be increasing for that order) nor the impact of this relationship in the classification process have been studied in the literature. Moreover, there is not a clear preferred n-dimensional interval-valued overlap function to be applied in an IV-FRBCS. Hence, in this paper we: (i) present some new results on admissible orders, which allow us to introduce the concept of n-dimensional admissibly ordered interval-valued overlap functions, that is, n-dimensional interval-valued overlap functions that are increasing with respect to an admissible order; (ii) develop a width-preserving construction method for this kind of function, derived from an admissible order and an n-dimensional overlap function, discussing some of its features; (iii) analyze the behaviour of several combinations of admissible orders and n-dimensional (admissibly ordered) interval-valued overlap functions when applied in IV-FRBCSs. All in all, the contribution of this paper resides in pointing out the effect of admissible orders and n-dimensional admissibly ordered interval-valued overlap functions, both from a theoretical and applied points of view, the latter when considering classification problems.
Open Access
Improving Michigan-style fuzzy-rule base classification generation using a Choquet-like Copula-based aggregation function
(CEUR Workshop Proceedings (CEUR-WS.org), 2021) Hinojosa-Cardenas, Edward; Sarmiento-Calisaya, Edgar; Camargo, Heloisa A.; Sanz Delgado, José Antonio; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa, PJUPNA1926
This paper presents a modification of a Michigan-style fuzzy rule based classifier by applying the Choquet-like Copula-based aggregation function, which is based on the minimum t-norm and satisfies all the conditions required for an aggregation function. The proposed new version of the algorithm aims at improving the accuracy in comparison to the original algorithm and involves two main modifications: replacing the fuzzy reasoning method of the winning rule by the one based on Choquet-like Copula-based aggregation function and changing the calculus of the fitness of each fuzzy rule. The modification proposed, as well as the original algorithm, uses a (1+1) evolutionary strategy for learning the fuzzy rulebase and it shows promising results in terms of accuracy, compared to the original algorithm, over ten classification datasets with different sizes and different numbers of variables and clases.
Open Access
General admissibly ordered interval-valued overlap functions
(CEUR Workshop Proceedings (CEUR-WS.org), 2021) Da Cruz Asmus, Tiago; Pereira Dimuro, Graçaliz; Sanz Delgado, José Antonio; Wieczynski, Jonata; Lucca, Giancarlo; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa
Overlap functions are a class of aggregation functions that measure the verlapping degree between two values. They have been successfully applied in several problems in which associativity is not required, such as classification and image processing. Some generalizations of overlap functions were proposed for them to be applied in problems with more than two classes, such as 𝑛- dimensional and general overlap functions. To measure the overlapping of interval data, interval-valued overlap functions were defined, and, later, they were also generalized in the form of 𝑛-dimensional and general interval-valued overlap functions. In order to apply some of those concepts in problems with interval data considering the use of admissible orders, which are total orders that refine the most used partial order for intervals, 𝑛-dimensional admissibly ordered interval-valued overlap functions were recently introduced, proving to be suitable to be applied in classification problems. However, the sole construction method presented for this kind of function do not allow the use of the well known lexicographical orders. So, in this work we combine previous developments to introduce general admissibly ordered interval-valued overlap functions, while also presenting different construction methods and the possibility to combine such methods, showcasing the flexibility and adaptability of this approach, while also being compatible with the lexicographical orders.
Open Access
Towards interval uncertainty propagation control in bivariate aggregation processes and the introduction of width-limited interval-valued overlap functions
(Elsevier, 2021) Da Cruz Asmus, Tiago; Pereira Dimuro, Graçaliz; Bedregal, Benjamin; Sanz Delgado, José Antonio; Mesiar, Radko; Bustince Sola, Humberto; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Estadística, Informática y Matemáticas; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa
Overlap functions are a class of aggregation functions that measure the overlapping degree between two values. They have been successfully applied as a fuzzy conjunction operation in several problems in which associativity is not required, such as image processing and classification. Interval-valued overlap functions were defined as an extension to express the overlapping of interval-valued data, and they have been usually applied when there is uncertainty regarding the assignment of membership degrees, as in interval-valued fuzzy rule-based classification systems. In this context, the choice of a total order for intervals can be significant, which motivated the recent developments on interval-valued aggregation functions and interval-valued overlap functions that are increasing to a given admissible order, that is, a total order that refines the usual partial order for intervals. Also, width preservation has been considered on these recent works, in an intent to avoid the uncertainty increase and guarantee the information quality, but no deeper study was made regarding the relation between the widths of the input intervals and the output interval, when applying interval-valued functions, or how one can control such uncertainty propagation based on this relation. Thus, in this paper we: (i) introduce and develop the concepts of width-limited interval-valued functions and width limiting functions, presenting a theoretical approach to analyze the relation between the widths of the input and output intervals of bivariate interval-valued functions, with special attention to interval-valued aggregation functions; (ii) introduce the concept of (a,b)-ultramodular aggregation functions, a less restrictive extension of one-dimension convexity for bivariate aggregation functions, which have an important predictable behaviour with respect to the width when extended to the interval-valued context; (iii) define width-limited interval-valued overlap functions, taking into account a function that controls the width of the output interval and a new notion of increasingness with respect to a pair of partial orders (≤1,≤2); (iv) present and compare three construction methods for these width-limited interval-valued overlap functions, considering a pair of orders (≤1,≤2), which may be admissible or not, showcasing the adaptability of our developments.
Open Access
dCF-integrals: generalizing CF-integrals by means of restricted dissimilarity functions
(IEEE, 2022) Wieczynski, Jonata; Lucca, Giancarlo; Pereira Dimuro, Graçaliz; Borges, Eduardo N.; Sanz Delgado, José Antonio; Da Cruz Asmus, Tiago; Fernández Fernández, Francisco Javier; Bustince Sola, Humberto; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Estadística, Informática y Matemáticas; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa, PJUPNA1926
The Choquet integral (CI) is an averaging aggregation function that has been used, e.g., in the fuzzy reasoning method (FRM) of fuzzy rule-based classification systems (FRBCSs) and in multicriteria decision making in order to take into account the interactions among data/criteria. Several generalizations of the CI have been proposed in the literature in order to improve the performance of FRBCSs and also to provide more flexibility in the different models by relaxing both the monotonicity requirement and averaging conditions of aggregation functions. An important generalization is the CF -integrals, which are preaggregation functions that may present interesting nonaveraging behavior depending on the function F adopted in the construction and, in this case, offering competitive results in classification. Recently, the concept of d-Choquet integrals was introduced as a generalization of the CI by restricted dissimilarity functions (RDFs), improving the usability of CIs, as when comparing inputs by the usual difference may not be viable. The objective of this article is to introduce the concept of dCF -integrals, which is a generalization of CF -integrals by RDFs. The aim is to analyze whether the usage of dCF -integrals in the FRM of FRBCSs represents a good alternative toward the standard CF -integrals that just consider the difference as a dissimilarity measure. For that, we consider six RDFs combined with five fuzzy measures, applied with more than 20 functions F . The analysis of the results is based on statistical tests, demonstrating their efficiency. Additionally, comparing the applicability of dCF -integrals versus CF -integrals, the range of the good generalizations of the former is much larger than that of the latter.
Open Access
Motor-imagery-based brain-computer interface using signal derivation and aggregation functions
(IEEE, 2021) Fumanal Idocin, Javier; Wang, Yu-Kai; Lin, Chin-Teng; Fernández Fernández, Francisco Javier; Sanz Delgado, José Antonio; Bustince Sola, Humberto; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Estadística, Informática y Matemáticas
Brain Computer Interface (BCI) technologies are popular methods of communication between the human brain and external devices. One of the most popular approaches to BCI is Motor Imagery (MI). In BCI applications, the ElectroEncephaloGraphy (EEG) is a very popular measurement for brain dynamics because of its non-invasive nature. Although there is a high interest in the BCI topic, the performance of existing systems is still far from ideal, due to the difficulty of performing pattern recognition tasks in EEG signals. This difficulty lies in the selection of the correct EEG channels, the signal-tonoise ratio of these signals and how to discern the redundant information among them. BCI systems are composed of a wide range of components that perform signal pre-processing, feature extraction and decision making. In this paper, we define a new BCI Framework, named Enhanced Fusion Framework, where we propose three different ideas to improve the existing MI-based BCI frameworks. Firstly, we include an additional pre-processing step of the signal: a differentiation of the EEG signal that makes it time-invariant. Secondly, we add an additional frequency band as feature for the system: the Sensory Motor Rhythm band, and we show its effect on the performance of the system. Finally, we make a profound study of how to make the final decision in the system. We propose the usage of both up to six types of different classifiers and a wide range of aggregation functions (including classical aggregations, Choquet and Sugeno integrals and their extensions and overlap functions) to fuse the information given by the considered classifiers. We have tested this new system on a dataset of 20 volunteers performing motor imagery-based braincomputer interface experiments. On this dataset, the new system achieved a 88.80% of accuracy. We also propose an optimized version of our system that is able to obtain up to 90, 76%. Furthermore, we find that the pair Choquet/Sugeno integrals and overlap functions are the ones providing the best results.
Open Access
Interval-valued aggregation functions based on moderate deviations applied to motor-imagery-based brain computer interface
(IEEE, 2021) Fumanal Idocin, Javier; Takáč, Zdenko; Fernández Fernández, Francisco Javier; Sanz Delgado, José Antonio; Goyena Baroja, Harkaitz; Lin, Chin-Teng; Wang, Yu-Kai; Bustince Sola, Humberto; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Estadística, Informática y Matemáticas
In this work we develop moderate deviation functions to measure similarity and dissimilarity among a set of given interval-valued data to construct interval-valued aggregation functions, and we apply these functions in two MotorImagery Brain Computer Interface (MI-BCI) systems to classify electroencephalography signals. To do so, we introduce the notion of interval-valued moderate deviation function and, in particular, we study those interval-valued moderate deviation functions which preserve the width of the input intervals. In order to apply them in a MI-BCI system, we first use fuzzy implication operators to measure the uncertainty linked to the output of each classifier in the ensemble of the system, and then we perform the decision making phase using the new interval-valued aggregation functions. We have tested the goodness of our proposal in two MI-BCI frameworks, obtaining better results than those obtained using other numerical aggregation and interval-valued OWA operators, and obtaining competitive results versus some non aggregation-based frameworks.