Open Access
Generalizando el pooling maximo por funciones (a, b)-grouping en redes neuronales convolucionales
(CAEPIA, 2024) Rodríguez Martínez, Iosu; Da Cruz Asmus, Tiago; Pereira Dimuro, Graçaliz; Herrera, Francisco; Takáč, Zdenko; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Gobierno de Navarra / Nafarroako Gobernua
Este artículo es un resumen del trabajo publicado en la revista Information Fusion [1]. En este artículo explorábamos el reemplazo del operador de pooling máximo comunmente empleado en redes neuronales convolucionales (CNNs) por funciones (a, b)-grouping. Estas funciones extienden el concepto de función de grouping clásica [2] a un intervalo cerrado [a, b], siguiendo la filosofía de [3]. En el contexto del operador de pooling, estas nuevas funciones ayudan a la optimización de los modelos suavizando los gradientes en el proceso de retropropagación y obteniendo resultados competitivos con métodos más complejos
Open Access
Applying d-XChoquet integrals in classification problems
(IEEE, 2022) Wieczynski, Jonata; Lucca, Giancarlo; Borges, Eduardo N.; Emmendorfer, Leonardo R.; Ferrero Jaurrieta, Mikel; Pereira Dimuro, Graçaliz; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika
Several generalizations of the Choquet integral have been applied in the Fuzzy Reasoning Method (FRM) of Fuzzy Rule-Based Classification Systems (FRBCS's) to improve its performance. Additionally, to achieve that goal, researchers have searched for new ways to provide more flexibility to those generalizations, by restricting the requirements of the functions being used in their constructions and relaxing the monotonicity of the integral. This is the case of CT-integrals, CC-integrals, CF-integrals, CF1F2-integrals and dCF-integrals, which obtained good performance in classification algorithms, more specifically, in the fuzzy association rule-based classification method for high-dimensional problems (FARC-HD). Thereafter, with the introduction of Choquet integrals based on restricted dissimilarity functions (RDFs) in place of the standard difference, a new generalization was made possible: the d-XChoquet (d-XC) integrals, which are ordered directional increasing functions and, depending on the adopted RDF, may also be a pre-aggregation function. Those integrals were applied in multi-criteria decision making problems and also in a motor-imagery brain computer interface framework. In the present paper, we introduce a new FRM based on the d-XC integral family, analyzing its performance by applying it to 33 different datasets from the literature.
Open Access
Admissible OWA operators for fuzzy numbers
(Elsevier, 2024) García-Zamora, Diego; Cruz, Anderson; Neres, Fernando; Santiago, Regivan; Roldán López de Hierro, Antonio Francisco; Paiva, Rui; Pereira Dimuro, Graçaliz; Martínez López, Luis; Bedregal, Benjamin; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC
Ordered Weighted Averaging (OWA) operators are some of the most widely used aggregation functions in classic literature, but their application to fuzzy numbers has been limited due to the complexity of defining a total order in fuzzy contexts. However, the recent notion of admissible order for fuzzy numbers provides an effective method to totally order them by refining a given partial order. Therefore, this paper is devoted to defining OWA operators for fuzzy numbers with respect to admissible orders and investigating their properties. Firstly, we define the OWA operators associated with such admissible orders and then we show their main properties. Afterward, an example is presented to illustrate the applicability of these AOWA operators in linguistic decision-making. In this regard, we also develop an admissible order for trapezoidal fuzzy numbers that can be efficiently applied in practice.
Open Access
On fuzzy implications derived from general overlap functions and their relation to other classes
(MDPI, 2023) Pinheiro, Jocivania; Santos, Helida; Pereira Dimuro, Graçaliz; Bedregal, Benjamin; Santiago, Regivan; Fernández Fernández, Francisco Javier; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC
There are distinct techniques to generate fuzzy implication functions. Despite most of them using the combination of associative aggregators and fuzzy negations, other connectives such as (general) overlap/grouping functions may be a better strategy. Since these possibly non-associative operators have been successfully used in many applications, such as decision making, classification and image processing, the idea of this work is to continue previous studies related to fuzzy implication functions derived from general overlap functions. In order to obtain a more general and flexible context, we extend the class of implications derived by fuzzy negations and t-norms, replacing the latter by general overlap functions, obtaining the so-called (GO, N)-implication functions. We also investigate their properties, the aggregation of (GO, N)-implication functions, their characterization and the intersections with other classes of fuzzy implication functions.
Open Access
A generalization of the Sugeno integral to aggregate interval-valued data: an application to brain computer interface and social network analysis
(Elsevier, 2022) Fumanal Idocin, Javier; Takáč, Zdenko; Horanská, Lubomíra; Da Cruz Asmus, Tiago; Pereira Dimuro, Graçaliz; Vidaurre Arbizu, Carmen; Fernández Fernández, Francisco Javier; Bustince Sola, Humberto; Institute of Smart Cities - ISC
Intervals are a popular way to represent the uncertainty related to data, in which we express the vagueness of each observation as the width of the interval. However, when using intervals for this purpose, we need to use the appropriate set of mathematical tools to work with. This can be problematic due to the scarcity and complexity of interval-valued functions in comparison with the numerical ones. In this work, we propose to extend a generalization of the Sugeno integral to work with interval-valued data. Then, we use this integral to aggregate interval-valued data in two different settings: first, we study the use of intervals in a brain-computer interface; secondly, we study how to construct interval-valued relationships in a social network, and how to aggregate their information. Our results show that interval-valued data can effectively model some of the uncertainty and coalitions of the data in both cases. For the case of brain-computer interface, we found that our results surpassed the results of other interval-valued functions.
Open Access
VCI-LSTM: Vector choquet integral-based long short-term memory
(IEEE, 2022) Ferrero Jaurrieta, Mikel; Takáč, Zdenko; Fernández Fernández, Francisco Javier; Horanská, Lubomíra; Pereira Dimuro, Graçaliz; Montes Rodríguez, Susana; Díaz, Irene; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika
Choquet integral is a widely used aggregation operator on one-dimensional and interval-valued information, since it is able to take into account the possible interaction among data. However, there are many cases where the information taken into account is vectorial, such as Long Short-Term Memories (LSTM). LSTM units are a kind of Recurrent Neural Networks that have become one of the most powerful tools to deal with sequential information since they have the power of controlling the information flow. In this paper, we first generalize the standard Choquet integral to admit an input composed by $n$-dimensional vectors, which produces an $n$-dimensional vector output. We study several properties and construction methods of vector Choquet integrals. Then, we use this integral in the place of the summation operator, introducing in this way the new VCI-LSTM architecture. Finally, we use the proposed VCI-LSTM to deal with two problems: sequential image classification and text classification.
Open Access
Generalizing max pooling via (a, b)-grouping functions for convolutional neural networks
(Elsevier, 2023) Rodríguez Martínez, Iosu; Da Cruz Asmus, Tiago; Pereira Dimuro, Graçaliz; Herrera, Francisco; Takáč, Zdenko; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa
Due to their high adaptability to varied settings and effective optimization algorithm, Convolutional Neural Networks (CNNs) have set the state-of-the-art on image processing jobs for the previous decade. CNNs work in a sequential fashion, alternating between extracting significant features from an input image and aggregating these features locally through ‘‘pooling" functions, in order to produce a more compact representation. Functions like the arithmetic mean or, more typically, the maximum are commonly used to perform this downsampling operation. Despite the fact that many studies have been devoted to the development of alternative pooling algorithms, in practice, ‘‘max-pooling" still equals or exceeds most of these possibilities, and has become the standard for CNN construction. In this paper we focus on the properties that make the maximum such an efficient solution in the context of CNN feature downsampling and propose its replacement by grouping functions, a family of functions that share those desirable properties. In order to adapt these functions to the context of CNNs, we present (𝑎, 𝑏)- grouping functions, an extension of grouping functions to work with real valued data. We present different construction methods for (𝑎, 𝑏)-grouping functions, and demonstrate their empirical applicability for replacing max-pooling by using them to replace the pooling function of many well-known CNN architectures, finding promising results.
Open Access
Type-(2, k) overlap indices
(IEEE, 2022) Roldán López de Hierro, Antonio Francisco; Roldán, Concepción; Tíscar, Miguel Ángel; Takáč, Zdenko; Santiago, Regivan; Bustince Sola, Humberto; Fernández Fernández, Francisco Javier; Pereira Dimuro, Graçaliz; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika
Automatic image detection is one of the most im- portant areas in computing due to its potential application in numerous real-world scenarios. One important tool to deal with that is called overlap indices. They were introduced as a procedure to provide the maximum lack of knowledge when comparing two fuzzy objects. They have been successfully applied in the following fields: image processing, fuzzy rule-based systems, decision making and computational brain interfaces. This notion of overlap indices is also necessary for applications in which type-2 fuzzy sets are required. In this paper we introduce the notion of type-(2, k) overlap index (k 0, 1, 2) in the setting of type-2 fuzzy sets. We describe both the reasons that have led to this notion and the relationships that naturally arise among the algebraic underlying structures. Finally, we illustrate how type- (2, k) overlap indices can be employed in the setting of fuzzy rule-based systems when the involved objects are type-2 fuzzy sets.
Open Access
d-XC integrals: on the generalization of the expanded form of the Choquet integral by restricted dissimilarity functions and their applications
(IEEE, 2022) Wieczynski, Jonata; Fumanal Idocin, Javier; Lucca, Giancarlo; Borges, Eduardo N.; Da Cruz Asmus, Tiago; Emmendorfer, Leonardo R.; Bustince Sola, Humberto; Pereira Dimuro, Graçaliz; Automática y Computación; Automatika eta Konputazioa; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika
Restricted dissimilarity functions (RDFs) were introduced to overcome problems resulting from the adoption of the standard difference. Based on those RDFs, Bustince et al. introduced a generalization of the Choquet integral (CI), called d-Choquet integral, where the authors replaced standard differences with RDFs, providing interesting theoretical results. Motivated by such worthy properties, joint with the excellent performance in applications of other generalizations of the CI (using its expanded form, mainly), this paper introduces a generalization of the expanded form of the standard Choquet integral (X-CI) based on RDFs, which we named d-XC integrals. We present not only relevant theoretical results but also two examples of applications. We apply d-XC integrals in two problems in decision making, namely a supplier selection problem (which is a multi-criteria decision making problem) and a classification problem in signal processing, based on motor-imagery brain-computer interface (MI-BCI). We found that two d-XC integrals provided better results when compared to the original CI in the supplier selection problem. Besides that, one of the d-XC integrals performed better than any previous MI-BCI results obtained with this framework in the considered signal processing problem.
Open Access
Application of the Sugeno integral in fuzzy rule-based classification
(Elsevier, 2024-09-27) Wieczynski, Jonata; Lucca, Giancarlo; Borges, Eduardo N.; Urío Larrea, Asier; López Molina, Carlos; Bustince Sola, Humberto; Pereira Dimuro, Graçaliz; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa
Fuzzy Rule-Based Classification System (FRBCS) is a well-known technique to deal with classification problems. Recent studies have considered the usage of the Choquet integral and its generalizations (e.g.: 𝐶𝑇 -integral, 𝐶𝐹 - Integral and 𝐶𝐶-integral) to enhance the performance of such systems. Such fuzzy integrals were applied to the Fuzzy Reasoning Method (FRM) to aggregate the fired fuzzy rules when classifying new data. However, the Sugeno integral, another well-known aggregation operator, obtained good results in other applications, such as brain–computer interfaces. These facts led to the present study, in which we consider the Sugeno integral in classification problems. That is, the Sugeno integral is applied in the FRM of a widely used FRBCS, and its performance is analyzed over 33 different datasets from the literature, also considering different fuzzy measures. To show the efficiency of this new approach, the results obtained are also compared with previous studies that involved the application of different aggregation functions. Finally, we perform a statistical analysis of the application.