Open Access
Generalizando el pooling maximo por funciones (a, b)-grouping en redes neuronales convolucionales
(CAEPIA, 2024) Rodríguez Martínez, Iosu; Da Cruz Asmus, Tiago; Pereira Dimuro, Graçaliz; Herrera, Francisco; Takáč, Zdenko; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Gobierno de Navarra / Nafarroako Gobernua
Este artículo es un resumen del trabajo publicado en la revista Information Fusion [1]. En este artículo explorábamos el reemplazo del operador de pooling máximo comunmente empleado en redes neuronales convolucionales (CNNs) por funciones (a, b)-grouping. Estas funciones extienden el concepto de función de grouping clásica [2] a un intervalo cerrado [a, b], siguiendo la filosofía de [3]. En el contexto del operador de pooling, estas nuevas funciones ayudan a la optimización de los modelos suavizando los gradientes en el proceso de retropropagación y obteniendo resultados competitivos con métodos más complejos
Open Access
Application of the Sugeno integral in fuzzy rule-based classification
(Elsevier, 2024-09-27) Wieczynski, Jonata; Lucca, Giancarlo; Borges, Eduardo N.; Urío Larrea, Asier; López Molina, Carlos; Bustince Sola, Humberto; Pereira Dimuro, Graçaliz; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa
Fuzzy Rule-Based Classification System (FRBCS) is a well-known technique to deal with classification problems. Recent studies have considered the usage of the Choquet integral and its generalizations (e.g.: 𝐶𝑇 -integral, 𝐶𝐹 - Integral and 𝐶𝐶-integral) to enhance the performance of such systems. Such fuzzy integrals were applied to the Fuzzy Reasoning Method (FRM) to aggregate the fired fuzzy rules when classifying new data. However, the Sugeno integral, another well-known aggregation operator, obtained good results in other applications, such as brain–computer interfaces. These facts led to the present study, in which we consider the Sugeno integral in classification problems. That is, the Sugeno integral is applied in the FRM of a widely used FRBCS, and its performance is analyzed over 33 different datasets from the literature, also considering different fuzzy measures. To show the efficiency of this new approach, the results obtained are also compared with previous studies that involved the application of different aggregation functions. Finally, we perform a statistical analysis of the application.
Open Access
Explainable classification methods for fish species detection using hydroacoustic data
(IEEE, 2021) Costa, Lucas Tubino Bonifacio; Lucca, Giancarlo; Pereira Dimuro, Graçaliz; Borges, Eduardo N.; Emmendorfer, Leonardo R.; Weigert, Stefan Cruz; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika
This work aims to evaluate explainable classification methods for the detection of fish species from hydroacoustic data acquired by echo sounders at a region near the coastline of south and southeastern Brazil. Decision trees and fuzzy rule-based methods were adopted. The fitted models were evaluated by quality measures based on the performance of the classifiers and also by an expert which analyzed the usefulness of the rules on describing the schools. The models learned by the algorithms performed well for the available data and were able to represent the documented behavior of the species considered in the studied region, according to the literature.
Open Access
Abstract homogeneous functions and consistently influenced/disturbed multi-expert decision making
(IEEE, 2021) Santiago, Regivan; Bedregal, Benjamin; Pereira Dimuro, Graçaliz; Fernández Fernández, Francisco Javier; Bustince Sola, Humberto; Fardoun, Habib; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika
In this paper we propose a new generalization for the notion of homogeneous functions. We show some properties and how it appears in some scenarios. Finally we show how this generalization can be used in order to provide a new paradigm for decision making theory called consistent influenced/disturbed decision making. In order to illustrate the applicability of this new paradigm, we provide a toy example.
Open Access
Additively generated (a,b)-implication functions*
(IEEE, 2023) Santos, Helida; Pereira Dimuro, Graçaliz; Bedregal, Benjamin; Paiva, Rui; Lucca, Giancarlo; Moura, Bruno; Cruz, Anderson; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika
Some problems involving classification through neural networks are known to use inputs out of the scope of the unit interval. Therefore, defining operations on arbitrary closed real intervals may be an interesting strategy to tackle this issue and enhance those application environments. In this paper we follow the ideas already discussed in the literature regarding (a,b)-fusion functions, and (a,b)-negations, to provide a new way to construct implication functions. The main idea is to construct an operator using additively generated functions that preserve the properties required by implication functions.
Open Access
VCI-LSTM: Vector choquet integral-based long short-term memory
(IEEE, 2022) Ferrero Jaurrieta, Mikel; Takáč, Zdenko; Fernández Fernández, Francisco Javier; Horanská, Lubomíra; Pereira Dimuro, Graçaliz; Montes Rodríguez, Susana; Díaz, Irene; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika
Choquet integral is a widely used aggregation operator on one-dimensional and interval-valued information, since it is able to take into account the possible interaction among data. However, there are many cases where the information taken into account is vectorial, such as Long Short-Term Memories (LSTM). LSTM units are a kind of Recurrent Neural Networks that have become one of the most powerful tools to deal with sequential information since they have the power of controlling the information flow. In this paper, we first generalize the standard Choquet integral to admit an input composed by $n$-dimensional vectors, which produces an $n$-dimensional vector output. We study several properties and construction methods of vector Choquet integrals. Then, we use this integral in the place of the summation operator, introducing in this way the new VCI-LSTM architecture. Finally, we use the proposed VCI-LSTM to deal with two problems: sequential image classification and text classification.
Open Access
Generalizing max pooling via (a, b)-grouping functions for convolutional neural networks
(Elsevier, 2023) Rodríguez Martínez, Iosu; Da Cruz Asmus, Tiago; Pereira Dimuro, Graçaliz; Herrera, Francisco; Takáč, Zdenko; Bustince Sola, Humberto; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Universidad Pública de Navarra / Nafarroako Unibertsitate Publikoa
Due to their high adaptability to varied settings and effective optimization algorithm, Convolutional Neural Networks (CNNs) have set the state-of-the-art on image processing jobs for the previous decade. CNNs work in a sequential fashion, alternating between extracting significant features from an input image and aggregating these features locally through ‘‘pooling" functions, in order to produce a more compact representation. Functions like the arithmetic mean or, more typically, the maximum are commonly used to perform this downsampling operation. Despite the fact that many studies have been devoted to the development of alternative pooling algorithms, in practice, ‘‘max-pooling" still equals or exceeds most of these possibilities, and has become the standard for CNN construction. In this paper we focus on the properties that make the maximum such an efficient solution in the context of CNN feature downsampling and propose its replacement by grouping functions, a family of functions that share those desirable properties. In order to adapt these functions to the context of CNNs, we present (𝑎, 𝑏)- grouping functions, an extension of grouping functions to work with real valued data. We present different construction methods for (𝑎, 𝑏)-grouping functions, and demonstrate their empirical applicability for replacing max-pooling by using them to replace the pooling function of many well-known CNN architectures, finding promising results.
Open Access
A generalization of the Sugeno integral to aggregate interval-valued data: an application to brain computer interface and social network analysis
(Elsevier, 2022) Fumanal Idocin, Javier; Takáč, Zdenko; Horanská, Lubomíra; Da Cruz Asmus, Tiago; Pereira Dimuro, Graçaliz; Vidaurre Arbizu, Carmen; Fernández Fernández, Francisco Javier; Bustince Sola, Humberto; Institute of Smart Cities - ISC
Intervals are a popular way to represent the uncertainty related to data, in which we express the vagueness of each observation as the width of the interval. However, when using intervals for this purpose, we need to use the appropriate set of mathematical tools to work with. This can be problematic due to the scarcity and complexity of interval-valued functions in comparison with the numerical ones. In this work, we propose to extend a generalization of the Sugeno integral to work with interval-valued data. Then, we use this integral to aggregate interval-valued data in two different settings: first, we study the use of intervals in a brain-computer interface; secondly, we study how to construct interval-valued relationships in a social network, and how to aggregate their information. Our results show that interval-valued data can effectively model some of the uncertainty and coalitions of the data in both cases. For the case of brain-computer interface, we found that our results surpassed the results of other interval-valued functions.
Open Access
Aggregation functions based on the Choquet integral applied to image resizing
(Atlantis Press, 2019) Bueno, Jéssica C. S.; Dias, Camila A.; Pereira Dimuro, Graçaliz; Santos, Helida; Bustince Sola, Humberto; Estatistika, Informatika eta Matematika; Institute of Smart Cities - ISC; Estadística, Informática y Matemáticas
The rising volume of data and its high complexity has brought the need of developing increasingly efficient knowledge extraction techniques, which demands efficiency both in computational cost and in accuracy. Most of problems that are handled by these techniques has complex information to be identified. So, machine learning methods are frequently used, where a variety of functions can be applied in the different steps that are employed in their architecture. One of them is the use of aggregation functions aiming at resizing images. In this context, we introduce a study of aggregation functions based on the Choquet integral, whose main characteristic in comparison with other aggregation functions is that it considers, through fuzzy measure, the interaction between the elements to be aggregated. Thus, our main goal is to present an evaluation study of the performance of the standard Choquet integral the and copula-based generalization of the Choquet integral in relation to the maximum and mean functions, looking for results that may be better than the aggregation functions commonly applied. The results of such comparisons are promising, when evaluated through image quality metrics.
Open Access
d-XC integrals: on the generalization of the expanded form of the Choquet integral by restricted dissimilarity functions and their applications
(IEEE, 2022) Wieczynski, Jonata; Fumanal Idocin, Javier; Lucca, Giancarlo; Borges, Eduardo N.; Da Cruz Asmus, Tiago; Emmendorfer, Leonardo R.; Bustince Sola, Humberto; Pereira Dimuro, Graçaliz; Automática y Computación; Automatika eta Konputazioa; Estadística, Informática y Matemáticas; Estatistika, Informatika eta Matematika
Restricted dissimilarity functions (RDFs) were introduced to overcome problems resulting from the adoption of the standard difference. Based on those RDFs, Bustince et al. introduced a generalization of the Choquet integral (CI), called d-Choquet integral, where the authors replaced standard differences with RDFs, providing interesting theoretical results. Motivated by such worthy properties, joint with the excellent performance in applications of other generalizations of the CI (using its expanded form, mainly), this paper introduces a generalization of the expanded form of the standard Choquet integral (X-CI) based on RDFs, which we named d-XC integrals. We present not only relevant theoretical results but also two examples of applications. We apply d-XC integrals in two problems in decision making, namely a supplier selection problem (which is a multi-criteria decision making problem) and a classification problem in signal processing, based on motor-imagery brain-computer interface (MI-BCI). We found that two d-XC integrals provided better results when compared to the original CI in the supplier selection problem. Besides that, one of the d-XC integrals performed better than any previous MI-BCI results obtained with this framework in the considered signal processing problem.