• ProtoVAE: A Trustworthy Self-Explainable Prototypical Variational Model 

      Gautam, Srishti; Boubekki, Ahcene; Hansen, Stine; Salahuddin, Suaiba Amina; Jenssen, Robert; Hohne, Marina Marie-Claire; Kampffmeyer, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-10-15)
      The need for interpretable models has fostered the development of self-explainable classifiers. Prior approaches are either based on multi-stage optimization schemes, impacting the predictive performance of the model, or produce explanations that are not transparent, trustworthy or do not capture the diversity of the data. To address these shortcomings, we propose ProtoVAE, a variational autoencoder-based ...
    • Reconsidering Representation Alignment for Multi-View Clustering 

      Trosten, Daniel Johansen; Løkse, Sigurd Eivindson; Jenssen, Robert; Kampffmeyer, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-11-13)
      Aligning distributions of view representations is a core component of today’s state of the art models for deep multi-view clustering. However, we identify several drawbacks with naïvely aligning representation distributions. We demonstrate that these drawbacks both lead to less separable clusters in the representation space, and inhibit the model’s ability to prioritize views. Based on these ...
    • Reducing Objective Function Mismatch in Deep Clustering with the Unsupervised Companion Objective 

      Trosten, Daniel Johansen; Jenssen, Robert; Kampffmeyer, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-04-19)
      Preservation of local similarity structure is a key challenge in deep clustering. Many recent deep clustering methods therefore use autoencoders to help guide the model's neural network towards an embedding which is more reflective of the input space geometry. However, recent work has shown that autoencoder-based deep clustering models can suffer from objective function mismatch (OFM). In order to ...
    • RELAX: Representation Learning Explainability 

      Wickstrøm, Kristoffer; Trosten, Daniel Johansen; Løkse, Sigurd Eivindson; Boubekki, Ahcene; Mikalsen, Karl Øyvind; Kampffmeyer, Michael; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-03-11)
      Despite the significant improvements that self-supervised representation learning has led to when learning from unlabeled data, no methods have been developed that explain what influences the learned representation. We address this need through our proposed approach, RELAX, which is the first approach for attribution-based explanations of representations. Our approach can also model the uncertainty ...
    • Self-Constructing Graph Convolutional Networks for Semantic Labeling 

      Liu, Qinghui; Kampffmeyer, Michael; Jenssen, Robert; Salberg, Arnt-Børre (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-02-17)
      Graph Neural Networks (GNNs) have received increasing attention in many fields. However, due to the lack of prior graphs, their use for semantic labeling has been limited. Here, we propose a novel architecture called the Self-Constructing Graph (SCG), which makes use of learnable latent variables to generate embeddings and to self-construct the underlying graphs directly from the input features ...
    • Self-constructing graph neural networks to model long-range pixel dependencies for semantic segmentation of remote sensing images 

      Liu, Qinghui; Kampffmeyer, Michael; Jenssen, Robert; Salberg, Arnt Børre (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-06-16)
      Capturing global contextual representations in remote sensing images by exploiting long-range pixel-pixel dependencies has been shown to improve segmentation performance. However, how to do this efficiently is an open question as current approaches of utilising attention schemes, or very deep models to increase the field of view, increases complexity and memory consumption. Inspired by recent work ...
    • A self-guided anomaly detection-inspired few-shot segmentation network 

      Salahuddin, Suaiba Amina; Hansen, Stine; Gautam, Srishti; Kampffmeyer, Michael; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-11-13)
      Standard strategies for fully supervised semantic segmentation of medical images require large pixel-level annotated datasets. This makes such methods challenging due to the manual labor required and limits the usability when segmentation is needed for new classes for which data is scarce. Few-shot segmentation (FSS) is a recent and promising direction within the deep learning literature designed ...
    • Semi-supervised target classification in multi-frequency echosounder data 

      Choi, Changkyu; Kampffmeyer, Michael; Handegard, Nils Olav; Salberg, Arnt Børre; Brautaset, Olav; Eikvil, Line; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-08-12)
      Acoustic target classification in multi-frequency echosounder data is a major interest for the marine ecosystem and fishery management since it can potentially estimate the abundance or biomass of the species. A key problem of current methods is the heavy dependence on the manual categorization of data samples. As a solution, we propose a novel semi-supervised deep learning method leveraging a few ...
    • Short-Term Load Forecasting with Missing Data using Dilated Recurrent Attention Networks 

      Choi, Changkyu; Bianchi, Filippo Maria; Kampffmeyer, Michael; Jenssen, Robert (Conference object; Konferansebidrag, 2020-02-06)
      Forecasting the dynamics of time-varying systems is essential to maintaining the sustainability of the systems. Recent studies have discovered that Recurrent Neural Networks(RNN) applied in the forecasting tasks outperform conventional models that include AutoRegressive Integrated Moving Average(ARIMA). However, due to the structural limitation of vanilla RNN which holds unit-length internal ...
    • Short-Term Load Forecasting with Missing Data using Dilated Recurrent Attention Networks 

      Choi, Changkyu; Bianchi, Filippo Maria; Kampffmeyer, Michael; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-02-06)
      Forecasting the dynamics of time-varying systems is essential to maintaining the sustainability of the systems. Recent studies have discovered that Recurrent Neural Networks(RNN) applied in the forecasting tasks outperform conventional models that include AutoRegressive Integrated Moving Average(ARIMA). However, due to the structural limitation of vanilla RNN which holds unit-length internal ...
    • Short-Term Load Forecasting with Missing Data using Dilated Recurrent Attention Networks 

      Choi, Changkyu; Kampffmeyer, Michael; Jenssen, Robert (Conference object; Konferansebidrag, 2020)
      Data without annotation are easy to obtain in the real-world, however, established supervised learning methods are not applicable to analyze them. Several learning approaches have been proposed in recent years to exploit the underlying structure of the data without requiring annotations. Semi-supervised learning aims to improve the predictive performance of these unsupervised approaches, by exploiting ...
    • Supercm: Revisiting Clustering for Semi-Supervised Learning 

      Singh, Durgesh Kumar; Boubekki, Ahcene; Jenssen, Robert; Kampffmeyer, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-05-05)
      The development of semi-supervised learning (SSL) has in recent years largely focused on the development of new consistency regularization or entropy minimization approaches, often resulting in models with complex training strategies to obtain the desired results. In this work, we instead propose a novel approach that explicitly incorporates the underlying clustering assumption in SSL through extending ...
    • This looks more like that: Enhancing Self-Explaining Models by Prototypical Relevance Propagation 

      Gautam, Srishti; Hohne, Marina Marie-Claire; Hansen, Stine; Jenssen, Robert; Kampffmeyer, Michael (Journal article; Tidsskriftartikkel; Peer reviewed, 2022-11-12)
      Current machine learning models have shown high efficiency in solving a wide variety of real-world problems. However, their black box character poses a major challenge for the comprehensibility and traceability of the underlying decision-making strategies. As a remedy, numerous post-hoc and self-explanation methods have been developed to interpret the models’ behavior. Those methods, in addition, ...
    • Towards robust partially supervised multi-structure medical image segmentation on small-scale data 

      Dong, Nanqing; Kampffmeyer, Michael; Liang, Xiaodan; Xu, Min; Voiculescu, Irina; Xing, Eric (Journal article; Tidsskriftartikkel; Peer reviewed, 2021-11-20)
      The data-driven nature of deep learning (DL) models for semantic segmentation requires a large number of pixel-level annotations. However, large-scale and fully labeled medical datasets are often unavailable for practical tasks. Recently, partially supervised methods have been proposed to utilize images with incomplete labels in the medical domain. To bridge the methodological gaps in ...
    • Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GAN 

      Xie, Zhenyu; Huang, Zaiyu; Zhao, Fuwei; Dong, Haoye; Kampffmeyer, Michael; Liang, Xiaodan (Journal article; Tidsskriftartikkel; Peer reviewed, 2021)
      Image-based virtual try-on is one of the most promising applications of human-centric image generation due to its tremendous real-world potential. Yet, as most try-on approaches fit in-shop garments onto a target person, they require the laborious and restrictive construction of a paired training dataset, severely limiting their scalability. While a few recent works attempt to transfer garments ...
    • Uncertainty-Aware Deep Ensembles for Reliable and Explainable Predictions of Clinical Time Series 

      Wickstrøm, Kristoffer Knutsen; Mikalsen, Karl Øyvind; Kampffmeyer, Michael; Revhaug, Arthur; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-12-07)
      Deep learning-based support systems have demonstrated encouraging results in numerous clinical applications involving the processing of time series data. While such systems often are very accurate, they have no inherent mechanism for explaining what influenced the predictions, which is critical for clinical tasks. However, existing explainability techniques lack an important component for trustworthy ...
    • Unsupervised supervoxel-based lung tumor segmentation across patient scans in hybrid PET/MRI 

      Hansen, Stine; Kuttner, Samuel; Kampffmeyer, Michael; Markussen, Tom-Vegard; Sundset, Rune; Øen, Silje Kjærnes; Eikenes, Live; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2020-11-29)
      Tumor segmentation is a crucial but difficult task in treatment planning and follow-up of cancerous patients. The challenge of automating the tumor segmentation has recently received a lot of attention, but the potential of utilizing hybrid positron emission tomography (PET)/magnetic resonance imaging (MRI), a novel and promising imaging modality in oncology, is still under-explored. Recent ...
    • View it like a radiologist: Shifted windows for deep learning augmentation of CT images 

      Østmo, Eirik Agnalt; Wickstrøm, Kristoffer; Radiya, Keyur; Kampffmeyer, Michael; Jenssen, Robert (Journal article; Tidsskriftartikkel; Peer reviewed, 2023-10-23)
      Deep learning has the potential to revolutionize medical practice by automating and performing important tasks like detecting and delineating the size and locations of cancers in medical images. However, most deep learning models rely on augmentation techniques that treat medical images as natural images. For contrast-enhanced Computed Tomography (CT) images in particular, the signals producing the ...