Contrastive Self-Supervised Learning for Globally Distributed Landslide Detection

The Remote Sensing (RS) field continuously grapples with the challenge of transforming satellite data into actionable information. This ongoing issue results in an ever-growing accumulation of unlabeled data, complicating interpretation efforts. The situation becomes even more challenging when satellite data must be used immediately to identify the effects of a natural hazard. Self-supervised learning (SSL) offers a promising approach for learning image representations without labeled data. Once trained, an SSL model can address various tasks with significantly reduced requirements for labeled data. Despite advancements in SSL models, particularly those using contrastive learning methods like MoCo, SimCLR, and SwAV, their potential remains largely unexplored in the context of instance segmentation and semantic segmentation of satellite imagery. This study integrates SwAV within an auto-encoder framework to detect landslides using deca-metric resolution multi-spectral images from the globally-distributed large-scale landslide4sense (L4S) 2022 benchmark dataset, employing only 1% and 10% of the labeled data. Our proposed SSL auto-encoder model features two modules: SwAV, which assigns features to prototype vectors to generate encoder codes, and ResNets, serving as the decoder for the downstream task. With just 1% of labeled data, our SSL model performs comparably to ten state-of-the-art deep learning segmentation models that utilize 100% of the labeled data in a fully supervised manner. With 10% of labeled data, our SSL model outperforms all ten fully supervised counterparts trained with 100% of the labeled data.

View this article on IEEE Xplore

BERT-NAR-BERT: A Non-Autoregressive Pre-Trained Sequence-to-Sequence Model Leveraging BERT Checkpoints

We introduce BERT-NAR-BERT (BnB) – a pre-trained non-autoregressive sequence-to-sequence model, which employs BERT as the backbone for the encoder and decoder for natural language understanding and generation tasks. During the pre-training and fine-tuning with BERT-NAR-BERT, two challenging aspects are considered by adopting the length classification and connectionist temporal classification models to control the output length of BnB. We evaluate it using a standard natural language understanding benchmark GLUE and three generation tasks – abstractive summarization, question generation, and machine translation. Our results show substantial improvements in inference speed (on average 10x faster) with only little deficiency in output quality when compared to our direct autoregressive baseline BERT2BERT model. Our code is publicly released on GitHub ( https://github.com/aistairc/BERT-NAR-BERT ) under the Apache 2.0 License.

View this article on IEEE Xplore

State-Based Decoding of Force Signals From Multi-Channel Local Field Potentials

The functional use of brain-machine interfaces (BMIs) in everyday tasks requires the accurate decoding of both movement and force information. In real-word tasks such as reach-to-grasp movements, a prosthetic hand should be switched between reaching and grasping modes, depending on the detection of the user intents in the decoder part of the BMI. Therefore, it is important to detect the rest or active states of different actions in the decoder to produce the corresponding continuous command output during the estimated state. In this study, we demonstrated that the resting and force-generating time-segments in a key pressing task could be accurately detected from local field potentials (LFPs) in rat’s primary motor cortex. Common spatial pattern (CSP) algorithm was applied on different spectral LFP sub-bands to maximize the difference between the two classes of force and rest. We also showed that combining a discrete state decoder with linear or non-linear continuous force variable decoders could lead to a higher force decoding performance compared with the case we use a continuous variable decoder only. Moreover, the results suggest that gamma LFP signals (50-100 Hz) could be used successfully for decoding the discrete rest/force states as well as continuous values of the force variable. The results of this study can offer substantial benefits for the implementation of a self-paced, force-related command generator in BMI experiments without the need for manual external signals to select the state of the decoder.

View this article on IEEE Xplore