GitHub

understanding-of-LLM-Encoder-and-decoder-model-

An Encoder-Decoder model is a fundamental architecture in the field of deep learning and natural language processing (NLP). It's widely used for a variety of tasks, including machine translation, text ...
IEEE

De-END: Decoder-Driven Watermarking Network

Abstract: Deep-learning-based watermarking technique is being extensively studied. Most existing approaches adopt a similar encoder-driven scheme which we name END (Encoder-NoiseLayer-Decoder) ...
Microsoft

SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing

Motivated by the success of T5 (Text-To-Text Transfer Transformer) in pre-trained natural language processing models, we propose a unified-modal SpeechT5 framework that explores the encoder-decoder ...
IEEE

Self-Supervised Pre-Training for Attention-Based Encoder-Decoder ASR Model

Abstract: End-to-end (E2E) models, including the attention-based encoder-decoder (AED) models, have achieved promising performance on the automatic speech recognition (ASR) task. However, the ...