​
Overview

AWSTranscribeSTTService provides real-time speech recognition using Amazon Transcribe’s WebSocket streaming API with support for interim results, multiple languages, and configurable audio processing parameters.

API Reference

Complete API documentation and method details

AWS Transcribe Docs

Official AWS Transcribe documentation and features

Example Code

Working example with AWS services integration

​
Installation

To use AWS Transcribe services, install the required dependency: 
pip install "pipecat-ai[aws]"
You’ll also need to set up your AWS credentials as environment variables:
  • AWS_ACCESS_KEY_ID
  • AWS_SECRET_ACCESS_KEY
  • AWS_SESSION_TOKEN (if using temporary credentials)
  • AWS_REGION (defaults to “us-east-1”)
Get your AWS credentials by setting up an IAM user with Amazon Transcribe access in your AWS Console.

​
Frames

​
Input

  • InputAudioRawFrame - Raw PCM audio data (16-bit, 8kHz or 16kHz, mono)
  • STTUpdateSettingsFrame - Runtime transcription configuration updates
  • STTMuteFrame - Mute audio input for transcription

​
Output

  • InterimTranscriptionFrame - Real-time transcription updates
  • TranscriptionFrame - Final transcription results
  • ErrorFrame - Connection or processing errors

​
Language Support

AWS Transcribe supports multiple languages with regional variants:
Language CodeDescriptionService Codes
Language.AFAfrikaansaf-ZA
Language.AF_ZAAfrikaans (South Africa)af-ZA
Language.ARArabic (Modern Standard)ar-SA
Language.AR_AEArabic (Gulf)ar-AE
Language.AR_SAArabic (Modern Standard)ar-SA
Language.EUBasqueeu-ES
Language.EU_ESBasque (Spain)eu-ES
Language.CACatalanca-ES
Language.CA_ESCatalan (Spain)ca-ES
Language.ZHChinese (Simplified)zh-CN
Language.ZH_CNChinese (Simplified)zh-CN
Language.ZH_TWChinese (Traditional)zh-TW
Language.ZH_HKChinese (Cantonese)zh-HK
Language.YUECantonesezh-HK
Language.HRCroatianhr-HR
Language.HR_HRCroatian (Croatia)hr-HR
Language.CSCzechcs-CZ
Language.CS_CZCzech (Czech Republic)cs-CZ
Language.DADanishda-DK
Language.DA_DKDanish (Denmark)da-DK
Language.NLDutchnl-NL
Language.NL_NLDutch (Netherlands)nl-NL
Language.ENEnglish (US)en-US
Language.EN_AUEnglish (Australian)en-AU
Language.EN_GBEnglish (British)en-GB
Language.EN_INEnglish (Indian)en-IN
Language.EN_IEEnglish (Irish)en-IE
Language.EN_NZEnglish (New Zealand)en-NZ
Language.EN_ZAEnglish (South African)en-ZA
Language.EN_USEnglish (US)en-US
Language.FAPersian/Farsifa-IR
Language.FA_IRPersian/Farsi (Iran)fa-IR
Language.FIFinnishfi-FI
Language.FI_FIFinnish (Finland)fi-FI
Language.FRFrench (France)fr-FR
Language.FR_FRFrench (France)fr-FR
Language.FR_CAFrench (Canadian)fr-CA
Language.GLGaliciangl-ES
Language.GL_ESGalician (Spain)gl-ES
Language.KAGeorgianka-GE
Language.KA_GEGeorgian (Georgia)ka-GE
Language.DEGerman (Germany)de-DE
Language.DE_DEGerman (Germany)de-DE
Language.DE_CHGerman (Swiss)de-CH
Language.ELGreekel-GR
Language.EL_GRGreek (Greece)el-GR
Language.HEHebrewhe-IL
Language.HE_ILHebrew (Israel)he-IL
Language.HIHindihi-IN
Language.HI_INHindi (India)hi-IN
Language.IDIndonesianid-ID
Language.ID_IDIndonesian (Indonesia)id-ID
Language.ITItalianit-IT
Language.IT_ITItalian (Italy)it-IT
Language.JAJapaneseja-JP
Language.JA_JPJapanese (Japan)ja-JP
Language.KOKoreanko-KR
Language.KO_KRKorean (South Korea)ko-KR
Language.LVLatvianlv-LV
Language.LV_LVLatvian (Latvia)lv-LV
Language.MSMalayms-MY
Language.MS_MYMalay (Malaysia)ms-MY
Language.NBNorwegian Bokmålno-NO
Language.NB_NONorwegian Bokmål (Norway)no-NO
Language.NONorwegianno-NO
Language.PLPolishpl-PL
Language.PL_PLPolish (Poland)pl-PL
Language.PTPortuguese (Portugal)pt-PT
Language.PT_PTPortuguese (Portugal)pt-PT
Language.PT_BRPortuguese (Brazil)pt-BR
Language.RORomanianro-RO
Language.RO_RORomanian (Romania)ro-RO
Language.RURussianru-RU
Language.RU_RURussian (Russia)ru-RU
Language.SRSerbiansr-RS
Language.SR_RSSerbian (Serbia)sr-RS
Language.SKSlovaksk-SK
Language.SK_SKSlovak (Slovakia)sk-SK
Language.SOSomaliso-SO
Language.SO_SOSomali (Somalia)so-SO
Language.ESSpanish (Spain)es-ES
Language.ES_ESSpanish (Spain)es-ES
Language.ES_USSpanish (US)es-US
Language.SVSwedishsv-SE
Language.SV_SESwedish (Sweden)sv-SE
Language.TLTagalogtl-PH
Language.FILFilipinotl-PH
Language.FIL_PHFilipino (Philippines)tl-PH
Language.THThaith-TH
Language.TH_THThai (Thailand)th-TH
Language.UKUkrainianuk-UA
Language.UK_UAUkrainian (Ukraine)uk-UA
Language.VIVietnamesevi-VN
Language.VI_VNVietnamese (Vietnam)vi-VN
Language.ZUZuluzu-ZA
Language.ZU_ZAZulu (South Africa)zu-ZA
AWS Transcribe supports additional languages and regional variants. See the AWS documentation for a complete list.

​
Usage Example

​
Basic Configuration

Initialize the AWSTranscribeSTTService and use it in a pipeline: 
from pipecat.services.aws.stt import AWSTranscribeSTTService
from pipecat.transcriptions.language import Language

# Configuration with explicit credentials
stt = AWSTranscribeSTTService(
    aws_access_key_id="YOUR_ACCESS_KEY_ID",
    api_key="YOUR_SECRET_ACCESS_KEY",
    aws_session_token="YOUR_SESSION_TOKEN",  # If using temporary credentials
    region="us-west-2",
    language=Language.FR
)

# Use in pipeline
pipeline = Pipeline([
    transport.input(),
    stt,
    context_aggregator.user(),
    llm,
    tts,
    transport.output(),
    context_aggregator.assistant()
])

​
Dynamic Configuration

Make settings updates by pushing an STTUpdateSettingsFrame for the AWSTranscribeSTTService: 
from pipecat.frames.frames import STTUpdateSettingsFrame

await task.queue_frame(
    STTUpdateSettingsFrame(settings={"language": Language.FR})
)

​
Metrics

The service provides:
  • Time to First Byte (TTFB) - Latency from audio input to first transcription
  • Processing Duration - Total time spent processing audio
Learn how to enable Metrics in your Pipeline.

​
Additional Notes

  • Sample Rate: Supports 8kHz and 16kHz sample rates. Other rates are automatically resampled to 16kHz.
  • Connection Management: Handles WebSocket connections with automatic reconnection and proper connection state management.
  • Credentials: Supports both environment variables and explicit credential parameters for flexible deployment
  • Error Handling: Comprehensive error handling with graceful degradation and connection recovery