Skip to content

Python: support (Azure) OpenAI realtime audio models#13291

Merged
moonbox3 merged 6 commits intomicrosoft:mainfrom
moonbox3:support-realtime-ga-audio
Feb 28, 2026
Merged

Python: support (Azure) OpenAI realtime audio models#13291
moonbox3 merged 6 commits intomicrosoft:mainfrom
moonbox3:support-realtime-ga-audio

Conversation

@moonbox3
Copy link
Collaborator

@moonbox3 moonbox3 commented Oct 24, 2025

Motivation and Context

As of 2/27/2026, revived the PR, and the latest code is working for both Azure OpenAI realtime models and OpenAI realtime models.

SK has support for realtime-preview models; however, since they've gone to GA we have not added support for the latest library abstractions. This PR brings in the changes to support running models like gpt-realtime-1.5, gpt-realtime, gpt-realtime-mini or gpt-audio.

Description

Contribution Checklist

@moonbox3 moonbox3 self-assigned this Oct 24, 2025
@moonbox3 moonbox3 requested a review from a team as a code owner October 24, 2025 04:14
@markwallace-microsoft markwallace-microsoft added the python Pull requests for the Python Semantic Kernel label Oct 24, 2025
@markwallace-microsoft
Copy link
Member

markwallace-microsoft commented Oct 24, 2025

Python Test Coverage

Python Test Coverage Report •
FileStmtsMissCoverMissing
const.py70100% 
connectors/ai/open_ai
   const.py20100% 
connectors/ai/open_ai/prompt_execution_settings
   open_ai_realtime_execution_settings.py50786%97, 101, 105, 109, 113, 117, 121
connectors/ai/open_ai/services
   _open_ai_realtime.py4529678%288, 290, 292, 329, 384, 392, 436–440, 464–467, 558–559, 562–563, 573, 581–584, 591, 593, 596–597, 647–650, 659–662, 674–675, 719–721, 723–724, 727–728, 731, 742, 744, 746–748, 787–788, 795–797, 816, 823, 828–830, 832–835, 842–844, 852–853, 857–861, 884–885, 890–892, 927, 930, 933–936, 941–943, 946–952
   azure_realtime.py1026140%112–113, 123–127, 148, 163, 168–171, 174–176, 178–180, 182, 190–192, 263–264, 274–279, 285–287, 307, 316, 320–322, 324–325, 332–333, 340, 352, 358–361, 365–367, 369, 371, 373–375, 384–387
connectors/ai/open_ai/settings
   open_ai_settings.py150100% 
TOTAL28230487682% 

Python Unit Test Overview

Tests Skipped Failures Errors Time
3833 23 💤 0 ❌ 0 🔥 1m 48s ⏱️

@moonbox3 moonbox3 added the PR: breaking change Pull requests that introduce breaking changes label Oct 24, 2025
@SimoneMarretta
Copy link

@moonbox3 @markwallace-microsoft Is there any news on this pull request? It would be an important feature to have. Thank you!

@bocodigital
Copy link

wondering about this too since the preview model is being retired in about a month

@moonbox3 moonbox3 added this pull request to the merge queue Feb 27, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Feb 27, 2026
@eavanvalkenburg eavanvalkenburg added this pull request to the merge queue Feb 27, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Feb 27, 2026
@TaoChenOSU TaoChenOSU added this pull request to the merge queue Feb 27, 2026
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Feb 27, 2026
@moonbox3 moonbox3 merged commit 429dd1c into microsoft:main Feb 28, 2026
28 of 29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation PR: breaking change Pull requests that introduce breaking changes python Pull requests for the Python Semantic Kernel

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Python: Bug: Python - Semantic Kernel Realtime isn't supporting the GA versions of Azure OpenAI realtime models

6 participants