In case you missed it, there now is a #WindowsVirtualDesktop (#WVD) feature in preview called RDP Shortpath which can make your WVD connections even faster and allows you to use UDP.

Read it all here: Windows Virtual Desktop RDP Shortpath (preview) – Azure | Microsoft Docs