I just noticed that I had both typ and typst in the Unicode Latex extension list. The typ entry seems to not do anything, but I confirm that the typst one does allow me to use the extension as expected.
Note also that you have to restart the VSCode process for the extension changes to go into effect.