Starting with Typst v0.12, which is currently available for testing, this will happen automatically when setting the language to Polish using #set text(lang: "pl").
The same is true for the languages Lower Sorbian, Czech, Croatian, Portuguese, Slovak, and (in some cases) Spanish.