Preheat your oven to 350°F (175°C). Line a baking sheet with parchment paper.
Cream the softened butter and granulated sugar together using an electric mixer until light and fluffy.
Add eggs one at a time, mixing well and scraping the bowl after each addition. The mixture should be pale and slightly thick.
Stir in the vanilla and almond extracts until combined.
In a separate bowl, whisk together the all-purpose flour, baking powder, and salt.
Gradually add the dry ingredients to the wet ingredients, mixing gently just until combined and a soft, slightly sticky dough forms. Don't over-mix.
Scoop and roll the dough into balls, about 1 tablespoon each, and arrange on the prepared baking sheet.
Bake for 9–11 minutes, or until the cookies are set and just barely golden on the undersides, but still pale on top.
Let the cookies cool on the baking sheet for 5 minutes, then transfer to a wire rack to cool completely before glazing.
For the glaze: In a bowl, whisk together powdered sugar, milk, and extract until smooth and thick (like glue). If too thick, add another splash of milk; if too thin, add more sugar.
Dip the tops of the cooled cookies into the glaze, letting excess drip off. Immediately add sprinkles if desired. Let the glaze set before storing or serving. Enjoy!