Mix 1 1/4 cups flour, 1/2 cup butter, and 1/3 cup brown sugar together in a bowl; press mixture into a 9-inch square pan.
Bake in the preheated oven until browned, about 15 minutes.
Spread strawberry jam to within 1/2 inch of edges of baked crust. Mix 3/4 cup flour, 1/2 cup brown sugar, 1/4 cup butter, 1/2 teaspoon almond extract, and salt in a bowl until crumbly. Sprinkle mixture over jam layer.
Bake in the preheated oven until lightly browned, about 20 minutes. Cool completely.
Whisk confectioners' sugar, milk, and 1 teaspoon almond extract together in a bowl until smooth; drizzle over cooled bars.