Preheat the oven to 350 F and prepare a loaf pan with non-stick spray and parchment paper for easy removal.
In a mixing bowl, cream together the butter and sugar until light and fluffy, about 1-2 minutes using a handheld mixer. Add in the sweetened condensed milk, eggs and vanilla and mix until combined.
Add in the gluten free baking flour, almond flour and tapioca flour and stir until no dry spots remain. Try not to over mix the batter. Gently fold in the raspberries. Transfer the batter to the prepared pan and bake it for 45-55 minutes. A toothpick will come out clean when inserted. Let the loaf cool completely.
Whisk together the powdered sugar and almond milk one tablespoon at a time until you reach a thick but pourable consistency. Drizzle the glaze over the loaf and let it set at room temperature for 20 minutes before cutting into slices and serving.