Almond milk is much better for you. The carbohydrates are what gets converted by your liver into fat that gets stored on your stomach and hips. With this substitution of almond milk for fat free milk, you’re getting 11g fewer carbohydrates and the fats that you get will be much healthier for your body than the casein (milk protein) that you would have gotten from the milk. In addition you’re skipping all the hormones that are naturally and un-naturally added to the milk. Those hormones cause you to grow and store fat too.
A popular diet for weight loss is Zone diet. It has 30 % calories from proteins, 30 % calories from fats and 40 % calories from carbohydrates. Unfortunately, you didn’t give height/weight, so I can’t estimate the number of grams, but here’s an example:
5′ 8″ girl is 170 lbs and wants to lose weight. Her starting BMI is 25.9. If she went down to BMI 22.0 she’d be about 145 lbs. With a bit of light exercise she’d need 2000 calories to maintain her weight at 145, and might need to cut to about 1750 or 1700 calories to lose weight safely at 1 to 2 lbs per week. BMI isn’t always right, but it’s pretty good for average people who are not professional athletes or body builders. Each gram of fat is worth 9 calories, so when losing weight on 1750 calories x 30 % fats / 9 calories/g = 58 g of fat in diet per day. No more than 10 g should be saturated fats according the the US govt suggested diet.