Whoops, missed the bit in there about milk intolerance.
Olive oil, avocados, and nuts/nut butters all work well as mass gainers. Eggnog can also work as a calorific beverage. Overall, just eat a lot more. I wouldn't worry too much about eating squeaky clean.
At any rate, the OP's a prime...