Milk allergy is a completely different medical form where one is sensitive to protein in milk. Milk allergy is an immune reaction rather than an altered reaction of regular absorption. Usually, the signs are pretty different. An allergic reaction, by using dairy products, might include swelling around the lips and tongue, hives, asthma and gastrointestinal problems. So the answer is yes; the consumption of dairy products can cause swelling.