Some calcium supplements are indeed made of calcium carbonate and it is one way to get some of your calcium needs met, however, calcium carbonate doesn't contain the other vitamins and minerals found in milk, which include phosphorous, potassium, selenium, Vitamin D, etc.
This site gives a good breakdown of the nutrition available in milk:
http://www.nutritiondata.com/facts/dairy-and-egg-products/69/2