The response - not an answer really - is would you know one if you saw it? If not, then how do you know you never see them?
Some birds (e.g. ducks) leave the nest when they are very small and you will easily recognise them as "babies". You might not know what their parents are unless they are accompanying the youngsters. Other birds (e.g. robins) don't leave the nest until they are almost as big as the parent - in fact, with fluffy feathers still in place, they often appear to be bigger than the parent. Recognising the juvenile (by species) can take experience; in many cases the young plumage is quite unlike the adults' plumage.
You don't specify a type of pigeon, but I suggest you follow up your interest and look for pictures of the juvenile birds so you know them next time. Get a good field guide to your local birdlife and it will give you hours of pleasure. Any binoculars are better than none and bring the bird much closer to you.
Enjoy yourself.