No. Contrary to popular belief, birds generally will not reject hatchlings touched by human hands. The best thing to do for a newborn bird that has fallen or has been pushed out of the nest is to locate the nest as quickly as possible and gently put the bird back in.
Source: Merilees, Bill. Attracting Backyard Wildlife, p. 138.