The law provides that all parents are equal before the child. Unless it is a case where the mother neglected the child, then all parents should have access to the child. Since the father has refused to give the child to the mother, the only option is to go to court and argue your case.
Alternatively, you can report the matter to the area chief so that the case can be settled out of court.