I hear this often. Can I briefly explain why this is a false conclusion. The vocation of marriage is a complete vocation. While married people aspire to have a perfect marriage, they rarely succeed. The constraints within marriage can be irksome and difficult - but everyone in our society pays the penalty of failure. Priesthood is similarly a complete vocation - some even call it being married to the Church. Jesus saw himself as the groom with the Church his bride. The vocation of Ordination is rarely lived out in its perfection. Humans are people continually challenged to grow holier. All of us fail at times. There are areas in the Church who have married clergy - the Maronite and Melkite Rites are cases in point. Their difficulties and failures are the same as the Latin Rite celibate priesthood. Anglican clergy similarly.
Paedophilia is a different question. Most perpetrators are not clergy (though the media would have you think so.) Paedophilia is widespread, and usually from a member of the family. Paedophilia is an almost incurable affliction. It is quite distinct from homosexuality.
The celibate priesthood is a wonderful vocation which affords us a unique charism and apostolate. Jesus was celibate as was Mary. Peter was not. But the early Church saw the immense value in having a celibate clergy who could advance their own holiness and in a unique way, through their sacramental ministry, serve the Body of Christ. Every vocation has the grace to fulfil its role - but it needs to be asked for in prayer and worked at diligently. The Catholic priest gives his life for his parishioners. He has few other concerns outside this privilege. Whatever advantages a non-celibate clergy may appear to have in the short term are vastly outweighed by the graces that flow to God's people throught the Sacramental celibate clergy of the Catholic Church. We are a sacramental Church which joyfully celebhrates two great sacraments - marriage and ordination.