At his installation Mass, Bishop Nguyen stressed his commitment to being "a bridge builder."
"We must foster pathways across the political and religious divide to build not only a rich and strong Australia but also an inclusive and humane society and a responsible world citizen," he said. He urged the faithful to take heed to Pope Francis' counsel to be a Church "where everyone can feel welcomed, loved, forgiven and encouraged to live according to the Gospel."
He voiced his commitment to Church renewal patterned on Christ: "the Church that dies to worldly power, privilege, clericalism and rises to humility, simplicity, equality and servanthood – the Church that might be smaller, poorer and humbler but hopefully more of a light and a sacrament of God's love to the world."
The bishop lamented "the flood of secularization that has washed away much of the Church we've known and loved."
"We have been battered and bruised. We've been reduced in numbers and status," he said. "What is more, we have to admit with the greatest humility that we have not lived up to that fundamental ethos of justice, mercy and care for those who have been hurt by our own actions and inactions."
Bishop Nguyen noted the sexual abuse crisis, voicing hope it will be "a catalyst for transformation."
He also encouraged everyone to be part of the Church.
"There can be no future for the living Church without there being space for those who have been hurt, damaged or alienated, be they abuse victims, survivors, divorcees, gays, lesbians or disaffected members," he said. "I am committed to make the Church in Parramatta the house for all peoples, a Church where there is less an experience of exclusion but more an encounter of radical love, inclusiveness and solidarity."
The bishop's mother, godmother and four siblings were present at the installation.
Bishop Nguyen succeeds Archbishop Anthony Fisher O.P., who was appointed Archbishop of Sydney.
The Parramatta diocese is about 14 miles west of Sydney. It is predominantly Catholic, with about 330,000 faithful in 47 parishes and 120 active and retired priests.
(Story continues below)
Subscribe to our daily newsletter