This hymn is a statement of faith in the Roman Catholic church, and appears to be the basis for the more-widely-used 19th century hymn, I am a Faithful Catholic.
The original publication
The earliest-located instance of this song is in Easy Hymns and Sacred Songs for Young Children, Burns & Lambert, London England in 1853, credited to the semi-anonymous Sister M. B of the Sisters of Mercy convent in Charlville, County Cork, Ireland (source).1. I am a little Catholic, and Christian is my name;
And I believe the Holy Church in ev’ry age the same.
2. The holy ancient Roman Church, enduring firmly still;
Where Christ her King hath planted her, upon St. Peter's hill.
3 Jerusalem she is above, our city and our home;
But after that same pattern is the holy city, Rome.
4. Time writes no wrinkles on thy brow, for thou art ever young;
Hail! Rome, eternal citadel, from whence our faith hath sprung!
5. Once England was the fairest gem in all St. Peter's crown.
O may it soon there shine again, as once of yore it shone.
- An Irish person, even in the mid 1800s, did not write verse five. Unless they were part of a wry comment about people who were "a little Catholic" - as in not particularly so, and not even named after a saint.
- This is published in a book of hymn and songs that are easy for young children to sing. Does any part of verses 2-4 look even vaguely singable by young children?
Further publications
I am a little Catholic, and Christian is my name;
And I believe the Holy Church in ev’ry age the same.
I love her altars where I kneel, My Jesus to adore;
I love my Mother Mary dear O, may I love her more.
I love the saints of olden time, the places where they dwelt;
I love to pray where saints have prayed, and kneel where they have knelt.
I love the priests, my pastors dear, they have left all for me;
Next to my parents here on earth, I love them tenderly.
I love the Holy Sacraments, they bring me near to God;
The Church points out the way to heav’n. These help me on the road.
I am a little Catholic, I love my Holy Faith;
I will be true to Holy Church and steadfast until death.