Romanos was born to a Jewish family in Syria in the 5th century. He was baptized into the Church as a young boy. As an adult, he moved to Beirut and was ordained a deacon. He later moved to Constantinople and served as a sacristan in the Hagia Sophia.
Legend says that he was not a talented reader or singer. Around 518, he was assigned to read the psalter during an all-night vigil. He read so poorly that another reader had to take over. Humiliated and weary, he fell asleep in the choir stall. There, Mary appeared to him with a scroll in her hand and told him to eat it. Romanos awoke, went to the pulpit, and beautifully chanted a hymn on the Nativity. According to tradition, this was the very first hymn, or kontakion, ever sung.