After the service he quickly wrote on a scrap of paper at a host's home the words of 'He Leadeth Me', handed it to his wife and forgot about it. Unknown to him she sent it to the Watchman and Reflector magazine.

Three years later when he was about to preach at the Second Baptist Church, Rochester, New York, he was pleased and greatly surprised to see his words, 'He Leadeth Me', in the Rochester hymn book with music by William Bradbury.

Josepth Gilmore penned other hymns but his quickly written hymn 'He Leadeth Me' was sung most widely.