John Neilson was born at Stranraer in Wigtonshire, Scotland, the son of William Neilson and Jessie McFarlane. He migrated to Australia with his mother and step-father, John Shaw, in the 1850s at the age of nine. Neilson spent his youth on farming properties and recalled seeing Adam Lindsay Gordon (q.v.) ride in a steeplechase at Penola, South Australia. Neilson continued working on the land in the Wimmera of Victoria with his sons John Shaw Neilson (q.v.), William Neilson and Frank Neilson. His first wife died in 1897, and he remarried in 1911. He was the father of nine children, six of whom survived him.
It appears that Neilson began writing verse in about 1876, in his early thirties. Although entirely self-educated, he developed a reputation as a bush poet and contributed verse to local newspapers in Mount Gambier and the Adelaide Punch. His first published poem was 'The Bellbird' (date and source unknown as of 4 September 2006). His work was also published in Borderwatch, the Australian Star, the Australasian, the Ballarat Courier, and in some West Australian and New South Wales newspapers. A poem by Neilson won the prize offered by the Australian Natives' Association of Melbourne in 1893, and in 1897 he was awarded a prize for verse at a Warrnambool exhibition. Sadly, much of his verse has been lost.