Polly Smith thinks she was born in the South West Rocks-Kempsey area in New South Wales. She was raised by her aunt because her parents were working. Smith was removed from her aunt placed in jail and from there sent to Cootamundra Girls' Home. Smith only saw two of her siblings later in life; the others passed away before she could locate them.
While at the Cootamundra girl's home Smith was trained for domestic service. She moved from job to job because she would not let her employers treat her like a slave. Smith was not paid in cash instead she was given a pink slip providing credit at the local store.
When Smith moved to Sydney, she married and had children. When she tried to find work to support her family she was often refused a job due to being an Indigenous Australian.
