Doreen James's parents are from the Rocklea Station area in the Hamersley Ranges where they both worked. Her father, of the Binikura and Kurrama people, was a dogger who travelled throughout the Pilbara. He later worked as a stockman on Glenroy Station. Born in a tent, Doreen James lived in the bush for most of her young life; her family would visit town for Aboriginal ceremonies held at Bindi Bindi. She is the second youngest of five children, but has lost two siblings. James began her schooling with the School of Air at Urala Station, before attending Onslow Primary and later Port Hedland Junior High School. During her schooling she lived at Moorgunyah Hostel and after she completed Year Eleven she began working there as a domestic. James married Phillip Carey according to Aboriginal law and had three children. They both worked at Peedamulla Station and when the children began attending school the family moved back to town where James was employed at the Gilliamia Hostel until 1989, before gaining a position with the Department of Community Development (DCD) as a family resource worker. James worked with her her brother and sister-in-law to establish the Yinhawangka group as an incorporated association. James has continued to work with women's groups and has established a Safe House to help with issues such as domestic violence.
