Born on 22nd September 1944 in Horsforth, West Riding of Yorkshire. His father was born in Ipswich, Suffolk and his mother was Scottish.
Attending the Corona Theatre School, Frazer started his career as a child actor from the age of ten. He appeared in numerous films including uncredited roles in Stock Car (1955), One Good Turn (1955), John and Julie (1955), The Woman for Joe (1955), The Weapon (1956), Miracle in Soho (1957).
Frazer's first television role was as a boy called Napoleon in the BBC adaptation of Huntingtower (1957).
This followed with more television roles including Jan in several episodes of the serial, The Silver Sword (1957 to 1958); Mick Fairburn in all five episodes of Run to Earth (1958)