In 1979 Ferguson was a member of the Matt Stagger Band, along with keyboard player Jaz Coleman. When Coleman left to form his own band, Ferguson jumped ship too. They were quickly joined by bassist Youth and guitarist Geordie, releasing a series of singles on their before being signed by Virgin. Killing Joke was soon a popular live act, attracting critical and commercial success in the mid-'80s. However, by the time it came to record their seventh album, Outside the Gate, internal tensions had begun to pull the band apart. Ferguson was the first to leave, being fired by Coleman over disputes about the material. Soon afterwards, the band folded, with the members pursuing other projects. Ferguson joined U.S. alternative rockers Warrior Soul, appearing on their debut album, Last Decade Dead Century.
In 1992, he hooked up with his former Killing Joke comrades in the industrial collective Murder Inc., providing his characteristic tribal beats alongside Martin Atkins' more traditional playing. This lead to a number of appearances with Atkins' own project Pigface, both recording and touring. Since then, Ferguson has remained away from the mainstream music scene, despite rumors that he was to rejoin Killing Joke for the recording of Pandemonium. ~ Jim Harper, Rovi