From 1971 to 1978 Jilani headed the ISI, being the third man to hold the position. In that role, he served three Pakistani governments, those headed successively by Yahya Khan, Z. A. Bhutto, and Zia-ul-Haq. In 1976, when Tikka Khan retired as Chief of Army Staff, Jilani was the fifth most senior army officer.