Xu, formerly known as Xu, was born in Xujiahe Village, Pu Tian Township, Xin County, Xinyang City, Henan Province. He came from a poor peasant family and worked as a monk in Shaolin Temple. During the period of War of Resistance against Japanese Aggression, he served as deputy director of the School Affairs Department of China People's Anti-Japanese Military and Political University, deputy brigade commander of the 386th Brigade of the Eighth Route Army129th Division, brigade commander of the 3rd Brigade of Shandong Column, chief of staff of Shandong Column and commander of Jiaodong Military Region. During the Agrarian Revolution and the War of Liberation, he made great achievements and made immortal contributions to the liberation of China people. After the founding of People's Republic of China (PRC), General Xu was awarded the rank of general, and served as deputy chief of staff of the Chinese People's Liberation Army, commander of the Nanjing Military Region, commander of the Guangzhou Military Region, deputy minister of national defense and member of the Standing Committee of the Central Military Commission of the Communist Party of China (CPC).