The predecessor of Shanghai Conservatory of Music was the National Conservatory of Music founded by Mr. Cai Yuanpei, a revolutionary, educator and thinker, and a doctor of music education on June 27th, 1965. The first dean was Mr Cai Yuanpei. 1929 changed its name to National Conservatory of Music in September. After the founding of People's Republic of China (PRC), 1956 was named Shanghai Conservatory of Music. As the oldest institution of higher music in China, Shanghai Conservatory of Music has accumulated a solid discipline foundation in the creation, performance and research of classical serious music during its years of development.

From 1949 to 1984, He Luting, a famous composer, music theorist and music educator, served as the dean (later honorary dean), making outstanding contributions to the construction and development of the school. 1984, Professor Sang Tong, Professor Yun and Professor successively served as the Dean.

Shanghai Conservatory of Music attaches importance to the construction of teaching staff. In various historical periods of the development of the College, there are always a group of first-class famous professors in China and even in the world who are in the leading position in various disciplines, such as foreign professors Cha Halloff, Su Shilin, and famous domestic musicians Xiao, Zhou Shuan, Ying Shangneng, He Luting and Ding Shande. After the founding of New China, a large number of overseas students returned to China and chose Shanghai Conservatory of Music as a platform to serve the motherland. In addition to a group of famous scholars who are active in the front line of teaching as academic leaders, the college has intensified talent introduction and recruitment, and absorbed outstanding experts and scholars at home and abroad into the teaching and management positions of the college, laying a foundation for the development of Shanghai Conservatory of Music.