Whether illegally collected evidence can be used as the basis for the finalization of national laws is controversial in this field. With the progress of the rule of law and civilization, the awareness of human rights protection and the deep understanding of the harm of illegal evidence, most countries have established the exclusion rules of illegal evidence. In our country, whether illegal evidence can be accepted and used as the basis of final judgment, the theoretical circle of substantive law and all walks of life have different understandings and great disputes. There is no explicit provision for this rule in the current legal code, but with the need of judicial practice, it is imperative to establish the exclusionary rule of illegal evidence. The author puts forward some preliminary views on this hot issue and makes a preliminary exploration on perfecting the exclusionary rules of illegal evidence in China.