Unless your diploma or degree certificate is fake or belongs to someone else.

The Education Bureau can only take away the relevant certificates issued by them, such as Putonghua certificate and teacher qualification certificate.

And it must be because of the teacher's personal problems that it is possible to take it away.

For example, although a teacher passed the Putonghua test, he was later reported by others that the Putonghua certificate was taken by others. After verification, the Education Bureau has the right to confiscate his certificate.