It's not as serious as you think. His power is that you don't get points in the class selection, and he has to take care of party member's affairs. Party member may miss you, too. Don't make mistakes in principle in class, so that he can't grasp the handle. What he can influence you most is to leave a record of violation on the file. This kind of attention will do. Of course, you should study hard and try not to fail.