It's depressing to live in a dormitory in college.
But you should know that the less you express yourself, the less chance they have to know you, so they will misunderstand you because of your silence and your inner isolation.
You can buy some snacks and fruits to eat with everyone on weekends, and then tell everyone that you are not really arrogant and indifferent because you can't express yourself. It's really not that difficult to take this step.