In order to survive, mice need to eat and drink, and food is usually placed below, so mice can only come down if they don't want to be hungry. You can set some traps and catch mice with sticky mouse boards. Indeed, there are too many rats, so it is necessary to put rodenticide and kill them chemically.
Killing rats is a long-term and continuous work, and it is also a process of fighting rats. Good luck.