That depends on how much you have to suffer from college. There are eight government-funded universities in Hong Kong, but I think if you really want to visit them, it is enough to go to HKU, CUHK, HKUST, City University and Polytechnic. It's ok to take a quick look at flowers a day.
The suggested route is: CUHK- CityU-Polytechnic-HKUST. To be honest, HKUST is far away, so you can choose between them.