There are many study rooms in Building 4, generally in the classrooms on the north and south sides. Mostly small classrooms. As long as there is no class, you can teach yourself. Most of the fourth and fifth floors are graduate classrooms. Boiling water is available on every floor.
The library opens at 9: 00 a.m. and locks at night 10. You don't need to swipe your card to go in. You can sit there and read books, but if you want to borrow books, you need to swipe your student card to borrow books.