327 Bathurst Street
So I went to so many libraries while I was in Toronto that I can't remember where all of them even where (it was like a month ago!). It just took me like ten minutes of clicking around on Google maps ant the Toronto Public Library to even find this one.
Inside they had these cute little window seats. Sure they could be more comfortable (I didn't actually sit in them so I don't know how they felt), but they seem like pretty nice places to read a book.