Yes, sometimes. If you are in a room or location where there is a book, the quest marker will point to where the book is. But if you are in a room where there is not a book, it will point to an exit. And, for confusion, if you still search for several books, you will have multiple markers doing both.