The Discoveries: Libraries history option says, "This background grants you an extra level to your Library Knowledge and Filing Skills, and grants you access to two libraries - the Library of Manetele and the Library of the Mantle of Stars - from which most of your fellow students are technically barred."
It's not quite explicit, but this strongly implies that you get Visitation Rights to those two libraries. Yet in the game that I just started in the latest version (patch 3 + content patch 1), I have been assigned detention for trespassing on a day when I only attended classes and visited the Library of the Mantle of Stars. Since I'm clearly allowed to attend class, I can only assume that I've been reprimanded for visiting the Library of the Mantle of Stars, which I should have Visitation Rights for!
In a more blatant example, back on my unpatched game I was repeatedly reprimanded for "trespassing" in the Champion's Room, despite having gained knowledge and Visitation Rights through using a Merit Prize!
The instructors at Academagia are capricious, certainly, but it's just blatantly unfair to punish me for visiting a location I've been told I'm allowed at.