Please allow people with access to bring in guests in a similar way to how gondola dialogue works, or even turn the door dialogue into a regular "door opening somewhere".
The place is super cool, but being unable to bring in people you want to have over is kind of an issue, and effectively makes those awesome quarters fancy storage, unless your other guests are all thieves.