This reverts commit 95157362.

so that they are not hard attached to doors. E.G. when a door gets
deleted the history sticks around, or if a door gets moved, it's tied to
location.

Also updated the authorizer to pass around a full door since it is there
anyway...