Instead of taking margin size into account twice when positioning layers, just rely on the absolute position calculated during display list construction.