The middle seat gets both armrests. The aisle passenger can lean into the aisle and the window passenger can lean into the wall. The middle passenger has nowhere to go, so the two armrests are theirs.