A seat swap is a favor, not a right. Ask politely, offer a seat as good as or better than the one you want, and accept the first no. Nobody is obliged to trade for a worse seat.