When you unequip mainhand weapon (by pressing X) you also unequip the offhand. But if you unequip offhand, only offhand is unequipped.