You gain special bonuses for fighting with specific things in your offhand while Single Weapon Fighting.
If you have nothing in your offhand, your ability score modifier contributes 25% more to your melee damage. If you have an Orb or Runearm in your Offhand, you gain +1 bonus Imbue Dice.