If you see the update icon go to Device settings on the app, scroll to the bottom and If a yellow device update icon appears on the main page then select the "Devices" icon.
You can do a bulk update, selecting the devices on the "Devices" page and then tapping on "Update firmware from the menu on the top right".
(You don't need to repeat the update for every switch but just one per device).