No, the application does not have to run.
The button can work fully autonomously with light and sound reminders.
It also has the possibility of storing a virtually infinite number of clicks in the internal memory. When you want to transfer the clicks and do your stats on the phone, then the phone needs to be in range, bluetooth needs to be on and the app in the background.
the Klikkit team