I'm pretty sure this is how the app is designed. If you choose Help from the menu, you'll see the following:

"...and it will repeat alerts until acknowledged..."

I think the app considers any sort of trackball movement or key depression to be "acknowledgement."