Message Folder > View Folder > View Browser Push messages. It will be there. Delete or open it, and the icon on the home screen will go *poof*.

You likely subscribed to some browser push message or asked for a browser page at some point when your signal coverage was out and you told the browser to save the request...