There appears to be a bug. It actually does show up on subsequent months, just not the month where you created it. By going to one of those, you can delete or change it. Once you turn off the recurrence it is back at its original day and you can delete it. Wierd.