Been down since 12:30PM Pacific. Only 2 users have trickled through...

Booooo

i have been living off of zelda and brickbreaker...its just keeping my fingers in practice
I resent service books on the big 4 carriers, and out of 20 possible emails to get the "Activation" message, 2 have gotten it. Data seems to be trickling in and out now, but at least it is moving some

Still Flapping here in SF. But when we are up we are trickling messages outbound.

Cute in a "Dawn of the Dead" way.... Instead of "Brraaainnsss" its "Eeee-Maiiilll".

Sounds like an idea! *brickbreaker mode*

Starting to come through in DC

Called RIM support...a very quick "we are experiencing network issues".

Messages trickling...

haha agreed there...its a shame...but hopefully soon enough we'll be rockin again

just had a bunch of my messages come through, email delivery is going extremely slow but at least it appears to be working

Here in Houston, I was queued up to 7000 pending, now down to 4000 and my device is now caught up.

Still down in Boston, MA, started at 3PM

odd, one of my 2 BES servers is back up and running but the other is not and SRP is disconnected, hopefully this one will come back to life soon.

also in Houston. pending msgs have been cut in half but are going down VERY SLOW.

Much agreed, leaving for a Red Bull and a smoke.

Just got from AT&T:
Valued Customer,

This e-mail is to provide an update to a network problem that MAY affect your Mobile Service.

Trouble Ticket: TT000006216509
Severity: 1-High
Description of Issue: Degradation of RIM Blackberry services Location of Issue: All Regions ;All Markets and surrounding areas Start Time: Feb 11 2008 12:20 PM PST Symptoms you MAY experience: RIM Blackberry users may be unable to send/receive messages or may have difficulty connecting to the network.
End Time: Unknown

UPDATE: RIM BES service should be returning to normal. Messages sent during the outage will arrive withing 1.5-2 hours.

Pending is about half of what it was 30 minutes ago.....still going very slow.

CNN is reporting that service is being restored. It was caused by a crashed server.

I am seeing my pending go down, slowly. Still no browsing with Blackberry Browser, and very SLOW email.

started back up here in L.A. for about 30 minutes and then down again

:(

Yikes! went from about 1500 pending to 0 in about 15 minutes!

woo hoo!! mail getting delivered!

yes indeed, looks good, funny though i still have 18 messages pending.

We seem to be working now, or at least slowly catching up.

When I do a Test Network Connection in the BlackBerry Server Configuration tool under the BlackBerry Router tab, I get "Not all IPs that the name resolves to could be successfully connected."

We're set to srp.na.blackberry.net and the network test attempts to contact 206.51.26.33 (successful) and 204.187.87.33 (ERROR: recv() failed: Connection reset by peer (10054).

??

I am still receiving the following, in Blackberry Server Configuration, Blackberry Router tab, Test Network Connection...

Attempting to connect to :
srp.ca.blackberry.net (206.51.26.33), port 3101
Successful
Attempting to connect to :
srp.ca.blackberry.net (204.187.87.33), port 3101
ERROR: recv() failed: Connection reset by peer (10054)

finnaly.

now i can go home on time.

I've started to get new emails in at 4:30 PST in WA.

For interested parties:
BlackBerry email service goes down - Feb. 11, 2008

Yup same here. The 204.187.87.33 has problems but the .33 one appears to take the load because all our pending on the Bes went out.

I heard a "Chunk" as someone at rim flushed the server and all the "pending" mail went "woosh" and flowed down the server into the sewer lines... I mean the internet.

Gnarly outage. Was intermittent noon - 3PM PST on ATT in Cali. 3PM+ it's totally down.

YAY I'm down to only 30000!!!

forgive the newbie here, but does this outage affect ATT using just BIS? I have a curve and can't get internet, not getting eny email and any data connection like Jivetalk doesnt work. Thanks...

Looks like we are back up. I still have some pending messages, but I think that's from users who put their devices in their drawers

Sending messages is almost instant now...yay!

Browsing and PIN working great too.

This affects all (or many) users in North America, all carriers, all model devices, all services but phone.

Wooo! *fingers get busy again*

Im only on BIS but it did not feel very good to be so lost. I was in a Zombie state almost!

"OMG my pins are not delivered!" "I cannot connect to the web!"

"I picked NOW to stop sniffing glue!"

back up in boston

I can use PIN to PIN on my BIS device, but my Gmail account is not working.

I resent the service books to my device and received the service books for my Charter.net account, but not the Gmail.com account.

Anyone else having problems with Gmail via BIS?

Yes this happen to me around 3 pm NYC time when I tried to activate a user. I don't see any angry or pissed of at rim.

This happen a couple of times in the past. I thought rim would get it act together, so now they cant argue their push email system is the best. Heck if someone come out with 99.9999999% uptime network, that's where I will go. Look at what google did against yahoo and msn. No one can't beat them on search engine.

I can't believe a crashed server can take RIM's network down like this for 4 hours. Why isn't there infrastructure a little more redundant? You would think a company their size with so many subsribers depending on their devices would have that in place. This is at least the 3rd time something like this has happened over the past 12 months so I hope RIM is working on preventing things like this from happening going forward.

Unfortunately I will bet u $202M which is the current NY megamillion lottery that this WILL happen again.