I didn't see a hiccup, nor did most of my Rogers users.

No way, I'm in Northern Va, email is still *very* flaky.

BIS, Verizon.

-A

i have about 100 users, and i sent them all links and excerpts of the CNN article about it this morning so they would chill out. thankfully most of my users have desktop pcs or at least access to them for the meantime. we seem to be ok now, mine was recieveing again at 420-422am

"NEW YORK (CNNMoney.com) -- A massive system wide failure of the BlackBerry network has brought emails to a halt for users of the handheld communication devices Wednesday morning, according to a report from a New York TV news channel.

As of Wednesday morning the Blackberry Customer Support Center has a recorded message that says the following: "Please be advised that we are currently experiencing service interruptions that are causing delays in sending and receiving messages."

"We apologize for the inconvenience and will provide updates as soon as they become available," the message said.

The problem, which started at 8 p.m. ET Tuesday, affected Blackberries throughout the Western hemisphere by preventing emails from being pushed to the handheld devices, according to WNBC.

Research in Motion (Charts) (RIMM), which makes Blackberry device and runs the system, was not immediately available to comment on the outage.

RIMM stock is trading is sharply lower in pre-market trading.

Research in Motion is trying to reset the system but expects the problem to last into the morning, the report said.

Even when the system is reset, users will experience delays as the company processes through the backlog of email messages, WNBC reported.

According to documents filed with the U.S. Securities and Exchange Commission, Research in Motion had approximately 8 million Blackberry subscribers worldwide in 2007.

BlackBerry maker's earnings up"

Internet back up here on sprint in Ohio.
No emails yet!

Phoenix, AZ

Im only getting my gmail pushed to me now. Yahoo and @tmo.blackberry.net still down

Isn't this FUN? All of my users were freaking out this morning. I think I'm going to have to have a 12 step program for them. Anyway, I thought this was hiliarous (from CNN's article about the outage):

"A spokeswoman for Verizon, one of the service providers for Research in Motion, said the outage didn't involve Verizon's networks."

So let me get this straight, Verizon's Blackberry's don't use the RIM network. WOW, let me buy some of THAT stock.

You know, now that you mention it, my connection description has been going between 1xev and the usual 1XEV since last night. Can anyone explain the difference to me, aside from the obvious capitalization?

tmo BIS here in MD back up and runnin so far....

As of 9:00, all of our Nextel 72xx's are completely functional (WWW included). New emails are being delivered to the handheld in real time

Around 9:45, the VZW 8703e's started getting their backlog of messages, and some new messages, but the service isn't consistent. WWW is still down, and BB Msgr PIN messages seem to get delivered/received about 50% of the time

Cingular here

Everything is up here for me

VA

I am in Alexandria, VA......BES/BIS and internet up and running finally

Cingular here

Everything is up here for me

VA

VZW - NYC

BES/BIS - Working
WWW - Working
BB Msgr / PIN Msgs - Not Working

Nextel - NYC

BES/BIS - Working
WWW - Working
BB Msgr / PIN Msgs - Working

Cingular - NYC

BES/BIS - Working
WWW - Working
BB Msgr / PIN Msgs - Working

TMO - NYC

BES/BIS - Working
WWW - Not Working
BB Msgr / PIN Msgs - Not Working

Well, it seems as though gmail is not push right now - anyone else experiencing this ?

I just got this article from zdnet regarding the outages and look at who they're referencing!

I can't post proper links so here is a butchered copy of it:
news. zdnet. com/2100-1035_22-6177072. html

A widespread system failure of Research In Motion's network has left BlackBerry users in the Western Hemisphere without e-mail on their handheld devices.

The problem, first reported on news site WNBC.com, is believed to have originated around 8 p.m. Eastern time Tuesday and has not yet been solved. Because the problem concerns the RIM BlackBerry network, all cellular carriers that support BlackBerry are affected.

On the BlackberryForums.com discussion site, some people also indicated that they could not browse the Internet.

RIM has acknowledged the problem through a recorded message that plays when calls are placed to the BlackBerry customer service hotline. The message states that the company is "currently experiencing a service interruption that is causing delays in sending or receiving messages." No updates have been provided, and no time frame has been given for resolving the problem. However, the automated message assured callers that they would be kept in the loop.

Attempts to reach press representatives at Waterloo, Ontario-based RIM have been unsuccessful.

looks like it fixed itself....

Neither by blackberry.net nor my gmail are coming through yet. they did for a little bit this morning. I sent myself test messages from my desktop and they are not coming in yet.

US Cellular is getting email now

RIM is in for a rough ride on this one...here is a Q&A from the Globe & Mail site published about an hour ago

DesMoinesRegister.com


Thousands of Iowans were relieved this morning to learn that their BlackBerry electronic devices were once again sending and receiving e-mails.

Research in Motion Ltd., which owns the BlackBerry network, said today it had restored BlackBerry service to most customers after disruptions delayed e-mail messages in North America, according to Bloomberg News Service.

rogers is still not up. i get random emails to my 8700. internet is fine and pin is fine. i can log in to bis and send service books but dont actually get them. ive done a few resets (battery out) just in case.

I seemed to be delayed by one email right now. ie new email comes in, the email before that gets pushed.

I'm also getting rogers activation messages every few hours.

I stand corrected...everything was working until 10 mins ago. Now I have "edge", no browser, no host routing table, no email...........

Arlington, VA

When you see 1xev it means you're connected to the Verizon EVDO network, but not the BlackBerry servers and service. 1XEV means you're connect to both Verizon's network AND the BlackBerry service.

I have some devices working and some not (various carriers - Nextel, Sprint, T-Mobile). I also have 1 Nextel device that I cannot get to complete the Enterprise Activation. This is for an existing user who is getting a different device (7520). The activation gets to 'Waiting for services' and then times out.

Ho Hum.....

Rogers was down for about 15 minutes last night and then came back up. I guess with the back log, my e-mail was delayed up to 8 hours this morning.

Rogers was down for about 15 minutes last night and then came back up. I guess with the back log, my e-mail was delayed up to 8 hours this morning.

I'm gonna have to followup, though, and point to the link that another member posted from the G&M:

http://www.theglobeandmail.com/servl.../Business/home

I feel vindicated for my statement, RIM has everything going through one NOC and that NOC screwed up for whatever reason. This is piss-poor planning and a horrible network infrastructure, they should feel rightly chastized for having such a crappy infrastructure with one point of failure.

(systems engineering hat on) There is no excuse. (hat off)

Had a whole bunch of e-mail this morning (backlog from yesterday evening) when I got up at 8 a.m. PST. Things have been coming through sure and steady since about 11 a.m.
Funny enough I didn't enough wonder why my e-mail wasn't coming through to the BB until someone asked me if I knew about it around 9 p.m. PST yesterday. Heh. I guess after I've had dinner I don't really think much about the ole Berry on a weeknight.
But it came back up in time for me to have a harried e-mail exchange with my dentist's appointment setter. Got tomorrow's appointment cancelled. Yay me! Boyo, what would I do without this thing? ;)

So load balance through mulitiple data centers on multiple continents with a hundred-fold redundancy on the load balancers only to have a provider have issues? Honestly, the idea behind 'no single point of failure', as i mentioned, is a big ole marketing ploy. Kind of like Santa Claus for the network and systems weenies (yes, I'm one of the latter). An outage of this magnitude makes people understand that no matter what kind of HA environment you build, there's always something out of your reach that can (and will) happen that disrupts service.

P.S. - That's just my personal opinions, by the way. When I do speak to our RIM contacts, obviously I'll side with your opinions and judgements, but I also know the reality of issues that are going to happen from time to time.

9:00pm EST
Tmobile NE Ohio

BB Emails are still very flakey (emails get sent out late, in bursts)
WWW is hit/miss. Usually works one time. Then will not go anywhere else.
EDGE (not edge)

haha sounds like me talking to my people... "look, if I had my way there'd be an OC-12 drop to every desk and you could look at all the pr0n you want, but for now you are *not* allowed to download episodes of 'Lost' via the office LAN."

all's well for baltimore cingular

TMO in Denver Co,

I am only getting GSM on my berry, no gprs or GPRS.

And you'd be OK to pay twice as much for your service so that an outage every year could be avoided?

As I tell my users, e-mail is a great tool. But if yiu need to make absolutely sure that your commmunication is received, pick up the phone!!!

I woke up to this problem in Gdansk, Poland this morning on three different networks. Flew to Shannon, Ireland and still had the same problem. It was obviously much bigger than just North America/Western Hemisphere. Got back to the states and all was working again this afternoon.

Possibly, yes - but then again you're on Robbers and already pay through the nose for data charges. But keep in mind RIM services, amongst others, very large businesses that *will* pay to never go down.

My data charges are over twice my phone bill, so why isn't my service twice as good? But I digress...

I just came up at 1105 MTN. Glad we don't have these outages often...

An executive at our company said this morning, in regards to the outage and business notification to our users, that "BlackBerry technology changes the way we do business with one another. When we have a widespread outage such as this one, even those people who don't have BlackBerry devices need to be notified, as it affects the way we work and management styles and practices for everyone."

Yes, I will agree with you that the phone has not been replaced by email, but the entire scope and landscape of how business is run has changed because of data communication services, such as email (and mobile email). Depending on your company, considering either as non-critical non-replacements for traditional communication devices, such as the phone, would be an oversight, imo.

Do I think that BlackBerry is a high priority critical service? At my former company, the largest conferencing provider in the world, I would say 'No' in most cases. At my current company, I would have to say an emphatic 'Yes'.