BlackBerry Forums Support Community               

Closed Thread
 
LinkBack Thread Tools
Old 06-20-2006, 05:31 AM   #1 (permalink)
Thumbs Must Hurt
 
Join Date: Mar 2005
Model: 7100t
Posts: 63
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default SMS_Borer - Export SMS data from backup file(.ipd)

Please Login to Remove!

I develop this utility to export sms data from backup file (*.ipd). To some people who have plenty of SMS, they can use it to export SMS data on PC. And then process it using any application you like (For example, MS excel). There is a .ipd sample in zip package for your reference. Any feedback is welcome. Enjoy it.

(1)Running following command and export data to "output.dat". You can open the .dat file using MS Excel and use its text_to_columm function to separate data to several columns.
sms_borer.exe xxxxxxxx.ipd

(2)Format of output file "output.dat"
One line is one SMS. Every Fields are separated by "|"(7CH). For example
"1|1|20060309-063046|20060614-134937|+861372550000|qwerty111"

1st Field: Seq no
2nd Field: Direction. 1 for receiving, 0 for sending.
3rd Field: UST(GMT +0)
4th Field: For receiving, time stamp with SMS
For sending, UST(GMT+0)
5th Field: Far end mobile number
6th Field: SMS content. Don't support unicode at this version.

(3)Test
Test on Win2K & XP and confirm it pass for following platform
DM Ver: 4.0.0.x, 4.0.1.x, 4.1.0.xxx
BB OS: 4.0.0.x, 4.0.2.x, 4.1.1.xxx, 3.8.0.xxx

(4)Limitation
This version don't support unicode.
Attached Images
File Type: jpg excel_e.jpg (44.4 KB, 277 views)
Attached Files
File Type: zip sms_borer1.3e.zip (28.4 KB, 451 views)

Last edited by haobo : 07-27-2006 at 06:09 AM.
Offline  
Old 06-21-2006, 09:05 PM   #2 (permalink)
Thumbs Must Hurt
 
Join Date: Mar 2005
Model: 7100t
Posts: 63
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Someone even tried this program? Look forward to any feedback.
Offline  
Old 06-22-2006, 01:44 AM   #3 (permalink)
Retired BlackBerryForums.com Moderator
 
d_fisher's Avatar
 
Join Date: Oct 2005
Location: Columbus, OH
Model: 9700
OS: SID 6.7
Carrier: AT&T
Posts: 4,455
Post Thanks: 0
Thanked 2 Times in 1 Post
Default

I tried it, but it didn't give me anything useful. Not sure how I could use this utility in a beneficial way. If the SMS content field would actually show the text from the message it would be much more useful.
__________________
Doug

Remember, please try searching first!

Need a screenshot? ... Like JavaLoader?
Try using BBscreen .....Use JL_Cmder!
or BBScreenShooter!

[SIGPIC][/SIGPIC]
Offline  
Old 06-22-2006, 06:03 AM   #4 (permalink)
Thumbs Must Hurt
 
Join Date: Mar 2005
Model: 7100t
Posts: 63
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Sure. It's used to export info from SMS backup file. Have you tried the sample ipd in package? is it ok? If yes, you get correct way to use this utility.
If the content of your SMS include unicode (For example, East Asia Character), pls try another unicode version here. It work well with simplied chinese and should be ok for Japanese & Korean.
Attached Files
File Type: zip sms_borer_u.zip (32.0 KB, 147 views)

Last edited by haobo : 06-22-2006 at 06:25 AM.
Offline  
Old 06-22-2006, 06:05 AM   #5 (permalink)
New Member
 
Join Date: Mar 2006
Location: Qingdao, China
Model: 8700
Carrier: cmcc
Posts: 3
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Say Hello to VIP BB user from China
Offline  
Old 06-22-2006, 06:31 AM   #6 (permalink)
Thumbs Must Hurt
 
Join Date: Mar 2005
Model: 7100t
Posts: 63
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Quote:
Originally Posted by Wilber
Say Hello to VIP BB user from China
Nice to see you here.
Offline  
Old 07-05-2006, 03:15 AM   #7 (permalink)
New Member
 
Join Date: Jul 2006
Model: 7290
Posts: 2
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Hi haobo

I used this to export the SMS from my 7290. It does exactly what you say it does - I love it. I've been looking for a utility like this far ages! Great to see it here.

A tip for users is to create a new back up of ONLY your SMS using the desktop manager. The utility will then recognise the SMS and export the to output.dat file.

Once output, you can import the data in Excel using the import wizard. For the delimiter, select 'other' and enter the grep [ | ] character.

Thanks again haobo.

Cheers

Ali.
Offline  
Old 07-05-2006, 03:33 AM   #8 (permalink)
New Member
 
Join Date: Jul 2006
Model: 7290
Posts: 2
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

By the way, I used this on XP Pro SP2, using desktop manager 4.1.08 and 7290 version 3.8.0.139.
Offline  
Old 09-08-2006, 06:00 AM   #9 (permalink)
New Member
 
Join Date: Sep 2006
Model: 7290
Carrier: D1 Telekom
Posts: 2
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Havent tried it yet, but from the screenshots exactly what i was looking for , thanks a lot from Germany ..
Offline  
Old 09-08-2006, 10:24 AM   #10 (permalink)
CrackBerry Addict
 
Join Date: Aug 2004
Model: 950
Carrier: robbers
Posts: 909
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Damn -- a fine application. I don't have a use for this, but can you possibly use this to extract other data so users can export this?

This is a much requested feature that just does not exist.. keep on it , and you will have a definiate market share, especially from IT professionals..

let me know if you do, i'll purchase it..

* Extract e-mail
* Extract sent messages
* Extract PIN messages
etc
Offline  
Old 09-08-2006, 11:24 PM   #11 (permalink)
New Member
 
Join Date: Sep 2006
Model: 6230
Posts: 5
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

There is a limitation on the number of records that can be exported. Is it possible to either remove this limitation, or somehow extract sections of the file at a time?

Thanks
Offline  
Old 09-21-2006, 03:29 AM   #12 (permalink)
New Member
 
Join Date: Sep 2006
Model: 7290
Carrier: D1 Telekom
Posts: 2
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

HiHo,

me again... so i tried the program, and as bradwhiteau says it does not seem to extract all the messages that are stored in the ipd file. I tried IPDEditor too, which displays all messages, but that program does not allow the export of the messages :(...

I'm also trying to convert the file myself, found the documentation of the ipd file (general structure, database block set-up), but from that documentation it is not quiet clear, who to convert the none ascii parts, e.g. the conversion of the timestamp is a ridle to me, how to convert that? Maybe you can point me to another doc.

Hope you'll come back to this forum and see my remark ...
Offline  
Old 09-21-2006, 12:25 PM   #13 (permalink)
New Member
 
Join Date: Sep 2006
Model: 7105
Carrier: T-Mobile
Posts: 7
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default Export ipd format to csv

I have a utility for extracting SMS, Contact, E-Mail, Phone Log and Calendar info to a comma separated values file. Its not free, but it is cheap ($10). Its called bbExtractor and comes with a report writer called textifire.

I noticed someone asked for PIN messages. I don't know what that is, but I could add it to the extractor if there is interest.
Offline  
Old 09-21-2006, 07:04 PM   #14 (permalink)
New Member
 
Join Date: Sep 2006
Model: 6230
Posts: 5
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

MScott,

I am certainly not against buying a package...could you possibly provide details on here of the package, how it operates and how to purchase it for both myself and other interested people?

Thanks,
Brad.
Offline  
Old 09-22-2006, 10:36 AM   #15 (permalink)
New Member
 
Join Date: Sep 2006
Model: 7105
Carrier: T-Mobile
Posts: 7
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Brad,

I can't put a URL in my posts until I've made at least 10 posts, but if you google either 'bbextractor' or 'textifire' the home page will come up.

You can buy the software from the products page, it downloads as a self-extracting zip file. Once you've installed it you just click 'Find Files' to search for ipds then double click the backup file you want to open. Every database in the ipd is listed on the main screen (there's usually about 60 or so). From here you double click the database name you want to open, or click the corresponding speed button on the top row and the contents of the database appear in a spreadsheet-like grid. From here you can export to a csv file or pipe the output to the report writer and reformat it how you wish.

There are some automation features tied to the 'Config' button, such as a default search start directory and automatic database opening that can save some effort if you use the program a lot.

This whole process started for me when my girlfriend gave her blackberry to her nephew and needed to pull her contact and schedule info off her phone and I was shocked to find there was no easy way to do it. I then added email, sms and phone log extractors as well as viewing cabability for all the other databases in the file.

Anyway, I hope you find this utility useful and I am open to suggestions on how to improve it.

-Mike
Offline  
Old 10-03-2006, 12:49 AM   #16 (permalink)
New Member
 
Join Date: Sep 2006
Model: 6230
Posts: 5
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Hey MScott.

I purchased your program and it works great! I managed to extract the SMS, all 3500+ of them. One issue/improvement...

It seems it extracts the received SMS, but not the sent...is that in a different folder, and can I extract those also somehow? Or is that another change to the program?

Thanks,
Brad.
Offline  
Old 10-05-2006, 10:51 PM   #17 (permalink)
New Member
 
Join Date: Sep 2006
Model: 7105
Carrier: T-Mobile
Posts: 7
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Hey Brad,

Glad you like the software. All the databases stored in the ipd can be viewed in bbExtractor by double clicking the name on the main screen. I haven't found one that contains the outbound SMS files but if it's there I'll find it. I'll keep you posted.

Mike
Offline  
Old 10-05-2006, 11:26 PM   #18 (permalink)
Talking BlackBerry Encyclopedia
 
Join Date: Apr 2005
Location: Los Angeles, CA USA
Model: 9000
OS: 4.6.0.247
Carrier: AT&T
Posts: 209
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Incoming and outgoing SMS are stored in the same database. Look for field type 0x0B. If the first byte of data for that field is 0x00, the message was sent. If the first byte of data for that field is 0x01, the message was received.
Offline  
Old 10-10-2006, 09:05 PM   #19 (permalink)
New Member
 
Join Date: Sep 2006
Model: 7105
Carrier: T-Mobile
Posts: 7
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Thanks Tateu,

I rolled a Sent/Received flag into my last update of bbExtractor which also fixes the email timestamp issue. If you still need any help with timestamps, just drop the tech support guys a line at textifire.

Mike
Offline  
Old 02-05-2007, 07:14 PM   #20 (permalink)
Talking BlackBerry Encyclopedia
 
MyPearl's Avatar
 
Join Date: Jan 2007
Model: 9700
Carrier: AT&T
Posts: 263
Post Thanks: 0
Thanked 0 Times in 0 Posts
Default

Hi, the program worked fine when tried with sample.ipd. then when i tried to use it with my exported ipd (8100 pearl with latest s/w), i got the following:

--Inter@ctive Pager Backup/Restore File--2--75--1--
Name of database 57 is SMS Messages
Read body of record fail!Abnormal exit!!

** Database 57: xxx945;d3xxx9555;xxx9559;\xxx8597;
Records: 0
Columns: -919833700
Offline  
Closed Thread


Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On





Copyright 2004-2014 BlackBerryForums.com.
The names RIM and BlackBerry are registered Trademarks of BlackBerry Inc.