I'm a newbie to importomatic. Today I started an import of nearly 14,000 records into Raiser's Edge. After processing 595 records, the import has completely frozen. Has this happened to anyone before? I'm worried - if I close Raiser's Edge or restart my computer, will I lose the work I've already done??
I checked your record in our system and it indicates that your Raiser's Edge database is hosted by Blackbaud. Is this the case? Do you have Supervisor rights in RE? Has your import been running for more than 15 minutes?
If you answered yes to those questions, then it is very likely that your Hosting session has timed out and that you have actually been disconnected from RE. By default all RE users are logged out after 15 minutes of inactivity. This setting can be changed for all users EXCEPT those with Supervisor rights. Users with Supervisor rights are always logged out after 15 minutes of inactivity, to help protect your data.
The place to change this setting for non-Supervisor users is:
RE:Config--->Business Rules--->System Access Options--->Disable inactivity timeout for all non-Supervisor users
Unfortunately, the RE database does not always see importing as activity.
You can set up an RE user specifically for importing that does not have Supervisor rights and change the aforementioned setting in RE:Config.
If your session has timed out, you will have to re-start your connection to Hosting and re-start RE. While you should not lose the data for rows that have been successfully imported up to the point of the timeout, you will have to do some investigating to determine exactly where the import stopped. Since the entire session timed out, there was no way for IOM to create an entry in the Error.txt to tell you where it stopped. You can think of it almost as though you rebooted mid-import - there was no time for the applications that were running to tidy up.
I would generally recommend against running a 14,000 record file all in one run. If, for instance, you discovered you had the wrong value in a column, or had a field mapped incorrectly and the data ended up in the wrong place, you'd probably rather find out with a smaller group of records when you went back and spot checked your data. (All of you out there do spot check your data after import, right?) If it was 100 rows, or even 500 rows, that imported with a mistake you could recover from it manually in RE. If 10,000 rows imported with a mistake, then you're probably going to consider getting a backup restored.
You do have one advantage, being Hosted. Blackbaud backs you up every 15 minutes, and I do not believe they charge to restore your backup. That said, you still have to call Support and wait to have the backup restored, and you will lose anything done in RE after the restore point. For clients that are not hosted by Blackbaud, I would advise you to not process a really large file unless you have had your database backed up immediately prior to running the import. An import cannot be reversed once the import has been committed.
We have developed a free utility, called SplitOmatic, to help you easily break up large import files into more manageable chunks. Simply point it at a source folder that contains your .CSV files, specify an output folder and the number of data rows per file that you would like to have, then hit the start button. The last time I used it, on a file with 60k+ rows in it, it took under a minute to run. You can download SplitOmatic here: http://www.omaticsoftware.com/Forums/tabid/108/aft/44/Default.aspx#371
Please let me know if I can be of further assistance.