It's Been 17 Hours and Still Running an Import

True Story

You wouldn't believe it. I started this import of Excel data into an ACT! database at 2:15pm yesterday. After a minute or two, the status of the import shows "Not Responding" Import window shows only the frame, all of the content has disappeared. Why now after 17 hours am I still hopeful to have a successful import?

First step: Open the Task Manager. It shows running at 100%. Now how do I differentiate between a crash or if this massive import is still running? Of the various columns I select quite a number of them to indicate current status.

Currently running tasks:
Sqlservr.exe
I/O Read bytes at 32 billion, I/O Write bytes 124 billion and a virtual memory at 758K KB.

ACTSage.exe
I/O Read bytes at 14 billion, I/O Write bytes 22 billion and a virtual memory at 335K KB.

Excel.exe
I/O Read bytes at 44 million, I/O Write bytes 7 million and a virtual memory at 135K KB.

AppSvc32.exe
I/O Read bytes at 5.3 trillion, I/O Write bytes 1.7 trillion and a virtual memory at 12K KB.

But even if I did check the Task Manager carefully, I'm not positive this thing is still running. However, since I am able to also check an import log, I'm in better shape.

Fearing to interrupt the import process, I don't open the log directly. Instead I copy, using right click, onto my desktop. So now I'm able to open a copy of the log to check the process. It reveals of the nearly 6K ACT contacts, greater than 2/3rds have already been imported. This log file is the only real evidence I have that my mission is well underway. This import tool is well designed to include this kind of ancillary reference. I scroll down to the end and find of the 5,936 contacts, 4,124 have been confirmed to be written in ACT!

Because the log file details in the operating system show the date created as well as last modified, I calculate an estimate of how long this import will need to run to finish the last third of the contacts (1,812).

Since it has taken 17 hours to write 4,124 contacts, that works out to 242 contacts per hour. As I divide the 1812 by 242 the results is 7 more hours. If this works, the total import time will be 24 hours.

Why would an import take so much time? Well the tool I'm using has so many settings. Besides bringing in the contacts, it will create companies. More powerful for me is the ability to create groups.

Originally this client had another ACC (ACT! Certified Consultant) set up their database. It was poorly designed. Bad design results in a reduction in productivity. There were too many fields. In addition, nebulous field labels meant the user could be easily confused. So there could be a slack off on entering vital information.

This import means a lot to me. The client may have lost faith, but I'm on a mission. Therefore I'm willing to let this run. All told this will take over 24 hours. Billable hours? Well I did sleep through some of this. ;-> The lessons learned are as follows:


Lessons regarding Import

*Avoid when ever possible using an immature tool. The version of this import tool is 1.0.17. Unavoidable this time... But the tool is sufficently well designed to have an import log.

*Make sure the power settings on the control panel do not turn off the hard drive.

*Use the Task Manager to show the running processes.

*Copy the import log rather than opening it directly which could spoil the only verification tool in the import app.

I'm signing off. I'm a bit weary from the hypervigilance necessary on this import - now running at over 18 hours....