+ Start a Discussion
pinal2pinal2 

Loading Account takes long time

Hi Folks,

 

I need your help/thoughts.  I am loading Account records using Data Loader Command Line Interface. The Account has about 600,000 records with almost 70 to 80 fields.  Account data load takes about 20 hours to load.  Bulk API is used with parallel mode and the size of the batch is set to 6,000.  When I set the size to 10,000, it take over 10 mins to complete, thus, throws timeout error. So, I am going with 6,000.

 

One of the question I have is although the Bulk API is used with parallel mode, I don't see multiple batches running in parallel.  I would think that if the feature is set to parallel, then the batches should run in parallel.  But I always see batches running in sequetial.

 

In addition to the above problem, is there any tuning/settings that you recommend to improve the performance?

 

Thanks!