+ Start a Discussion
sailersailer 

Bulk API Process-Config.XML(1 Million Records)

 Hi Everyone,

 

I am not able to insert million records.i am keeping the batch size as "100",can we increase this batch size .

Does it apply the governor limits.

or we have any process..

Your organization has processed 2,020 batches in the last 24 hours.  Your organization can process 2,000 batches in a 24-hour period.

 

<beans>
 <bean id="AccountBLR_TEST_Insert_TtoS" class="com.salesforce.dataloader.process.ProcessRunner" singleton="false">
  <description>Created by Dataloader Cliq.</description>
  <property name="name" value="AccountBLR_TEST_Insert_TtoS"/>
  <property name="configOverrideMap">
   <map>
    <entry key="dataAccess.name" value="C:\salesforce.com\Data Loader\cliq_process\AccountBLR_TEST_Insert_TtoS\read\AccountBLR_TEST_Insert_TtoS.csv"/>
    <entry key="dataAccess.readUTF8" value="true"/>
    <entry key="dataAccess.type" value="csvRead"/>
    <entry key="dataAccess.writeUTF8" value="true"/>
    <entry key="process.enableExtractStatusOutput" value="true"/>
    <entry key="process.enableLastRunOutput" value="true"/>
    <entry key="process.lastRunOutputDirectory" value="C:\salesforce.com\Data Loader\cliq_process\AccountBLR_TEST_Insert_TtoS\log"/>
    <entry key="process.mappingFile" value="C:\salesforce.com\Data Loader\cliq_process\AccountBLR_TEST_Insert_TtoS\config\AccountBLR_TEST_Insert_TtoS.sdl"/>
    <entry key="process.operation" value="insert"/>
    <entry key="process.statusOutputDirectory" value="C:\salesforce.com\Data Loader\cliq_process\AccountBLR_TEST_Insert_TtoS\log"/>
    <entry key="sfdc.bulkApiCheckStatusInterval" value="5000"/>
    <entry key="sfdc.bulkApiSerialMode" value="5000"/>
    <entry key="sfdc.debugMessages" value="false"/>
    <entry key="sfdc.enableRetries" value="true"/>
    <entry key="sfdc.endpoint" value="https://www.salesforce.com/services/Soap/u/28.0"/>
    <entry key="sfdc.entity" value="Account_BLR_Test__c"/>
    <entry key="sfdc.extractionRequestSize" value="500"/>
    <entry key="sfdc.insertNulls" value="false"/>
    <entry key="sfdc.loadBatchSize" value="100"/>-----Can we increase the Batch size ?any Governor Limits
    <entry key="sfdc.maxRetries" value="3"/>
    <entry key="sfdc.minRetrySleepSecs" value="2"/>
    <entry key="sfdc.noCompression" value="false"/>
    <entry key="sfdc.password" value="f441b413584b5116f80a8187cf4eec85"/>
    <entry key="sfdc.proxyHost" value=""/>
    <entry key="sfdc.proxyNtlmDomain" value=""/>
    <entry key="sfdc.proxyPassword" value=""/>
    <entry key="sfdc.proxyPort" value=""/>
    <entry key="sfdc.proxyUsername" value=""/>
    <entry key="sfdc.timeoutSecs" value="60"/>
    <entry key="sfdc.useBulkApi" value="true"/>
    <entry key="sfdc.username" value=""/>
   </map>
  </property>
 </bean>
</beans>

 

Pl let help me out.

 

Regards

Sailer

Best Answer chosen by Admin (Salesforce Developers) 
Rahul_sgRahul_sg
Using bulk api you can use batch size upto 10000.

Even with normal update you can use batch size of 200.

you have to make sure that there are either no triggers on Account_BLR_Test__c or triggers are bulk safe.

If your trigger are bulk safe or if there are no triggers then you can go for max batch size : 10000 (using bulk api)