function readOnly(count){ }
Starting November 20, the site will be set to read-only. On December 4, 2023,
forum discussions will move to the Trailblazer Community.
+ Start a Discussion
SKriLLSKriLL 

Limits on exporting data?

Im wondering what the limits are on exporting data from a salesforce org.  I noticed that when scheduling a data export through Setup > Administration Setup > Data Management > Data Export the most frequently scheduled export you can do is once a week.

 

If I create a data loader command line file and use a scheduled .bat to run this command line export every day, or every hour, will there be issues?

 

What if this data loader command line file only exports one object?  What if it exports the whole DB?

 

If someone could give answers for all the different kinds of salesforce editions that would also be fantastic.

 

Thanks

Best Answer chosen by Admin (Salesforce Developers) 
sfdcfoxsfdcfox

The Weekly Backup service is called that because it allows backups in one week increments. This is so that there's not excessive load on the exporting server (you do have to share with other people!).

 

If you create a batch file to run daily on the Apex Data Loader, this would probably be okay depending on how much data you have to export. A full-sized export running hourly might take more than an hour depending on the number of records you query, average record size, and available bandwidth. It will also consume a ton of API calls, of which there is also a limit per day depending on the number of licenses you purchase. Contrariwise, If you're exporting just a single table, unless that table is very large (a few million records), an hourly export would most likely be okay.

 

A "better" solution would be to seek out some solutions on the AppExchange, some of which have the ability to synchronize just updated and deleted records (a partial refresh) with daily or weekly full backups. This would save a ton of data storage space, and reduce system load both for your systems and salesforce.com. If those cost too much, you could also consider having a developer write one in-house if your budget allows.

 

A comprehensive product and feature comparison chart is found here: http://www.salesforce.com/crm/editions-pricing.jsp. Near the bottom is an all-inclusive PDF. Strictly speaking, each higher level edition builds upon the the level below it. Here's a brief summary of each level:

 

Personal: Contact management, including contacts, accounts, and task lists/calendar events. Limited to personal use.

 

Group: Above, plus sales tracking and lead generation. Limited to a few licenses.

 

Professional: Above, plus basic sharing (access control), optional campaign and product management, basic customer support features (for your clients; all editions receive salesforce.com technical support), and custom user interfaces (via Visualforce). Unlimited licenses available; this edition normally falls in the 5-100 user range.

 

Enterprise: Above, plus advanced sharing (field level control), enhanced customizations and security options, advanced portals, integration features (the "API"), automation, custom business logic (via Apex Code), and a few other perks.

 

Unlimited: Above, plus higher data limits, more API access/day, Premier Support (2 hour response time instead of 2 business days), more custom objects, tabs, and so on, included mobile access, free online training, and a ton of other perks mostly related to the service itself (e.g. a dedicated account executive).

 

Note that my list is very incomplete, but my goal is to provide just an overview of each level. See the PDF I linked above for details.

All Answers

sfdcfoxsfdcfox

The Weekly Backup service is called that because it allows backups in one week increments. This is so that there's not excessive load on the exporting server (you do have to share with other people!).

 

If you create a batch file to run daily on the Apex Data Loader, this would probably be okay depending on how much data you have to export. A full-sized export running hourly might take more than an hour depending on the number of records you query, average record size, and available bandwidth. It will also consume a ton of API calls, of which there is also a limit per day depending on the number of licenses you purchase. Contrariwise, If you're exporting just a single table, unless that table is very large (a few million records), an hourly export would most likely be okay.

 

A "better" solution would be to seek out some solutions on the AppExchange, some of which have the ability to synchronize just updated and deleted records (a partial refresh) with daily or weekly full backups. This would save a ton of data storage space, and reduce system load both for your systems and salesforce.com. If those cost too much, you could also consider having a developer write one in-house if your budget allows.

 

A comprehensive product and feature comparison chart is found here: http://www.salesforce.com/crm/editions-pricing.jsp. Near the bottom is an all-inclusive PDF. Strictly speaking, each higher level edition builds upon the the level below it. Here's a brief summary of each level:

 

Personal: Contact management, including contacts, accounts, and task lists/calendar events. Limited to personal use.

 

Group: Above, plus sales tracking and lead generation. Limited to a few licenses.

 

Professional: Above, plus basic sharing (access control), optional campaign and product management, basic customer support features (for your clients; all editions receive salesforce.com technical support), and custom user interfaces (via Visualforce). Unlimited licenses available; this edition normally falls in the 5-100 user range.

 

Enterprise: Above, plus advanced sharing (field level control), enhanced customizations and security options, advanced portals, integration features (the "API"), automation, custom business logic (via Apex Code), and a few other perks.

 

Unlimited: Above, plus higher data limits, more API access/day, Premier Support (2 hour response time instead of 2 business days), more custom objects, tabs, and so on, included mobile access, free online training, and a ton of other perks mostly related to the service itself (e.g. a dedicated account executive).

 

Note that my list is very incomplete, but my goal is to provide just an overview of each level. See the PDF I linked above for details.

This was selected as the best answer
SKriLLSKriLL

...the ability to synchronize just updated and deleted records (a partial refresh) with daily or weekly full backups....you could also consider having a developer write one in-house if your budget allows...

 

This sounds like a good path to go down.  Any chance you have some reference materials for how to go about building something like that ourselves?

sfdcfoxsfdcfox

http://www.salesforce.com/us/developer/docs/api/index.htm

 

This page contains the documentation you need to get started, including code samples in both C# and Java. You'll need a SDK that can use WSDL files (from Setup > Develop > API), a programmer with the skills to complete the task, and a server to host the application on. Of particular interest in your scenario includes "getUpdated()" and "getDeleted()", which is a replication API designed to be called in increments as small as five minutes to allow near real-time replication of your data.

 

There's also a wealth of information here in the forums, as well as in the blogs and documentation area (the blue bar above).