I'm working with a third party API that provides a large amount of data to by synced with my org. Unfortunately, the API does not support paging or limiting my results. I simply get all of my data at one time. After implementing req.setHeader('Accept-Encoding', 'gzip') and req.setCompressed(true) I am now able to get a response, but when I call getBody on the response it is decompressed and causes my Heap Size to jump to about 30 MB. This is preventing me from saving the response and processing it in a seperate transaction. Any advice on how to deal with large amounts of data with third party APIs?

Hi,

There is an standard object called File. If i want to import and export files in the file object using data loader i cannot do it because File object is not there in the list in Data Loader. Please tell me how to export and import files.