You need to sign in to do that
Don't have an account?
Josh Brown 14
Export all Account data to S3 nightly
Hello,
I'm been trying to figure out how to get a list of all 167,000 accounts and put them in a csv and upload to S3 nightly. I'm running into multiple issues, mainly the size of the row return and uploading to S3 on a schedule. For the first part, i've been trying to use a Batchable class to bypass the 50,000 row limit, but Batchables don't allow @future calls, so I can't upload to S3. So then I tried using Queueable to bypass the @future problem, but I run into the 50,000 row limit. Is there a way to do this or am I stuck?
I'm been trying to figure out how to get a list of all 167,000 accounts and put them in a csv and upload to S3 nightly. I'm running into multiple issues, mainly the size of the row return and uploading to S3 on a schedule. For the first part, i've been trying to use a Batchable class to bypass the 50,000 row limit, but Batchables don't allow @future calls, so I can't upload to S3. So then I tried using Queueable to bypass the @future problem, but I run into the 50,000 row limit. Is there a way to do this or am I stuck?
From the batch class, instead of calling a future method, you can call a Queueable class. Will this fulfill your use case?
Thank you for this! I was trying to go that route, but I need to push the final csv to the queueable class so that the csv can be uploaded to S3, but I couldn't figure out how to add a parameter to the queueable class. Could you help me with that?
Batch Class
Queueable Class