function readOnly(count){ }
Starting November 20, the site will be set to read-only. On December 4, 2023,
forum discussions will move to the Trailblazer Community.
+ Start a Discussion
ArifArif 

What is the best way of Loading or backfilling bulk data

Requirement 1:
From time to time we update Products and make them enable/disabled or change any other field.
We have about a few hundered products that are changed.

Right now we are using Apex script to update them which runs fine but it requires a developer to update it every time and run it over. Obviously we test it before running.
I wonder if there is anything we can do to automate it, any thoughts?
I am thinking if we have any data migration tool that will take a file and update the product but that will require another license.
Another option is to simply write an Apex code get the file in uploads and run the script.
Third is to create one Flow to extract data from excel to product.

Requirement 2:
During the testing sometimes a lot of data is needed to test if our test are passed or not say we are testing duplicate rules. Or any other part in reporting that requires data. or we have created new objects that require regressive testing.
How can we effectively generate some real like data.

Condition: We are not allowed to use Salesforce data-loader in any of the requirement as its open source. Please don’t ask why :) 

Any help would be much appriciated!

Shri RajShri Raj
For Requirement 1:
One option you can consider is writing an Apex class that can read the data from a file and update the products accordingly. You can use the Salesforce API (e.g. REST API, SOAP API, or Bulk API) to do the updates. You can schedule this Apex class to run at a specific time, so that you don't need to manually run it every time you need to update the products.
Another option is to use an integration platform like Mulesoft or Jitterbit to automate the data migration process. You can set up a process that reads the data from the file and updates the products in Salesforce.
You can also use the Salesforce's native process builder or flow to update the products. You can use the flow's "Record Lookup" and "Record Update" elements to update the products based on the data in the file.
For Requirement 2:
One option is to use a data generation tool like Fabric.co or Generatedata.com to generate realistic sample data. You can then use the Salesforce API to upload the generated data into Salesforce for testing purposes.
Another option is to write an Apex class that can generate the sample data programmatically and insert it into Salesforce. You can use the built-in Salesforce random number and string functions to generate realistic data.
You can also use the Salesforce data generation tool, "Data Factory," to generate realistic sample data. Data Factory uses algorithms and rules to generate data that closely resembles real-world data.
Leo BishopLeo Bishop

The best way to backfill data is not to have to do it in the first place. In other words, by reducing the number of data incidents that require your team to go back and insert updated, correct data, the less data downtime you'll experience.

 

https://www.vwcredit.me/