Hello ,
I am basically trying to retrieve data from salesforce and build a csv based on certain criteria. But then way i designed it takes a ridiculously long time as all the tables are 1M+ rows. But the query that i can run directly in sql server (which has a copy of the SF database) takes less than 5 secs.
the query i intend to design in DS is…
select A.id, A.name, b.lift, c.qty, c.name from table1 A, table2 B left outer join table3 on b.id = c.name
where a.type = ‘Helsinki’
and a.createddate > getdate()-5
in my DS, the end result is correct, but every query transform is retrieving the entire table and its taking alteast an hour to run the job.
Please advise on how to retireve data where i can get the DS to query the database directly, rather than retrieve the entire table and then perform the filters ?
Hello!
Please tell me, did you use standard extraction methods or did you compose it yourself? Perhaps you have forgotten a point, check yourself using the salesforce implementation checklist. Possibly a problem with early setup.