Fetching {incremental_value} for incremental load from different schema than target. #382
Unanswered
rohitbatta
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am trying to load the data from source (oracle) to target (sqlserver). I am using incremental load approach to fetch delta and using last_modified column to load the data. Once data is loaded to sqlserver schema "staging", i would transform that data to different schema and cleanup staging schema.
For next run, there is no record in staging schema to calculate max_value for last_modified. Is there any option to pick the {incremant_value} dynamically from other schema from same database or picking max value from different table and pass it as {increment_value}
Beta Was this translation helpful? Give feedback.
All reactions