問題タブ [astera-dw-builder]
For questions regarding programming in ECMAScript (JavaScript/JS) and its various dialects/implementations (excluding ActionScript). Note JavaScript is NOT the same as Java! Please include all relevant tags on your question; e.g., [node.js], [jquery], [json], [reactjs], [angular], [ember.js], [vue.js], [typescript], [svelte], etc.
data-modeling - Error due to inserting null values in fact table in cases where dimension is not updated
I have recently deployed a data model on Astera DWBuilder, everything was completed and verified. It deployed successfully. I have created some data pipelines that fetches data from all the sources and feed into my data warehouse. These pipelines are scheduled to run on different frequencies.
I have noticed some pipelines which are inserting data into fact tables are failing, and the problem seems to be delayed loading of dimension tables due to the size of the data or queued jobs which results in null values being inserted into fact table as foreign keys.
How can I make sure that whenever the fact loader runs, it verifies the data in dimension loader first?