Data engineering & data science have unique problems,
A big one is validating data ingested into the pipeline.
It so often happens that data being ingested is not as per expectation
There are generally 6 broad categories classifying the different problems you may have, called data quality dimensions.
To ensure he quality of your data models and analytics, its vital to validate quality of the data BEFORE any processing happens.
Reference video linked below
#RedefiningSoftwareQualiy #BigData #DataScience #DataAnalytics