Design, develop, and maintain robust, scalable, and sustainable data and AI products and build and optimize data pipeline and infrastructure.
Collaborate with stakeholders to understand their data requirements and translate them into technical solutions.
Identify and implement data quality monitoring and validation processes to ensure data integrity.
Implement data quality frameworks and ensure data governance best practices, including data lineage, data documentation, and data security.
Build out the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Synapse, ADF, Spark, Kafka, or similar technologies.
Work closely with Data Analysts and Data Scientists to support their data and AI needs and enable advanced analytics and machine learning initiatives.
Contribute to the development of the organization's data strategy, including evaluating new technologies, tools, and frameworks to enhance the data engineering ecosystem.
