We are seeking a highly skilled and experienced Data DevOps Consultant specializing in Data Warehousing, Cloud-based Feature Engineering, Machine Learning Operations and Model Life-Cycle Management. The successful candidate will be responsible for providing comprehensive support and expertise in data architecture, cloud-based feature engineering, and machine learning operations management to optimize our data infrastructure and enhance our analytical capabilities.
Key Responsibilities:
Conduct a thorough audit of our current data warehousing infrastructure and cloud-based solutions.
Design and implement efficient data warehousing strategies tailored to our specific business needs.
Develop and maintain cloud-based feature engineering pipelines for data preprocessing and transformation.
Support in design of Machine Learning operations framework to manage the end to end model lifecycle.
Collaborate with cross-functional teams to ensure seamless integration of data engineering solutions into our existing systems.
Provide training sessions and workshops to educate team members on best practices in data warehousing and cloud-based feature engineering.
Offer advisory services to senior management on strategic decisions related to data infrastructure and analytics.
Act as a consultant to address any data engineering challenges and provide innovative solutions.
Qualifications:
Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
At least 7 years of proven experience in data warehousing, cloud-based feature engineering, and machine learning operations management.
Strong proficiency in Google Cloud Platform.
Expertise in designing and implementing features stores with Vertex AI, and familiarity with open source tools such as MLFlow.
Excellent communication and interpersonal skills with the ability to collaborate effectively with diverse teams.
Prior experience in providing consultancy and advisory services in data engineering and analytics.
Ability to analyze complex data requirements and develop scalable solutions to address business needs.
Expected Tasks for Consultant - Data Warehousing, Cloud-based Feature Engineering, and Management:
Perform a comprehensive audit of the current data warehousing infrastructure and cloud-based solutions used for credit scoring, fraud detection and loan management.
Design and implement efficient data warehousing strategies tailored to the organization's business needs and objectives. This includes a real-time data streaming service for credit scoring model interaction and a feature store.
Build CI/CD ML operations pipelines to ensure smooth and reliable deployment of models.
Develop and maintain cloud-based feature engineering pipelines for data preprocessing and transformation.
Collaborate with cross-functional teams to ensure seamless integration of data engineering solutions into existing technology systems.
Conduct training sessions and workshops to educate team members on best practices in data warehousing and cloud-based feature engineering.
Offer advisory services to senior management on strategic decisions related to data infrastructure and analytics.
Address any data engineering challenges and provide innovative solutions to optimize data processes and workflows.