Job Description: The role entails architecting the data platform layer, data cleansing layer, reporting and analytical layers within a cloud environment. Work closely with Data Scientists to understand model features and link back to transactional environment to understand data quality, data relationships and data availability. Document and define frameworks with the Data Engineer to build the data platform. Together these teams will enable data driven actionable insights. The role may include international exposure with Discovery partnerships. Job Responsibilities: Work closely with Data Engineer to facilitate Data Governance including access and security control Define data quality rules with Data Scientists to clean data Assist with the definition of custom meta data models for ELT/ETL Provide Data Architecture (DA) support for the Data Engineering team Define data mapping and transformation rules between source and datawarehouse and data lake The successful applicant will be working within a highly specialized and growing team to enable delivery of data and advanced analytics system capability. Profile new data sources in a variety of formats including Json, XML, etc Define DA for the Data Science teams and participate in review and walk-through sessions for model fit and model producionization Direct data automation capabilities with the Data Engineer and Data Scientist Expert documentation of DA for new data sources, metadata and productionized information flow Job Requirements: DevOps/DataOps and CI/CD experience Expert database knowledge in SQL and experience with MS Azure Exceptional data modelling skills ie physical, dimensional and relational 3N forms Modern Azure datawarehouse design skills Experience working on large and complex datasets 5 to 15 years of experience is preferred Honours degree in BSc Computer Science or Btech Strong communicator verbally and in writing Programming in R, Python AWS experience Job Details: Company: Discovery Limited Vacancy Type: Full Time Job Location: Sandton, Gauteng, SA Application Deadline: N/A Apply Here Vacancieshut.com
Vacancieshut