Data Engineer (Cloud & Analytics Platform)
Apply now
Job no: 493782
Work type: Permanent
Categories: Infocomm Technology
The incumbent will design, build, and maintain scalable data solutions that support analytics, machine learning, and business insights. Responsibilities include developing robust data pipelines, cloud-based data platforms, analytics solutions, and supporting AI/ML initiatives while ensuring data quality, governance, and operational excellence.
Responsibilities
- Design, develop, and maintain ETL/ELT pipelines across cloud and on-premise environments, integrating internal and external data sources, including compliant ingestion of public data where required.
- Build, optimize, and maintain scalable data models (e.g., star and snowflake schemas) to support analytics, reporting, and business intelligence requirements.
- Ensure data quality, integrity, and availability through validation, cleansing, transformation processes, and implementation of monitoring controls.
- Implement and manage cloud-based data solutions on Microsoft Azure, including Azure Data Factory, Data Lake Storage, Azure SQL, and related services.
- Support infrastructure configuration and administration, including compute, storage, networking, identity management, and security controls to ensure reliable and scalable platform operations.
- Implement CI/CD pipelines, automate deployments, and establish monitoring, logging, and alerting capabilities to maintain performance, reliability, and SLA adherence.
- Support the development and optimization of interactive dashboards and reports using Power BI, ensuring seamless integration between data pipelines and reporting layers.
- Collaborate with business stakeholders to understand requirements and translate them into effective data solutions and visualizations.
- Collaborate with Data Scientists to deploy, support, and monitor machine learning models in production environments and integrate AI/ML capabilities into data pipelines and applications.
- Ensure adherence to data governance, security, compliance, access control, and data lineage requirements while following software engineering best practices such as version control, code reviews, and modular design.
- Contribute to continuous improvement of data platform standards, operational performance, scalability, and cost optimization initiatives.
Requirements
- Possess a bachelor’s degree in Computer Science, Computer Engineering, or a related field.
- 2–3 years of experience in data engineering, software engineering, or related roles with exposure to data platforms, cloud technologies, and analytics solutions.
- Strong analytical thinking, problem-solving, and troubleshooting abilities.
- Good communication and collaboration skills with the ability to work effectively across technical and business teams.
- Self-motivated, detail-oriented, and able to manage multiple priorities in a dynamic environment.
- Possess initiative and willingness to learn new technologies, tools, and methodologies.
Technical Skills Required
- Experience with data warehousing concepts, data modeling, database optimization techniques, and ETL/ELT development using Python or ETL tools (e.g., SSIS, Informatica).
- Proficiency in relational database technologies such as Microsoft SQL Server and Oracle, and familiarity with big data technologies such as Spark and Databricks.
- Proficiency in Python for data processing, data engineering tasks, and basic API development.
- Hands-on experience with Microsoft Azure services, including Azure Data Factory, Data Lake Storage, and Azure SQL.
- Familiarity with CI/CD pipelines, DevOps practices, and automation tools such as Azure DevOps.
- Familiarity with streaming or real-time data processing concepts and exposure to monitoring, performance tuning, and optimization of data systems.
- Experience with Power BI, including DAX and Power Query, for dashboard development and reporting.
- Basic understanding of machine learning workflows and tools, including Scikit-learn and Azure Machine Learning.
Only shortlisted candidates will be notified.
Advertised:
Applications close:
Back to search results Apply now Refer a friend