Data Engineer (ESG)

You will be responsible for designing, building, and maintaining reliable data pipelines and curated datasets to support analytics and data science use cases.

The role ensures data quality, accessibility, reliability, and maintainability across multiple data sources and platforms.

The role works closely with analysts, data scientists, product managers and product owners to enable effective use of data for business and operational needs.

What you will be working on

• Collaboration with cross functional teams to translate data requirements into technical solutions and support data usage needs.

• Collaborate with government agency’s IT teams on technology stack, infrastructure and security alignment.

• Architect and build ingestion pipelines to collect, clean, merge, and harmonise data from different source systems.

• Day-to-day monitoring of databases and ETL systems, e.g., database capacity planning and maintenance, monitoring, and performance tuning; diagnose issues and deploy measures to prevent recurrence; ensure maximum database uptime.

• Construction, testing, and maintenance of reusable data models and data structures to support downstream analytics and data science workloads.

• Design and build secure mechanisms for end users and systems to access data in data warehouse.

• Research, propose and develop new technologies and processes to improve agency data infrastructure.

• Collaborate with data stewards to establish and enforce data governance policies, best practices and procedures.

• Maintain data catalogue to document data pipelines, datasets, metadata, and dependencies.

• Execution of data quality checks, validation processes, and basic reconciliation to ensure data accuracy and consistency.

• Implement and enforce data security best practices, including access control, encryption, and data masking, to safeguard sensitive data.

• Monitoring and troubleshooting of data pipeline performance, reliability, and operational issues.

• Strong attention to data accuracy, reliability, maintainability, and operational robustness.

What we are looking for

• Deep understanding of system design, data structure and algorithms, data modelling, data access, and data storage.

• Demonstrated ability in using cloud technologies such as AWS, Azure, and Google Cloud.

• Experience in architecting data and IT systems.

• Experience with distributed data technologies such as Spark, Hadoop.

• Proficiency in programming languages such as Python, Java, or Scala.

• Proficiency in writing SQL for databases.

• Familiarity with building and using CI/CD pipelines.

• Familiarity with DevOps tools such as Docker, Git, Terraform.

• Sound understanding of ETL and ELT concepts, data modeling principles, and data warehousing practices.

• Ability to collaborate effectively with analysts, data scientists, product managers and product owners.

Preferred requirements

• Bachelor’s Degree, preferably in Computer Science, Software Engineering, Data Engineering, Information Technology, or related disciplines.

• Experience in designing, building, and maintaining batch and real-time data pipelines.

• Experience with Databricks.

• Experience with implementing technical processes to enforce data security, data quality, and data governance.

• Familiarity with government systems and government's policies relating to data governance, data management, data infrastructure, and data security.

• Proficiency in SQL and experience with relational databases.

• Familiarity with cloud-based data platforms and services.

• Familiarity with ETL and ELT tools, orchestration frameworks, and data pipeline monitoring practices.

• Familiarity with version control systems and CI and CD practices.

What we offer you:

GovTech is an equal opportunity employer committed to fostering an inclusive workplace that values diverse voices and perspectives, as we believe that diversity is the foundation to innovation.

Our employee benefits are based on a total rewards approach, offering a holistic and market-competitive suite of perks. These include leave benefits to meet your work-life needs and employee wellness programs.

We champion flexible work arrangements (subject to your job role) and trust that you will manage your own time to deliver your best, wherever you are, and whatever works best for you.

Please note that this will be a 2-year fixed term contract.

Learn more about life inside GovTech at go.gov.sg/GovTechCareers.

Stay connected with us on social media at go.gov.sg/ConnectWithGovTech