(Senior) Data Engineer - Capital Markets

The core of the role is building and maintaining core data pipelines for ingesting, processing and summarisation of data. Using automation as a default, and delivering high-quality code to define pipelines and transformations.

As a data engineer, you will have the opportunity to assist with the data platform blueprint and design, evaluating workflows and tools for the platform, supported by senior engineers and engineering leaders.

Client Details

Are you looking for a role that builds on your experience with engineering data systems? Are you keen to learn, grow, and develop? Do you want to work in a nurturing culture where you can flourish and be your best?

Would you like to work on services that are used by key products and millions of users each day? If so, this opportunity could be for you.

Maintaining security on the platform is very important to ensure that we protect the data and ensure it is used in line with our data governance policies. This role gives you the opportunity to suggest solutions and infrastructure to be created with appropriate levels of security and encryption. Experience in data privacy engineering and techniques and anonymisation, data masking and obfuscation and others is highly desirable.

The data platform is a brand-new capability built using modern tools and components. We want to keep developing the platform and ensure we are keeping the platform up-to-date, so awareness of emerging database technologies and their potential impact on our data platform as well as staying up-to-date with developments in the open source community around DevOps, data engineering, data science, and similar tooling are key responsibilities.

Description

You will be a key member of our data platform engineering team, developing high-performing, scalable, high-impact data products and services.

• Building and maintaining core data pipelines for ingesting, processing and summarisation of data
• Using automation as a default, and delivering high-quality code to define pipelines and transformations
• Assist with the data platform blueprint and design, evaluating workflows and tools for the platform, supported by senior engineers and engineering leaders
• Develop and maintain standard operating procedures for data operation
• Collaborate with IT teams to ensure the data infrastructure is reliable and secure
• Support on data governance implementation and initiatives including data catalog, data use case registration and data lineage
  
  

Profile

• Knowledge of Big Data pipelines and processing technologies and experience in data processing and building data pipelines.
• Knowledge of database design, performance optimisation, and troubleshooting.
• Enthusiasm for writing clean, well-documented, and testable code and experience with software testing practices including unit testing frameworks where relevant.
• A security-first mindset - a good understanding of security and compliance principles as they relate to data infrastructures and the management of data.
• Strong problem-solving skills and experience with troubleshooting and root cause analysis.
• A willingness to deliver user value early while balancing technical quality - having an iterative deliverable mindset.

Technologies

• Experience with SQL, DBT and familiarity with Data Warehousing technologies (ideally Snowflake).
• Experience using general-purpose programming languages (typically we use Python and NodeJS for application services, but you should feel empowered to flex to what suits the job most effectively).
• Experience of building components on the cloud (preferably AWS).
• Experience of containerisation techniques using tools like Docker/Kubernetes.
• We are infrastructure as code first in our approaches - so experience with infrastructure/configuration as code tools and techniques (such as Terraform and CloudFormation).
• Familiarity with CI/CD pipelines for code validation and deployment.
• Experience of data pipeline orchestration e.g. Airflow or Jenkins.

Job Offer

We offer competitive remuneration package and comprehensive fringe benefits including medical and life insurance, excellent learning & development opportunities and flexibility to the right candidate

To apply online please click the 'Apply' button below. For a confidential discussion about this role please contact Royce Chan on +852 3602 2491.

More job from the company