Principal Data Engineer

RESPONSIBILITIES:

• Develop and operate cross-company data infrastructure.
• Manage data integration and data pipelines.
• Aggregate data from various internal products, services, and CRM tools into a data lake.
• Appropriately distribute the data collected in the data lake to analysis and ML platforms.
• Build and maintain data analysis infrastructure.
• Optimize DWH performance.
• Ensure data quality.

REQUIREMENTS: 

Educational background: 

• Graduated from a top level university/college in Vietnam
• Majored in mathematics, Computer Science or related to it

Technical skill

• Data engineering
  a. Development experience with SQL(Must to have Redshift and Postgres experiences)
  b. Development and operational experience using AWS and Google Cloud or similar tools:
      - Configuration management: Terraform
      - CI/CD: GitHub Actions, Argo CD, Circle CI
      - Monitoring and logging: Datadog, Cloud Monitoring, CloudWatch
      - Project management: JIRA Cloud, Miro
      - Documentation: Kibela, Google Workspace
      - Orchestration: Airflow (1 year-As a user not administrator), Trocco, DBT, kubernetes.
      - Spark: 2-3 years of experience(This is essential)
• Cloud architecture
  a. Experienced developing a system by using some cloud services on AWS, GCP or Azure(AWS is preferable)
  b. Understood cloud service components from architectural perspective(To know what can do, how it works and what should be paid attention)
  c. Designed and integrated a system with appropriate security

• Backend API Development

  a. Experience in Golang backend API development

  b. Experience with GraphQL-based APIs

  c. Deep knowledge of relational databases, SQL, and data modeling

  d. Expertise in software architecture and systems testing, with a focus on scalability and performance with Docker and containerized environments using Kubernetes (preferred)

  e. Experience with Row Level Security databases (preferred)

  f. Experience with Test Driven Development (preferred)

Human skill: Worked as a Data engineer lead of a team

Communication skill: 

• Openminded
• Has a capability to understand what is asked and why it is asked