Principal Accountabilities
Solution Design & Business Partnership
• Translate business requirements into data architecture and technical solutions.
• Estimate workload sizing, costs, effort, impacts, and delivery plans.
• Collaborate with business users, product owners, BAs, and project managers.
Build & Delivery
• Develop and maintain batch and streaming pipelines using SQL, Python, and GCP services.
• Build data transformations using Dataform and BigQuery, including external system integrations via FTP/SFTP.
• Implement data models, quality checks, validation, and reconciliation.
Governance & Operations
• Ensure data security, access control, classification, and compliant data sharing.
• Implement monitoring, logging, lineage, alerting, and incident resolution.
• Optimize pipeline performance and cloud costs, leveraging AI tools where appropriate.
Technical Leadership
• Establish engineering standards, design reviews, coding practices, CI/CD, and documentation.
• Mentor engineers, lead root cause analysis, and support cross-functional data initiatives.
• Ensure production code and pipelines are reviewed, tested, secure, and maintainable, including AI-assisted code.
Qualifications Required
Education
• Bachelor’s degree or higher in Computer Science, IT, Engineering, Statistics, or a related quantitative field.
Required Experience & Skills
• 5+ years of hands-on data engineering experience delivering enterprise-scale data platforms and pipelines.
• Strong hands-on GCP experience: BigQuery, Dataform, Cloud Storage, Composer/Airflow, Dataflow or Dataproc, Pub/Sub, Cloud Functions, Cloud SQL, and IAM.
• Advanced SQL, data modeling, query optimization, and strong Python scripting for data processing, integration, and automation.
• Experience with ETL/ELT, workflow orchestration, data quality, validation, and reconciliation.
• Experience in data architecture, business requirement analysis, workload sizing, cost estimation, and delivery planning.
• Strong knowledge of data security, governance, access control, and controlled data sharing.
• Experience operating production pipelines, including monitoring, alerting, troubleshooting, and cost optimization.
• Strong communication and collaboration skills with business and technical stakeholders.
Advantageous
• AWS/Azure, Spark/Kafka, Dataplex, Terraform, CI/CD, and AI/GenAI engineering tools.
• Retail or multi-business-unit experience.
• Relevant cloud certifications, such as Google Professional Data Engineer.
Characteristics / Skills
• Business-oriented with strong analytical and problem-solving skills.
• Clear communication in Thai and English.
• Collaborative, adaptable, and resilient under pressure.
• Strong ownership, leadership, attention to detail, and mentoring skills.
