パレクセルでの仕事
パレクセルは、臨床開発の上流から下流までのそれぞれの専門領域で、国内外の多くのお客様に高度なソリューションを提供するプロフェッショナル集団です。 パレクセルは、新しい薬や治療法を、それらを必要としている人々にいち早く届けることを目指し、日々の業務に取り組んでいます。
Senior Data Engineer
応募 求人ID R0000035260 ロケーション 台北, Taiwan 仕事内容- Architect, implement, and optimize ETL/ELT workflows using tools such as Databricks and Informatica to ingest and process large datasets.
- Deploy and manage data infrastructure on Azure and AWS, including containerized services and serverless components.
- Partner with data scientists, software engineers, and business stakeholders to translate requirements into scalable data solutions.
- Monitor and tune pipeline performance, implement robust monitoring/alerting (e.g., Prometheus, DataDog), and troubleshoot production issues.
- Define and enforce data validation rules, lineage tracking, and governance standards to ensure accurate and compliant data usage.
- Build CI/CD pipelines for data code, automate deployments, and support model operationalization workflows.
- Share knowledge of data engineering best practices, conduct code reviews, and mentor junior engineers.
Qualification:
- Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field.
- 8+ years of hands-on experience designing and building data pipelines and infrastructure.
- Strong proficiency in data engineering tools and technologies, such as Apache Spark, Hadoop, Kafka, and cloud-based platforms (AWS, Azure, or GCP).
- Hands-on experience with data modeling, ETL processes, and distributed data processing frameworks.