-Lead and mentor a team of data engineers in building and maintaining scalable ETL pipelines, ensuring data integrity and security. -Drive infrastructure planning and design for data platforms to ensure performance, scalability, and reliability. -Collaborate with business and engineering teams to define data requirements, design data models, and drive the development of data products. -Lead efforts in optimizing data systems for performance, scalability, and cost-efficiency across multiple environments, including cloud (GCP) and on-premises data centers. -Oversee the entire lifecycle of data projects, from conception to deployment, ensuring timely and high-quality delivery. -Take ownership of the continuous improvement of our data infrastructure and engineering practices to meet the needs of a rapidly growing business. -Provide technical guidance on the adoption of new technologies and data platforms to drive innovation in the team.
待遇面議
(經常性薪資達 4 萬元或以上)
不拘
-You have 5+ years of relevant experience in data engineering, including at least 2 years of team leadership or mentorship experience. -Proven track record of designing, building, and maintaining complex ETL pipelines with a focus on scalability, reliability, and security. -Strong proficiency in backend development with expertise in shell scripting, SQL, and at least one programming language (e.g., Python, Scala). -Expertise in distributed computing engines and platforms (e.g., ClickHouse, PySpark, Kafka, BigQuery, Airflow). -Demonstrated experience in planning and implementing infrastructure for large-scale data processing and storage solutions. -Familiarity with data exploration and visualization tools (e.g., Superset, Tableau) and experience in implementing data lake and data warehouse architectures. -Practical experience with cloud-based data processing solutions (e.g., AWS Data Pipelines, GCP Dataflow). -Practical experience with CDC (Capture Data Change) tools and methodologies, or any other streaming solutions. -Experience in managing stakeholders at different levels, with excellent interpersonal and communication skills. -Previous experience in setting up or utilizing Data Catalogs is a plus. -Passion for team development, fostering a collaborative and high-performance culture. Tech skills: Shell、Python、Scala、Data Modeling、ETL、MS SQL、MySQL、Tableau