Senior Data Engineer I
- Mutiara Damansara, Selangor
- Permanent
- Full-time
- Data Architecture Development:
- Design, develop, and maintain scalable data architectures, including databases, data warehouses, and data lakes.
- Evaluate and select appropriate technologies and tools for data storage, processing, and retrieval.
- Data Pipeline Implementation:
- Develop and optimize ETL processes to ingest, transform, and load data from various sources into our data infrastructure.
- Ensure data quality and integrity throughout the ETL process.
- Data Modeling:
- Design and implement data models to support analytics and reporting requirements.
- Collaborate with data scientists and analysts to understand their modeling needs and translate them into scalable data structures.
- Monitoring and Maintenance:
- Monitor data pipelines and infrastructure for performance, reliability, and security.
- Troubleshoot and resolve issues related to data processing, storage, and access.
- Documentation and Collaboration:
- Document data engineering processes, workflows, and best practices.
- Collaborate with cross-functional teams, including data scientists, analysts, software engineers, and business stakeholders, to understand requirements and deliver solutions.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer or similar role, with a strong background in data warehousing and ETL.
- Proficiency in programming languages such as Python, Java, or Scala.
- Hands-on experience with relational and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB).
- Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform.