Data Engineer

SOCAR

  • Kuala Lumpur
  • Permanent
  • Full-time
  • 27 days ago
Are you a talented and driven problem solver who would like to join our team in Kuala Lumpur? Someone with a startup mentality, who is capable of integrating into a multicultural team?SOCAR aims to change the way people in South East Asia move around by becoming the biggest car-sharing platform in South East Asia. We are currently the biggest player in Malaysia and aim to scale out our product offering across more verticals and geographies.Want to be part of this journey from the very beginning?We are growing fast - this is an extremely exciting moment for SOCAR.What will you be engaged in?As our new Data Engineer, you will be in charge of ……..● Overall management of data from architecture optimization, integration, processing and analytics● Collaborate with product and engineering teams to create innovative solutions and optimization of existing systems and applications.● Understand the analytics data we collect from our systems and how it relates to the business value being produce● Build large-scale batch and real-time data pipelines with data processing frameworks like Spark, Airflow and data warehouse platforms such as Databricks and BigQuery.● Identify areas of potential business value from data thru machine learning and automated data pipelines● Build out a testing framework to ensure uptime and reliability of data infrastructure.● Work in multi-functional agile teams to continuously experiment, iterate and deliver on new product objectives● Stay current with industry trends and best practices in data engineering and contribute to the adoption of new technologies and tools.Are you the ideal candidate?First and foremost, ask yourself: Are you customer-obsessed? This is the key SOCAR's prime value that drives our mission forward. If your heart and mind shout β€œYES, I am!”, you have just identified a fundamental match between you and your future SOCAR team.● Proven experience as a Data Engineer or similar role, with a strong background in data modeling, ETL development, and database management.● Know how to work with high volume heterogeneous data such as with distributed systems such as Spark, Databricks or other data warehousing platforms● Know how to write distributed, high-volume data processing systems.● Are knowledgeable about data pipelines, data access, and data storage techniques.● Strong analytical and problem-solving skills, with the ability to translate business requirements into technical solutions.● Love to be the bridge between engineering and analysis to have an impact on the product● Interested in optimizing workflows and maintaining backend systems● Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.● Understand that product value is a function of usefulness and not technical implementation details.Preferred technical skills:● Expertise in SQL and experience working with relational and non-relational databases, such as PostgreSQL, MySQL, MongoDB and DynamoDB● Experience with big data technologies such as Apache Beam, Spark, Databricks and RDBMS.● Experience in data integration, designing and developing ETL data pipelines. ● Experience in mapping or geospatial data pipelines a plus.● Experience and skill on creating and implementing machine learning models is a plusWhat will we offer you?● Be part of the fastest-growing car-sharing company in the world!● Opportunity to drive new ideas and make a measurable impact on company metrics● Work with incredibly driven people with great executable ideas● Competitive Salary● Medical Insurance● SOCAR travelling credits● Phone allowance● International environment (we are 10 different nationalities in the office!)● The chance to launch new markets in different countries● Endless company events (Futsal, cinema, birthday cakes, celebrations, team lunch, and dinner ...)

SOCAR

Similar Jobs

  • Data Engineer (Spark ,Scala, Elastic Search)

    Unison Consulting Pte Ltd

    • Kuala Lumpur
    Design, develop, and implement Spark Scala applications and data processing pipelines to process large volumes of structured and unstructured data Integrate Elasticsearch with Spa…
    • 2 months ago
    • Apply easily
  • Data Engineer (Spark Scala DevOps)

    Unison Consulting Pte Ltd

    • Kuala Lumpur
    Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives Collaborate with cross-functional teams to …
    • 2 months ago
    • Apply easily