Senior Data Engineer

Keysight Technologies

  • Pulau Pinang
  • Permanent
  • Full-time
  • 1 month ago
is on the forefront of technology innovation, delivering breakthroughs and trusted insights to the world's visionaries and innovators in electronic design, simulation, prototyping, test, manufacturing, and optimization. Our 15,000 employees create world-class solutions in communications, 5G, automotive, energy, quantum, aerospace, defense, and semiconductor markets for customers in over 100 countries. Our technical solutions - and our methods for creating them - help connect and secure the world. Learn more Our powerful culture has led to us being independently recognized on We're driven, collaborative, ethical, and curious, and we value all ideas, especially bold ones. And our culture extends far beyond our own walls. Our corporate social responsibility efforts support our communities, nurture the next generation of engineers, and promote environmental sustainability. At Keysight, Inclusion, Equity & Diversity is an integral part of our core values. We believe that when people feel a sense of belonging, they can be more creative, innovative, and thrive at all points in their careers. We believe everyone should be respected in the workplace and in their communities regardless of race, color, age, gender, sexual orientation, gender identity and expression, ethnicity, religion, disability, veteran status, national origin, or any protected class. We continuously challenge ourselves to grow in our understanding of inclusion by engaging in a wide variety of diversity programs, initiatives, employee network groups and mentoring/development. Job Description The job is to design, define, maintain, and support the architecture of existing product. As a data engineer the person would be required to work with Big Data tools and frameworks, ETL processes, web services, collaborate with development teams, build platforms, and maintain the production system. You will work in an AGILE team to solve complex dev-ops challenges. design and implementation problems also to investigate new technologies and applications and apply modern software engineering practices such as unit testing and usability testing. About the Team: We are part of the Product Development team that is responsible for the growth of the Keysight businesses. The team consists of Manager, Architect, Data Engg, Data Scientist, UI/UX. We ensure the feature rich and highly performant product with well-designed architecture. Responsibilities: The candidate is responsible for developing sustainable and well-defined components that can enhance or introduce new innovative features to existing product. As the data engineer, you will do the following: . Work in a team with other big data engineers and team leads on the feature design and development activities to achieve the sprint goals. . Do the peer code review. . Work in an AGILE team to turn innovative ideas into robust software and solve complex design and implementation problems. . Work with the team leads to understand the problem statement and implement the solution. Job Qualifications Basic Qualifications: . Bachelor's degree in Computer Science, Computer Engineering, or a software-related discipline, from an accredited college or university . 5 to 7 years' experience in Data Engineer related roles. . Must have hands-on experience in Big Data (Hadoop, HBase, Hive, Scala) . Must have hands-on experience in Spark development, Sqoop, Flume, Kafka and NIFI. . Must have hands-on experience in relational and non-relational databases. . Must have hands-on experience in built tool like Maven or SBT. . Must have hands-on experience in version control tools like Gitlab or bit-bucket. . Must have hands-on experience in CI/CD tools such as Jenkins and JIRA. . Proven success working in a team-oriented environment and demonstrated problem-solving skills. . Must have an ability to identify, formulate, and solve engineering problems. Desired Qualifications: . Experience in design, implementation, and deployment of high volume, highly available, cloud-based systems would be a plus. . Experience with real-time analytics will be an add-on. . Experience with microservices and REST API will be an add-on. . Experience with container platforms like OpenShift, Kubernetes or docker would be an add-on. . Experience with configuration management tools like Ansible, Chef or Puppet would be an add-on. . Experience on KX and KDB would be an add-on. . Experience in bringing up Hadoop clusters and installing various packages would be an add-on. . Experience with Agile software development methodologies and Test-Driven Design . A proactive and eager nature for tackling new challenges Job Function R&D

foundit

Similar Jobs

  • Senior Azure, BI data engineer

    Renesas Electronics

    • Pulau Pinang
    Job Description Identify and analyze system integration problems, formulate, and implement corrective and preventive plans. Design and implement systems architecture with the m…
    • 1 month ago
  • Principal Engineer, Quality System Analyst (Data Engineering)

    Western Digital

    • Batu Kawan, Pulau Pinang
    Company Description The future. It’s on you. You & Western Digital. We’ve been storing the world’s data for more than 50 years. Once, it was the most important thing we could d…
    • 2 days ago
    • Apply easily