Share this Job

Big Data Engineer

Date:  Jan 2, 2021
Country:  Singapore
State / Province:  Singapore
City:  Singapore
Job Type:  Internal Temporary Worker
Job ID:  38620

Job Description

At Keysight, we help companies address their toughest challenges with precision and confidence. We offer the most precise electronic measurement tools in the industry, with advanced software to match. Our employees leverage their insight and passion to revolutionize electronic measurements and make a difference in the world.

Keysight Singapore Center of Excellence is launching a new software development center in Singapore, chartered to create a new generation of software for electronic product design and test for customers around the world. With strong collaborations & partnerships with local universities here in Singapore, the center will attract top local graduates from computer science, artificial intelligence, systems programming and electrical/electronic/computer engineering schools.

You can join our mission to make a real difference through rapid solution development, turning measurement science IP into killer apps, on a hardware/OS agnostic, modern C++ foundation, delivered into an always-on, everywhere available, app store ecosystem.

Being part of the software development team, you will work in an AGILE team to turn innovative ideas into robust software, and solve complex design and implementation problems. You will also investigate new technologies and applications, and apply modern software engineering practices such as design reviews, code review, unit testing and usability testing.


  • Be part of the taskforce to support and contribute to Keysight’s Industry 4.0 vision
  • Data platform construction and administration (design, capacity planning, installation, monitoring, optimization, etc.)
  • Responsible for implementation and ongoing administration of Hadoop infrastructure.
  • Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users.
  • Setting up and managing the new and existing Spark, HBase cluster.
  • Performance tuning and debugging the memory and  server related exceptions related to Hadoop, Spark , HBase etc. 
  • Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Cloudera Manager Enterprise, Dell Open Manage and other tools.
  • Performance tuning of Hadoop clusters and setting up the monitoring and notification frameworks.
  • Working with Cloudera support for performance tuning and version upgradation.
  • Working with team to build and manage CI/CD pipelines, containerization and deployments.
  • Database design and structure, real-time data integration and database tools to deliver top-notch data management
  • Develop, administer, maintain, and implement data governance policies and procedures for ensuring the security, quality, integrity and availability of the company's data
  • Provide strong domain-based experience with toolsets to help get the most from current and next-generation data technologies
  • Manage the migration to new data technologies for structured, unstructured, streaming and high volume data
  • Solution design using proven patterns, awareness of anti-patterns, performance benchmarking
  • Collaborate with stakeholders and engineers to ensure that solutions meet business needs

Job Qualifications

  • Degree in Computer Science, Software Engineering, Electrical Engineering, Applied Mathematics or related field of study.
  • Good troubleshooting skills, understanding of system’s capacity, bottlenecks, basics of memory, CPU, OS, storage, and networks.
  • Good knowledge of Linux and Networking.
  • Familiarity with open source configuration management and deployment tools such as Puppet or Chef, Docker, Kubernetes and Linux scripting.
  • Master of Unix commands
  • Proficiency in SQL queries and relational databases
  • Experience in MPP (massively parallel processing)
  • Experience with Azure, AWS or other Cloud-based PaaS/SaaS environments is an added plus
  • Significant experience working with big data processing tools and technologies such as Hadoop, Yarn, Hive, Impala, Sqoop, Spark, Spark Streaming,  HBASE, Flume, Kudu, Kafka, NiFi, etc.
  • Excellent oral and written communication skills
  • Excellent collaborative skills

Job Function

R&D software







Day Job




Full Time (F)


Travel Required:


< 25%



Duration (Temp Positions Only):

13 - 24 months 


Careers Privacy Statement 

***Keysight is an Equal Opportunity Employer.***

Candidates can be considered to work from the following locations:

APAC : Singapore : Singapore : Singapore

Job ID : 38620 

Job Segment: Database, Engineer, Construction, Electrical, Computer Science, Technology, Engineering