Big Data Engineer job description

Job description of a Big Data Engineer

Big Data Engineers develop, test, and maintain Big Data solutions for a company. Their job is to gather large amounts of data from multiple sources and ensure that downstream users can access the data quickly and efficiently. Essentially, Big Data Engineers ensure the company’s data pipelines are scalable, secure, and able to serve multiple users.

This Big Data Engineer job description example includes the list of most important Big Data Engineer duties and responsibilities as shown below. It can be modified to fit the specific Big Data Engineer profile you're trying to fill as a recruiter or job seeker.

Big Data Engineer Duties and Responsibilities

Big Data Engineer job description should contain a variety of functions and roles including:

Responsible for Hadoop development
Implementation including loading from disparate data sets, preprocessing using Hive and Pig.
Scope and deliver various Big Data solutions
Ability to design solutions independently based on high-level architecture.
Manage the technical communication between the survey vendor and internal systems
Maintain the production systems (Kafka, Hadoop, Cassandra, Elasticsearch)
Collaborate with other development and research teams
Building a cloud based platform that allows easy development of new applications

Big Data Engineer Requirements / Skills / Qualifications

Big Data Engineer job description should include these common skills and qualifications:

University degree in Computer Science, Engineering or equivalent preferred)
x years of experience as a Big Data Engineer or similar role
x years experience programming and/or architecting a back end language (Java, J2EE, Core
Experience with Java oriented technologies (JBoss, Spring, SpringMVC, Hibernate, REST/SOAP)
Experience with non-relational & relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB, etc.)
Experience with Spark, or the Hadoop ecosystem and similar frameworks
Familiarity with various tools such as AWS, Mesos or Docker and an instinct for automation
Creative and innovative approach to problem-solving

As a hiring manager, recruiting an ideal Big Data Engineer starts with crafting a good job description. Use this Big Data Engineer job description template to save yourself time and help you attract the most qualified candidates. Feel free to revise it to meet your specific needs.

Job seekers interviewing for the role of a Big Data Engineer may also reference it in preparation for the interview.

Big Data Engineer Job Description

Job description of a Big Data Engineer

Big Data Engineer Duties and Responsibilities

Big Data Engineer Requirements / Skills / Qualifications

Related

Similar job descriptions