Data Engineer at Revent Technologies Limited
Revent Technologies Limited is a technology solutions provider for dynamic organizations, providing bespoke software design and development, developer outsourcing and technology advisory, etc.
We are recruiting to fill the following positions below:
Job Title: Data Engineer
Location: Lagos
Employment Type: Full Time
Job Description
- As a Data Engineer, you will be accountable for designing, developing and deploying ETL jobs to process petabytes of data through our big data platform, to enable analytics initiatives and data science.
- You will be passionate about big data, working daily on data extraction, load and transformation in big data environments to ensure the successful, on-time, delivery of high-quality data.
Responsibilities
- Design and develop ETL jobs in big data environments to process petabytes of data.
- Build reusable frameworks or jobs which can be used in different projects.
- Manage Data Services and Data Quality transformations using SQL: Analyzing redundant and inconsistent data.
- Own continuous improvement and performance testing: Document ETL-related issues and perform RCA, identify long-running jobs and optimization opportunities.
- Developing code to automate jobs using real-time services, and flexible coding to remove dependencies.
Qualifications
- BA/BS in Computer Science, Computer Engineering. Engineering, Statistics/Mathematics or similar
- 3 - 4 years experience
- Development experience in EITHER: Talend Big Data Edition on Hadoop or BODS
- Hands-on experience in ETL design, source-target mapping, developing and performance tuning complex ETL code
- Experience with multiple file formats and file location objects including SFTP, FTP, local, HDFS, ADLS, BLOB, Amazon S3
- Good understanding of HDInsight cluster, Microsoft SQL Servers as well as RDBMS databases & No-SQL databases
- Knowledge of Slowly Changing Dimensions, ABAP Data flow Extractions, Star Schema, Snowflake Schema, OLTP and OLAP
- Hands on experience of cloud platforms, especially Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP)
- Experience with Infrastructure automation, build automation and deployment automation
- Experience in working with GIT, SVN or VSTS
- Experience in connecting to heterogeneous sources including SAP ECC, Hadoop, Hive, Amazon, Azure, Salesforce, SAP among others
- Proficient in English, other languages beneficial
Competencies
- A true self-starter, who dreams big, and is motivated by a challenging and fast-paced environment
- Ability to manage conflicting priorities under pressure
- Strong relationship management, communication and collaboration skills: effectively working with technical audiences.
How to Apply
Interested and qualified candidates should send their CV to: [email protected] using the job title as the subject of the mail.