Data Engineer at Revent Technologies Limited

Revent Technologies Limited is a technology solutions provider for dynamic organizations, providing bespoke software design and development, developer outsourcing and technology advisory, etc.

We are recruiting to fill the following positions below:

Job Title: Data Engineer

Location: Lagos
Employment Type: Full Time

Job Description

• As a Data Engineer, you will be accountable for designing, developing and deploying ETL jobs to process petabytes of data through our big data platform, to enable analytics initiatives and data science.
• You will be passionate about big data, working daily on data extraction, load and transformation in big data environments to ensure the successful, on-time, delivery of high-quality data.

Responsibilities

• Design and develop ETL jobs in big data environments to process petabytes of data.
• Build reusable frameworks or jobs which can be used in different projects.
• Developing code to automate jobs using real-time services, and flexible coding to remove dependencies.
• Manage Data Services and Data Quality transformations using SQL: Analyzing redundant and inconsistent data.
• Own continuous improvement and performance testing: Document ETL-related issues and perform RCA, identify long-running jobs and optimization opportunities.

Qualifications

• BA/BS in Computer Science, Computer Engineering. Engineering, Statistics/Mathematics or similar
• 3 - 4 years experience
• Development experience in EITHER: Talend Big Data Edition on Hadoop or BODS
• Hands-on experience in ETL design, source-target mapping, developing and performance tuning complex ETL code
• Experience with Infrastructure automation, build automation and deployment automation
• Experience in working with GIT, SVN or VSTS
• Experience in connecting to heterogeneous sources including SAP ECC, Hadoop, Hive, Amazon, Azure, Salesforce, SAP among others
• Experience with multiple file formats and file location objects including SFTP, FTP, local, HDFS, ADLS, BLOB, Amazon S3
• Good understanding of HDInsight cluster, Microsoft SQL Servers as well as RDBMS databases & No-SQL databases
• Knowledge of Slowly Changing Dimensions, ABAP Data flow Extractions, Star Schema, Snowflake Schema, OLTP and OLAP
• Hands on experience of cloud platforms, especially Microsoft Azure, Amazon Web Services (AWS), Google Cloud Platform (GCP)
• Proficient in English, other languages beneficial

Competencies

• A true self-starter, who dreams big, and is motivated by a challenging and fast-paced environment
• Ability to manage conflicting priorities under pressure
• Strong relationship management, communication and collaboration skills: effectively working with technical audiences.

Application Closing Date
Not specified.