Senior Data Engineer at an IT Company - Growth in Value Alliance (GV Alliance) Partners Limited

Growth in Value Alliance (GV Alliance) Partners Limited - Our client, an IT company is recruiting to fill the position below:

Job Title: Senior Data Engineer

Location: Lagos

Job Description

• Our client, an IT company requires the service of a qualified Senior Data Engineer who will oversee junior data engineering activities and aiding in building the organizations data collection systems and processing pipelines. The successful candidate will oversee infrastructure, tools and frameworks used to support the delivery of end-to-end solutions to business problems through high performing data infrastructure. Also responsible for expanding and optimising the organizations data and data pipeline architecture, whilst optimising data flow and collection to ultimately support data initiatives.

Responsibilities

• Owns and extends the business's data pipeline through the collection, storage, processing, and transformation of large data- sets and oversee the process for creating and maintaining optimal data pipeline architecture and creating databases optimized for performance, implementing schema changes, and maintaining data architecture standards across the required databases.
• Oversee the assembly of large, complex data sets that meet functional / non-functional business requirements and align data architecture with business requirements.
• Build analytics tools that utilise the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. Create data tools for analytics and data scientist team members that assist them in building and optimising into an innovative industry leader.
• Monitor the existing metrics, analyse data, and lead partnership with other Data and Analytics teams in an effort to identify and implement system and process improvements. Utilise data to discover tasks that can be automated and identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Developing ETL processes that convert data into formats through a team of data analysts and dashboard charts. Oversee large-scale data Hadoop platforms and to support the fast-growing data within the business.
• Responsible overseeing the process for enabling and running data migrations across different databases and different servers and defines and implements data stores based on system requirements and consumer requirements.
• Responsible for performing thorough testing and validation in order to Ensure proper data governance and quality across EDO and the business as a whole.
• Oversee, design, and develop algorithms for real-time data processing within the business and to create the frameworks that enable quick and efficient data acquisition. Deploy sophisticated analytics programs, machine learning and statistical methods.
• Manage the analysis if complex data elements and systems, data flow, dependencies, and relationships in order to contribute to conceptual physical and logical data models.
• Liaise with and collaborate with data analysts, data warehousing engineers, and data scientists in finding and applying best practices within the Data and Analytics department as well as defining the business’s data requirements, which will ensure that the collected data is of a high quality and optimal for use across the department and the business at large.
• Acts as a subject matter expert from a data perspective and provides input into all decisions relating to data engineering and the use thereof. Provide guidance in terms of setting governance standards.
• Overseeing activities of the junior data engineering teams, ensuring proper execution of their duties and alignment with the client’s vision and objectives. Provide oversights and expertise to the Data Engineering that is responsible for the design, deployment, and maintenance of the business’s data platforms. Required to draw performance reports and strategic proposals form his gathered knowledge and analyses results for senior EDO leadership.

Qualifications / Experience

• First degree in Computer Science, Information Technology, Information Science or any related field.
• 8 - 10 years experience as a Data Engineer.
• Experience with big data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, Etc.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
• Experience with stream-processing systems: Storm, Spark- Streaming, etc.
• Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
• Experience Description: Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency and workload management. A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Working knowledge of message queuing, stream processing and highly scalable ‘big data’ data stores.

Technical Competencies:

• IT Architecture
• Data Integrity
• IT Applications
• Data Analysis
• Knowledge Classification
• Database Administration

Application Closing Date
20th February, 2022.

Method of Application
Interested and qualified candidates should send their CV to: [email protected] or [email protected] using the Job Title as the subject of the mail.