Duties and Responsibilities:

•  Design and deploy an end-to-end data pipeline system that centralizes and processes large volumes of structured and unstructured data from various sources.
•  Develop user-friendly interfaces that enable users to easily pull up relevant information for a product and customer.
•  Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and design data solutions that meet their needs.
•  Design and implement efficient data extraction, transformation, and loading (ETL) processes to populate the pipeline with data from various sources.
•  Build and maintain robust data pipelines that ensure data is accurate, up-to-date, and easily accessible.
•  Develop and maintain data models, data schemas, and data dictionaries.
•  Use APIs, batch exports, and SQL queries to extract data from various sources and integrate it into a SQL database.
•  Perform data cleaning, data transformation, and data integration tasks to ensure data quality and consistency.
•  Collaborate with data analysts, data scientists, and other stakeholders to ensure data is processed and analyzed effectively.
•  Monitor and optimize data pipelines to ensure they are performing efficiently.

Success for the role will be measured by delivering within the first few months of the following,

•  Successful deployment of the end-to-end data pipeline system, including system implementation, ETL processes, and data handling capabilities within the first few months.
•  Data accessibility and usability, are measured by ease of use of user-friendly interfaces and speed of accessing relevant information.
•  Data quality and consistency, are monitored through data accuracy, completeness, consistency, and integrity.
•  Collaboration and stakeholder satisfaction, are measured by feedback from stakeholders on the effectiveness of data solutions and maintaining positive working relationships.

Skills and Experience:

•  Bachelor’s degree in computer science, Information Systems, or related field.
•  At least 5 years of experience in designing and deploying end-to-end data pipelines.
•  Strong knowledge of SQL, ETL tools, and data warehousing concepts.
•  Experience working with APIs, batch exports, and SQL queries to extract data from various sources.
•  Experience with cloud computing platforms such as AWS, Azure, or Google Cloud Platform.
•  Strong data analysis and problem-solving skills.
•  Experience working with Microsoft Dynamics, open-source data systems like KOBO, and Call Center platforms would be an added advantage.
•  Excellent communication skills and ability to work in a team environment.