Job Description
As a Data Engineer, your goal is to provide an efficient, stable platform that reliably and predictably delivers accurate, high-quality data to other teams within the company including Data Wrangling, Data Science, and Business. You will collaborate with the Data Science team to build and extend procedures, tools, pipelines, and systems necessary for producing insights and analyses.
Core Responsibilities
- Build the infrastructure required for optimal Extraction, Transformation, and Loading of (non)structured data from a wide variety of data sources;
- Data Acquisition and Extraction from various sources using provided API or other solutions like web scrapping;
- Building data pipeline systems in event-driven or streaming architectures using systems such as Kafka or other equivalents;
- Building AI Model pipelines;
- Deployment and management of systems used for data processing and analytics;
- Building analytics tools that utilize the data pipelines and model artifacts to provide actionable insights.
