The data engineer is responsible for developing and testing architectures that enable data extraction and transformation for predictive or prescriptive modeling. The data engineer is also responsible for implementing different methods to improve data reliability and quality.
Responsibilities:
● Analyze and organize raw data.
● Build data systems and pipelines.
● Prepare data for prescriptive and predictive modeling.
● Combine raw information from different sources.
● Explore ways to enhance data quality and reliability.
● Collaborate with data scientists, data analysts, and architects on several projects.
Requirements
● Master's degree in Software Engineering, IT, or similar fields.
● Previous experience as a data engineer or in similar roles.
● Knowledge of scalable data infrastructure and understand distributed systems concepts.
● Strong knowledge of programming languages (Java, Scala and Python) to handle large volume data processing.
● Strong knowledge of SQL, database design, understanding ETL, data modeling and data warehousing.
