شرکت پیشرو فعال در مترو، راه آهن

منتشر شده 4 سال پیش

سمت شغلی

شرکت

حقوق

آمار رزومه‌های ارسال شده

Job Description

•Main Objective: We are looking for a savvy Data Engineer to join our growing team. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow, and they are adept at using large data sets to find opportunities for product and process optimization and using models to test the effectiveness of different courses of action •Main Responsibilities: -Create and maintain optimal data pipeline architecture -Assemble large, complex data sets that meet functional / non-functional business requirements -Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources -Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs -Mine and analyze data from company databases to drive optimization and improvement of product development, marketing techniques, and business strategies -Develop custom data models and algorithms to apply to data sets -Use predictive modeling to increase and optimize customer experiences, revenue generation, ad targeting and other business outcomes

Requirements

-Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases -Experience building and optimizing ‘big data’ data pipelines, architectures and data sets -Strong analytic skills related to working with unstructured datasets -Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores. -Experience with big data tools: Hadoop, Spark, Kafka -Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala -Knowledge of advanced statistical techniques and concepts (regression, properties of distributions, statistical tests, and proper usage, etc.) and experience with applications -Strong experience using a variety of data mining/data analysis methods, using a variety of data tools, building and implementing models, using/creating algorithms and creating/running simulations. -Proven ability to drive business results with their data-based insights. -Be comfortable working with a wide range of stakeholders and functional teams. -Have a passion for discovering solutions hidden in large data sets and working with stakeholders to improve business outcomes

Employment Type