About The Role

We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you’ll create algorithms and conduct statistical analysis. Overall, you’ll strive for efficiency by aligning data systems with business goals.

To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine methods.

If you are detail-oriented, with excellent organizational skills and experience in this field, we’d like to hear from you.

Key Responsibilities

• Hands on Experience in Pyspark and Data Stream Processing (Flink, Spark Structured Streaming).
• Experience with data mining, modeling, mapping, SQL and ETL process.
• Expert proficiency in Python.
• Experience building or maintaining ETL processes.

Minimum Requirement

• Familiarity with the AWS ecosystem specifically RedShift, Glue, Athena, messaging brokers (Kafka) and RDS.
• Minimum 3 years of relevant experience.

Keywords

Pyspark, AWS, ETL, Kafka.