Data Engineer
Job description
Digikala, the largest e-commerce platform in Iran, is looking for high-caliber data engineers to help us improve our products and deliver a world-class experience for our customers. In this position, you are supposed to:
- Have the ability to independently research, test and deploy new big data technologies
- Partner with the data science team to drive requirements for new products and integrate data during the development
- Innovate in order to create solutions for real-world problems
- Have the passion to extend the big data platform with new tools and services and build a growth mindset
- Develop high-quality data pipelines, business reports, and batch and stream processing applications using industry best practices
Requirements
- MS/BS in Software Engineering, IT or other related fields
- Familiar with software development patterns
- Experience in Python or Java programming
- Expertise in batch processing applications and Map/Reduce
- Expertise in pipeline development and maintenance
- Expertise in stream processing patterns
- Proficient with NoSQL and columnar databases
- Experience in working with messaging brokers
- Experience in working with distributed caches
- Familiar with distributed systems and algorithms such as replication, consensus, partitioning, etc.
- Great ability to identify and translate business and customer needs into data engineering projects and tasks
- Excellent communication and collaboration skills – experience in writing and presenting comprehensive narratives on opportunity, objectives, goals, and delivery plan to customers and stakeholders