Job Description and Requirements:
Technical Skills
- At least 4 years of experience as a Data Engineer
- Experience with ETL tools and frameworks for example Apache Airflow, Talend, Informatica
- Proficiency in programming languages – Python and SQL
- Knowledge of database systems for example PostgreSQL, MySQL
- Understanding of data warehousing concepts and dimensional modeling
- API integrations
Analytical and Problem-Solving Skills
- Ability to understand complex data structures and business requirements
- Proficiency in data analysis and data manipulation techniques
- Attention to detail and ability to identify and resolve data quality issues
- Nice to have: experience with machine learning
Data Extraction
- Identify and gather data from various sources (databases, flat files, APIs, etc.)
- Understand data structures and formats
- Write scripts or programs to extract data efficiently
Data Transformation
- Clean and preprocess raw data to ensure data quality and consistency
- Perform data validation, filtering, and deduplication
- Apply business rules and logic to transform data into the desired format
- Implement data mapping and data integration processes
Data Loading
- Design and develop processes to load transformed data into target systems (data warehouses, data lakes, etc.)
- Ensure data integrity and consistency during the loading process
- Optimize data loading performance and handle large volumes of data
Automation and Scheduling
- Develop automated ETL workflows and pipelines
- Schedule and monitor ETL processes for efficient and timely execution
- Implement error handling and recovery mechanisms
What we offer:
- Competitive salary and career growth
- Flexible work hours and remote work
- Work in a friendly, fun, multicultural, and fast-growing company
- A chance to work with the newest technology in the field
- Access to online courses and training programs
- Annual team building events and various team building activities
- Private health insurance and life insurance
- Monthly budget for additional perks (sports activities, wellness, literature, gadgets…)
- Annual budgets for learning and development (hackathons, seminars, conferences, trainings…)