Data Engineer

Key responsibilities

• Build and maintain scalable, reliable, and high-performance data pipelines
• Design and develop ETL/ELT workflows and orchestration processes
• Work with large-scale datasets using big data technologies such as Spark, Kafka, and Hadoop
• Design and optimize data models and data warehouse solutions
• Ensure data quality, integrity, and accuracy through validation and preprocessing techniques
• Optimize data collection and storage processes for scalability and efficiency
• Collect, process, and analyze complex datasets to generate meaningful business insights
• Design and conduct experiments to validate data-driven solutions and hypotheses
• Create templates, dashboards, and visualizations for stakeholders
• Collaborate with cross-functional teams to identify business and data requirements
• Support data governance and best practices across the organization

Requirements

• Strong experience in data engineering and cloud-based data platforms
• Advanced SQL and Python skills
• Hands-on experience with AWS services and modern data architectures
• Experience with Spark, Kafka, Hadoop, and Airflow
• Solid understanding of data modeling and data warehousing concepts
• Strong analytical and problem-solving skills
• Ability to work in agile and collaborative environments
• Good communication skills and stakeholder management experience

Nice to have

• Scala knowledge
• Experience in manufacturing environments or manufacturing processes
• Experience with reporting and visualization tools