Senior Data Engineer

Responsibilities:

• Design and implement robust and scalable data pipelines using Apache Kafka, ensuring reliable data ingestion and streaming capabilities.
• Develop and optimize SQL queries and stored procedures for data transformation and aggregation, working closely with data analysts and scientists
• Utilize Python to build and maintain ETL (Extract, Transform, Load) processes for efficiently processing large volumes of data.
• Implement and manage data processing workflows in Databricks, leveraging its distributed computing capabilities and advanced analytics features.
• Design and maintain Delta Tables to enable efficient data versioning, storage, and retrieval for analytical workloads.
• Collaborate with business stakeholders to gather data requirements and design data models for effective reporting and visualization in Power BI.
• Implement data integration and synchronization solutions using Azure SQL, ensuring seamless data flow between on-premises and cloud environments.
• Ensure the security, privacy, and compliance of data systems, following industry best practices and organizational guidelines.
• Monitor and troubleshoot data infrastructure and pipelines, proactively identifying and resolving performance and scalability issues.
• Collaborate with cross-functional teams to ensure data quality, accuracy, and integrity throughout the data lifecycle.
• Stay updated with emerging technologies and industry trends in data engineering, making recommendations for continuous improvement.

Requirements: 

•  Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
• Strong proficiency in Apache Kafka, SQL, and Python, with hands-on experience in designing and developing data pipelines.
• Experience with Databricks for big data processing and analytics, including Spark programming and cluster management.
• Proficiency in working with Delta Tables for data versioning, optimization, and reliability.
• Familiarity with Power BI for data visualization and reporting, creating interactive dashboards and reports.
• Working knowledge of Azure SQL for data integration and synchronization across on-premises and cloud environments.
• Experience with SAP HANA for high-performance data processing and analytics (preferred).
• Solid understanding of Linux-based operating systems and shell scripting.
• Strong problem-solving and analytical skills, with the ability to analyze complex data-related issues and provide effective solutions.
• Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
• Proven ability to manage multiple tasks and priorities in a fast-paced and dynamic environment.

Our team is composed of experts in their fields who are passionate about delivering high-quality work and maintaining a positive work culture. We value innovation, teamwork, and personal growth. As an experienced Data Engineer, you will have the opportunity to make a significant impact on our projects and contribute to the success of our organization. If you are ready to embrace exciting challenges and foster a culture of excellence, we encourage you to apply.

What do we offer:

• Work remotely from anywhere in the world, with a fully remote team, and enjoy a mutually agreed schedule that fits your needs. (Core US working hours) 
• Work primarily with US-based colleagues, providing you with the opportunity to collaborate with people from diverse backgrounds and skill sets.
• Use your skills and expertise to make a significant impact on the delivery of projects in our company
• Work in a supportive environment that values your contribution and provides you with the resources and training you need to grow in your career.
• Enjoy a 40-hour workweek that provides you with a healthy work-life balance, and the time to pursue your personal and professional goals outside of work.