Senior Data Engineer

CIGROUPEMEA is seeking an experienced Data Engineer to join our team. The ideal candidate has 5+ years of experience as a Data Engineer in a similar role and is proficient in SQL and Python. The candidate will be responsible for designing and implementing comprehensive data pipelines for a variety of flows (data integration across systems, ETL processes, machine learning infrastructures). The candidate must have experience with data modeling, warehousing, and building pipelines. Additionally, the candidate must have prior experience in continuous integration and continuous deployment of large scalable data systems.

What will be your key responsibilities:

Responsibilities:

  • Design and implement robust and scalable data pipelines using Apache Kafka, ensuring reliable data ingestion and streaming capabilities.
  •  Develop and optimize SQL queries and stored procedures for data transformation and aggregation, working closely with data analysts and scientists.
  • Utilize Python to build and maintain ETL (Extract, Transform, Load) processes for efficiently processing large volumes of data.
  • Implement and manage data processing workflows in Databricks, leveraging its distributed computing capabilities and advanced analytics features.
  • Design and maintain Delta Tables to enable efficient data versioning, storage, and retrieval for analytical workloads.
  • Collaborate with business stakeholders to gather data requirements and design data models for effective reporting and visualization in Power BI.
  • Implement data integration and synchronization solutions using Azure SQL, ensuring seamless data flow between on-premises and cloud environments.
  • Utilize SAP HANA for high-performance data processing and analytics, optimizing queries and data models for efficient data retrieval.
  • Ensure the security, privacy, and compliance of data systems, following industry best practices and organizational guidelines.
  • Monitor and troubleshoot data infrastructure and pipelines, proactively identifying and resolving performance and scalability issues.
  • Collaborate with cross-functional teams to ensure data quality, accuracy, and integrity throughout the data lifecycle.
  • Stay updated with emerging technologies and industry trends in data engineering, making recommendations for continuous improvement.

What experience should you have:

  •  Bachelor's or Master's degree in Computer Science, Information Systems, or a related field.
  • Strong proficiency in Apache Kafka, SQL, and Python, with hands-on experience in designing and developing data pipelines.
  • Experience with Databricks for big data processing and analytics, including Spark programming and cluster management.
  • Proficiency in working with Delta Tables for data versioning, optimization, and reliability.
  • Familiarity with Power BI for data visualization and reporting, creating interactive dashboards and reports.
  • Working knowledge of Azure SQL for data integration and synchronization across on-premises and cloud environments.
  • Experience with SAP HANA for high-performance data processing and analytics (preferred).
  • Solid understanding of Linux-based operating systems and shell scripting.
  • Strong problem-solving and analytical skills, with the ability to analyze complex data-related issues and provide effective solutions.
  • Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
  • Proven ability to manage multiple tasks and priorities in a fast-paced and dynamic environment.

What do you get in return:

Our team is composed of experts in their fields who are passionate about delivering high-quality work and maintaining a positive work culture. We value innovation, teamwork, and personal growth. As an experienced Data Engineer, you will have the opportunity to make a significant impact on our projects and contribute to the success of our organization. If you are ready to embrace exciting challenges and foster a culture of excellence, we encourage you to apply.

What do we offer:

  • Work remotely from anywhere in the world, with a fully remote team, and enjoy a mutually agreed schedule that fits your needs. (Core US working hours) 
  • Work primarily with US-based colleagues, providing you with the opportunity to collaborate with people from diverse backgrounds and skill sets.
  • Use your skills and expertise to make a significant impact on the delivery of projects in our company
  • Work in a supportive environment that values your contribution and provides you with the resources and training you need to grow in your career.
  • Enjoy a 40-hour workweek that provides you with a healthy work-life balance, and the time to pursue your personal and professional goals outside of work.



Mám zájem o tuto pozici

Poslat nabídku na e-mail

Další pozice v oboru Informační technologie, region remote

Software Engineer - eCommerce

  • Goodcall
  • Prague
  • By agreement

Responsible for the design, development and support of all Envista eCommerce solutions using the Magento framework. Maintain and monitor critical eCommerce functionality and website security.

Software Engineer - eCommerce

IT administrator

  • DISPONERO
  • Mladá Boleslav
  • Dohodou

Pro našeho významného klienta, který je předním představitelem v oblasti automobilových technologií hledáme IT administratora.

IT administrator

SAP Test Manager

  • TietoEVRY
  • Czech Republic
  • By agreement

We are seeking an experienced SAP Test Manager to join our team. The SAP Test Manager will be responsible for leading and managing the testing activities for SAP projects within the organization.…

SAP Test Manager