Data Engineer (DATABRICKS / PYSPARK)
Sigma Software · Poland · Himalayas
This role has not been seen on the source board recently. Confirm it is still open before you apply.
About the role
• Develop and maintain data pipelines for processing large volumes of data in batch and near real-time environments • Work with Databricks, PySpark, and SQL to transform, validate, and optimize data • Support implementation of Data Lakehouse solutions following engineering standards and best practices • Build, test, and automate ETL processes and data workflows • Improve data quality, organization, and reliability across platforms • Collaborate with engineers, analysts, and stakeholders to deliver scalable solutions • Troubleshoot, optimize, and monitor data pipelines • Stay up to date with modern data engineering technologies • Ensure deliverables meet quality standards and project requirements • 2+ years of experience in Big Data development and database design • Strong hands-on experience with SQL • Strong Python development skills • Hands-on experience with PySpark • Experience developing and maintaining data pipelines in Databricks • Experience with Delta Lake • Experience with Medallion Architecture (Bronze, Silver, Gold layers) • Strong analytical and problem-solving skills • Intermediate or higher English level WILL BE A PLUS• Experience with AWS services, including S3 We are looking for a Middle Data Engineer to join our team and contribute to building scalable data solutions for a leading AdTech and analytics company.
Similar roles
- Quality Engineer (Test Automation & AI Testing)The Greater Change · Dubai, Dubai, United Arab Emirates
- Software Engineer, AI Coding TasksAskable · Worldwide · $1000 per task
- Head of EngineeringLemon.io · Worldwide
- Tech Lead Full-Stack Rails EngineerMitre Media · USA, Canada, USA timezones · $170k - $200k
- AI Trainer - Video AnnotationiMerit Technology · Worldwide · 70K-80K
- Digital Platforms & Applications Senior AnalystHolcim Egypt · New Cairo, Cairo, Egypt