Senior Data Engineer – Palantir & Big Data Specialist

We are looking for an experienced Senior Data Software Engineer who thrives on solving complex data transformation challenges. In this role, you will play a critical part in designing and implementing sophisticated data pipelines and analytics solutions that empower key decision-making processes in the client’s business unit. This is a unique opportunity to work on a high-impact Data Transformation project that leverages cutting-edge technologies, including Big Data, Palantir, and Machine Learning. This role is part of the Property & Casualty Data Integration and Analytics project under the Data & Foundations division. The team is working on a global initiative to harness Property & Casualty data to drive enhanced decision-making across the reinsurance lifecycle. You will collaborate with industry experts, data scientists, and engineers to develop transformative data and analytics capabilities for the client’s strategic priorities. If you are a passionate engineer with hands-on experience in large-scale data solutions, we invite you to join our global, multicultural, and dynamic team driving transformative outcomes. This role offers the flexibility to work remotely or collaborate with colleagues at one of our offices. Experience the freedom of remote work from anywhere in Georgia, whether from the comfort of your home, our modern offices in Tbilisi and Batumi or a coworking space in Kutaisi. Responsibilities • Design and optimize scalable data pipelines using PySpark and Python to handle extensive datasets • Work closely with cross-disciplinary teams to translate complex business needs into effective technical solutions • Leverage Palantir Foundry to develop and maintain analytics applications that generate operational and strategic insights • Oversee data integration workflows across distributed systems and implement high-quality ETL/ELT solutions • Create advanced SQL queries to support data transformation, querying, and warehousing • Adopt Agile workflows and actively contribute to Scrum ceremonies to align with overarching project goals • Document technical processes and solutions to support knowledge sharing and future maintainability • Identify and resolve data processing and platform issues within dynamic production environments • Stay informed about emerging trends in cloud computing, Big Data technologies, and Machine Learning • Engage in code reviews and advocate for best practices in software engineering and development methods Requirements • Palantir Foundry expertise with prior hands-on experience in applying the platform • 5+ years of relevant industry experience, including work with distributed computing or large-scale analytics systems • Proficiency in Python and PySpark to build scalable, reliable data workflows • Background in SQL (preferably Spark SQL), enabling efficient querying and data warehousing capabilities • Skills in designing and implementing ETL/ELT processes for high-volume datasets • Competency in Agile development practices, including familiarity with Scrum methodologies • Bachelor’s degree in fields such as Computer Science, Data Science, or other technical disciplines • Analytical and problem-solving aptitude with a strategic approach to addressing intricate challenges • Strong self-management abilities to balance workloads effectively and deliver results consistently • Collaborative mindset and ability to communicate effectively in globally distributed and multicultural teams • Interest and adaptability to explore new technologies and integrate advanced practices in data engineering Nice to have • Familiarity with data workflows associated with insurance, financial industries, or finance-related projects • Knowledge of front-end technologies like HTML, CSS, JavaScript, and tools such as Gradle • Proficiency in Microsoft Power BI for crafting data dashboards and reports • Background in applying Machine Learning techniques or integrating Generative AI models • Understanding of statistical models and their implementation within data processing workflows • Exposure to Azure, AWS, or GCP cloud platforms to enable advanced engineering capabilities We offer • We connect like-minded people • Delivering innovative solutions to industry leaders, making a global impact • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home • Opportunity to work abroad for up to two months per year • Relocation opportunities within our offices in 55+ countries • Corporate and social events • We invest in your growth • Leadership development, career advising, soft skills and well-being programs • Certifications, including GCP, Azure and AWS • Unlimited access to LinkedIn Learning and Get Abstract • Free English classes with certified teachers • We cover it all • Participation in the Employee Stock Purchase Plan • Monetary bonuses for engaging in the referral program • Comprehensive medical & family care package • Five trust days per year (sick leave without a medical certificate) • Benefits package (sports activities, a variety of stores and services) EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, clients, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow. Apply tot his job