Data Engineer-(Scala and Spark)
Job Description
We are looking for a highly skilled Data Engineer with expertise in Scala and Apache Spark to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and solutions to manage and process large datasets efficiently.
Key Responsibilities: ? Design and implement robust, scalable, and high-performance data pipelines using Scala and Apache Spark. ? Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. ? Optimize data processing systems and ensure their scalability and efficiency. ? Work on data extraction, transformation, and loading (ETL) processes for various structured and unstructured datasets. ? Implement best practices for data engineering, including data governance, data quality, and monitoring. ? Debug and resolve data processing and performance issues promptly. ? Ensure data security and compliance with relevant regulations and guidelines.
Skills & Qualifications: ? Strong programming skills in Scala with 3+ years of hands-on experience. ? Proficiency in Apache Spark for large-scale data processing. ? Familiarity with Hadoop Ecosystem (e.g., HDFS, Hive, HBase) is a plus. ? Experience with cloud platforms like AWS, Azure, or GCP. ? Knowledge of relational and non-relational databases (e.g., PostgreSQL, MongoDB). ? Hands-on experience with data versioning, CI/CD pipelines, and orchestration tools (e.g., Airflow). ? Strong problem-solving skills and ability to work in an Agile environment. ? Knowledge of containerization tools (Docker, Kubernetes) is an advantage.
Educational Background:
? Bachelor?s or Master?s degree in Computer Science, Engineering, or a related field.
Experience: 3-6 years
Similar Remote Jobs
Data Engineer-(Scala and Spark)
Posted on: 22-11-2024 05:34
Delta work from home jobs
Posted on: 22-11-2024 05:34
Remote Embedded Software Engineer Jobs
Posted on: 22-11-2024 05:34
Remote Customer Chat Support Specialist ? Entry Level
Posted on: 22-11-2024 05:34
(Ohio) Virtual Assistant, Remote Mystery Shopper Needed ???
Posted on: 22-11-2024 05:34
Behavioral Health | Flexible Schedule| Remote
Posted on: 22-11-2024 05:34
WFH Call Center Representative Remote
Posted on: 22-11-2024 05:34
Remote Data Entry Clerk No Experience
Posted on: 22-11-2024 05:34
Now Hiring Remote Sales Experts: Apply Today
Posted on: 22-11-2024 05:34
Remote Online Amazon Chat Jobs No Experience ? Easy Jobs Hiring Near Me ? No Experience Needed
Posted on: 22-11-2024 05:34
Remote Office Assistant (Mental Health Practice)
Posted on: 03-02-2025 00:00
[Entry level Remote jobs] Aetna Data Entry Remote Jobs ? Apply Now
Posted on: 21-02-2025 00:00
Remote Principal Network Engineer - Join Our Team
Posted on: 28-01-2025 06:22
(Disney Data Entry Specialist) Work From Home Jobs ? No Experience / Entry Level
Posted on: 24-09-2024 00:00
Part Time Student - Foundry/Quality - Remote
Posted on: 16-11-2024 19:13
Customer Care Representative - Remote
Posted on: 13-09-2024 00:00
No Experience Needed! Entry Level & Full Time Immediate Openings!
Posted on: 16-07-2024 18:55
UPS Data Entry jobs From Home ?[Entry Level/No Experience] ?Immediate Hiring
Posted on: 16-11-2024 00:00
Apple Customer Service Work From Home
Posted on: 01-11-2024 07:54
Senior Manager- Paid Search Activation and Enablement
Posted on: 25-08-2024 00:00