Experienced Big Data Engineer - Software Development and Team Leadership Opportunity at arenaflex

Introduction to arenaflex arenaflex is a leading organization in the private industry, committed to innovation and excellence in technology. As part of our diverse tech group, you will have the opportunity to engineer, code, and develop software that makes us an essential part of our clients' digital lives. Our team is dedicated to creating a dynamic and inclusive environment where your voice is valued, and you have the autonomy to make your own decisions on what tech to use to tackle challenging problems. About This Job We are seeking a highly skilled and motivated Big Data Engineer to join our team. As a member of our engineering team, you will be responsible for developing and testing software, including ongoing refactoring of code and driving continuous improvement in code structure and quality. You will have the opportunity to work alongside talented engineers in an open, stable, and comprehensive environment where you can grow and develop your skills. Key Responsibilities Develop and test software, including ongoing refactoring of code and driving continuous improvement in code structure and quality Participate in code reviews and automated testing Troubleshoot basic software components and identify code defects for remediation Enable the deployment, support, and monitoring of software across test, integration, and production environments Automate solutions in test or production environments Scale applications based on demand projections Lead a small team of engineers and inspire them to achieve their full potential Influence colleagues with innovative changes and improvements by challenging the status quo and demonstrating risk-taking Essential Qualifications Bachelor's degree in Engineering or Computer Science or equivalent 3+ years of software development experience and leading teams of engineers and scrum teams 3+ years of hands-on experience working with Map Reduce, Hive, Spark (core, SQL, and PySpark) Strong Data warehousing concepts Knowledge of Financial reporting environment will be an plus Expertise in Distributed environment Hands-on experience in programming using Core Java or Python/Scala Expertise in Hadoop and Spark Architecture and its working principle Hands-on experience in writing and understanding complex SQL (Hive/PySpark-dataframes), optimizing joins while handling large amounts of data Experience in UNIX shell scripting Ability to design and develop advanced Data pipelines for batch and real-time data processing Should have experience in analysis, design, development, testing, and implementation of system applications Demonstrated ability to create and document technical and functional specifications and analyze software and system processing streams Preferred Qualifications Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be a benefit 3+ years of experience in designing and building solutions using Kafka streams or queues Experience with GitHub/Bitbucket and using CI/CD pipelines Experience with NoSQL i.e., HBase, Couchbase, MongoDB is good to have Amazing technical and analytical aptitude Excellent communication skills Exceptional Project management skills Career Growth Opportunities and Learning Benefits At arenaflex, we are committed to helping you grow and develop your skills. You will have access to dedicated opportunities to invest in your professional development, including training and mentorship programs. Our team is passionate about innovation and excellence, and we encourage you to think outside the box and come up with creative solutions to complex problems. Work Environment and Company Culture Our work environment is dynamic, inclusive, and collaborative. We value diversity and believe that it is essential to our success. Our team is made up of talented and motivated individuals who are passionate about what they do. We offer a comprehensive benefits package, including competitive salary, health insurance, and retirement savings plan. Compensation, Perks, and Benefits We offer a competitive salary of $28/hour, as well as a range of perks and benefits, including health insurance, retirement savings plan, and paid time off. Our team is committed to providing a positive and supportive work environment that allows you to thrive and grow. Conclusion If you are a motivated and talented Big Data Engineer looking for a new challenge, we encourage you to apply for this exciting opportunity at arenaflex. Our team is passionate about innovation and excellence, and we are committed to helping you grow and develop your skills. Don't miss out on this chance to join our dynamic and inclusive team and take your career to the next level. Apply Job! Apply for this job