[Remote] Lead Engineer- Big Data

Note: The job is a remote job and is open to candidates in USA. Diligente Technologies is seeking a Lead Engineer – Analytics who will be responsible for designing, developing, implementing and supporting data analytics solutions utilizing cloud architecture. The role involves leading projects, providing technical leadership, and collaborating with cross-functional teams to define technology architecture and improve data analytics capabilities. Responsibilities • Lead, build and deliver projects with high impact and cross-portfolio scope, complexity and collaboration with cross-functional teams, both business and technology • Identify technical implementation options and issues • Play a key role in defining the future Technology architecture and develop roadmaps of the systems, platforms and/or processes for the company across disciplines • Provide technical leadership and coaching to other engineers and architects across the organization • Act as expert and point of contact in cross-scrum business/technology/domain area • Partner and communicate cross-functionally across the enterprise • Provide the highest level of expertise for the specification, development, implementation and support of Analytical solutions (e.g. Datameer, Hive, Python, Redshift, Tableau) • Explain technical solutions and issues to senior leaders in the company in non-technical, understandable terms • Interact with business teams to gather, interpret and understand their business needs and create design specifications • Foster the continuous evolution of best practices within the development team to ensure data quality, standardization and consistency • Continuously seek Data Lake platform and data ingestion improvement opportunities that ensure optimal use of the environment and improve stability. Lead efforts to implement the solutions Skills • 10+ years of professional experience • 4+ years of experience with Big Data technology and analytics • Proficient in query languages such as SQL, Hive • Proficient in using Big Data tools (e.g., Hadoop, NoSQL DB, HBase) and API development and consumption • Proficient in data preparation and manipulation using Datameer tool • Experience with one or more languages (e.g., Python, Java) • Experience with SOA, IaaS, and Cloud Computing technologies, particularly in the AWS environment • Experience with Hadoop/Hive, Sqoop and Spark • Experience with ETL and ELT data modeling • Experience with data visualization tools like Tableau • Experience with continuous software integration, test and deployment • Experience with agile software development paradigm (e.g., Scrum, Kanban) • Ability to work within a dynamic environment with evolving requirements and capability goals • Self-motivated. Capable of working with little or no supervision • Maintains up-to-date knowledge in the appropriate technical areas • Strong written and verbal communication. Able to present and hold meetings with key business and technology partners, enterprise architects and vendors • Retail business domain knowledge preferred Company Overview • Diligente Technologies provides recruiting and staffing as well as IT consulting services for organizations. It was founded in 2006, and is headquartered in Santa Clara, California, USA, with a workforce of 51-200 employees. Its website is Company H1B Sponsorship • Diligente Technologies has a track record of offering H1B sponsorships, with 1 in 2025, 2 in 2020. Please note that this does not guarantee sponsorship for this specific role. Apply tot his job