**Experienced Full Stack Data Engineer – Web & Cloud Application Development at arenaflex**

At arenaflex, we're on a mission to revolutionize the way we collect, process, and analyze data. As a key member of our Dataworks team, you'll play a vital role in designing and driving the development of our data pipelines, working closely with IT, business, developers, and data scientists to deliver high-value insights and solutions. **About arenaflex** arenaflex is a leading provider of innovative logistics and transportation solutions. With a strong commitment to technology and innovation, we're constantly pushing the boundaries of what's possible in the industry. Our Dataworks team is at the forefront of this effort, using cutting-edge data engineering techniques to drive business growth and improvement. **Job Summary** We're seeking an experienced Full Stack Data Engineer to join our Dataworks team. As a key member of this team, you'll be responsible for designing, developing, and maintaining our data pipelines, working closely with cross-functional teams to deliver high-value insights and solutions. This is an exciting opportunity to work with a talented team of data engineers, developers, and data scientists to drive business growth and improvement. **Key Responsibilities** * Design and develop data pipelines to collect, process, and analyze large-scale data sets * Collaborate with cross-functional teams to deliver high-value insights and solutions * Work closely with IT, business, developers, and data scientists to ensure data quality and integrity * Develop and maintain data processing and analytics tools and technologies * Troubleshoot and resolve complex data-related issues * Provide technical guidance and support to junior team members * Stay up-to-date with industry trends and emerging technologies **Unexpected Expected Set of Responsibilities** As a Full Stack Data Engineer at arenaflex, you'll be responsible for a wide range of tasks, including: * Designing and developing data pipelines to collect, process, and analyze large-scale data sets * Collaborating with cross-functional teams to deliver high-value insights and solutions * Working closely with IT, business, developers, and data scientists to ensure data quality and integrity * Developing and maintaining data processing and analytics tools and technologies * Troubleshooting and resolving complex data-related issues * Providing technical guidance and support to junior team members * Staying up-to-date with industry trends and emerging technologies **Fundamental Work Obligations and Obligations** * Understanding both the business and technical issues Dataworks aims to address * Building tools, stages, and pipelines to empower teams to clearly and neatly investigate data, build models, and drive decisions * Scaling from "PC scale" to "team scale" issues, in terms of both infrastructure and problem design and method * Collaborating across teams to drive the creation of data-driven functional insights that mean high-value improved solutions * Delivering clear and actionable value quickly, working closely with different teams of changing backgrounds and disciplines * Classifying best practices for future reuse as available, reusable examples, layouts, and code bases * Connecting with senior technologists from the broader project and beyond arenaflex (partner environments and clients) to make collaborative energies and ensure smooth solutions to downstream functional frameworks **Expertise/Information Thought about an Or more** * Technical foundation in software engineering, programming, database frameworks, distributed frameworks * Familiarity with distributed and cloud environments and a deep understanding of enhancing computational considerations with theoretical properties * Experience in building robust cloud-based data engineering and curation solutions to make data items useful for various applications * Detailed knowledge of the Microsoft Azure tooling for large-scale data engineering endeavors and solutions is highly preferred. Experience with any combination of the following Azure tools: Azure Databricks, Azure Data Factory, Azure SQL Data Warehouse, Azure Machine Learning * Creating and operationalizing functions and solutions including under close to real-time high-volume streaming circumstances * Active development skills with the ability to work at the code level and help troubleshoot hard-to-resolve issues * A compelling history of planning and delivering large-scale technical solutions, which convey clear, ongoing value * Direct experience having built and delivered strong, complex production systems that execute current, data handling strategies at scale * Ability to set switch, to offer support to distributed teams which might require a "specialist programmer" to unblock a particularly difficult technical obstruction, and to figure out through issues as they are still being defined * Exhibited ability to deliver technical projects with a team, frequently working under close time constraints to deliver value * An 'engineering' attitude, able to make fast, practical decisions to improve performance, accelerate progress or amplify influence * Comfort with working with distributed teams on code-based expectations, using version control frameworks and code reviews * Ability to lead data analysis, research, and heredity studies to record and upgrade data quality and access * Utilization of agile and devops practices for project and software management including continuous integration and continuous delivery **Shown mastery working with some of the following common languages and tools:** * Flink (Scala and PySpark), Kafka and other high-volume data tools * SQL and NoSQL storage tools, like MySQL, Postgres, MongoDB/CosmosDB * Java, Python data tools * Azure DevOps experience to track work, develop using git-integrated version control examples, and build and use CI/CD pipelines * Working knowledge and experience executing data engineering patterns to help shifting business needs * Experience with various data types (json, xml, parquet, avro, unstructured) for both batch and streaming ingestions * Utilization of Azure Kubernetes Services, Eventhubs, or other related advancements to execute streaming ingestions * Experience creating and implementing warning and monitoring systems * Working knowledge of Infrastructure as Code (IaC) through Terraform to create and deploy assets * Execution experience across various data stores, messaging frameworks, and data processing engines * Data joining through APIs as well as REST services * PowerPlatform (PowerBI, PowerApp, PowerAutomate) development experience an or more **Least Capabilities:** **Information Architect I:** * Four-year college education in Data Frameworks, Software engineering or a quantitative discipline like Math or Designing or potentially One (1) year comparable conventional preparation or work insight * Essential knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines * Essential knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks * Experience as a junior member of multi-functional project teams * Solid oral and written communication skills * A connected postgraduate education might counterbalance the connected experience requirements **Sponsorship isn't available for Information Designer I job.** **Information Specialist II:** * Four-year certification in Software engineering, Data Frameworks, a connected quantitative field, for example, Designing or Math or identical proper preparation or work insight * Two (2) years comparable work insight in estimation and examination, quantitative business critical thinking, reproduction improvement and additionally prescient examination * Solid knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines * Solid knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks * Solid comprehension of the transportation business, contenders, and developing advancements * Experience as a member of multi-functional project teams * Solid oral and written communication skills * A connected postgraduate education might balance the connected experience requirements **Sponsorship isn't available for Information Architect II job.** **Information Designer III:** * Four-year college education in Data Frameworks, Software engineering or a quantitative discipline like Math or Designing as well as comparable conventional preparation or work insight * Three to Four (3 - 4) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination * Broad knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines * Broad knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks * Solid comprehension of the transportation business, contenders, and advancing advancements * Experience giving authority in a general preparation or counseling setting * Experience as a senior member of multi-functional project teams * Solid oral and written communication skills * A connected postgraduate education might counterbalance the connected experience requirements **Information Designer Lead:** * Four-year college education in Data Frameworks, Software engineering, or a quantitative discipline like Science or Designing as well as identical conventional preparation or work insight * Five to Seven (5 - 7) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination * Broad knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines * Broad knowledge in Data Frameworks including plan, development and execution of large-scale or online transaction-based frameworks * Solid comprehension of the transportation business, contenders, and developing advancements * Experience giving initiative in a general preparation or counseling setting * Experience as a leader or a senior member of multi-functional project teams * Solid oral and written communication skills * A connected postgraduate education might balance the connected experience requirements **Residence/Movement Data:** * This position can be domiciled anywhere in the US. **Application Standards:** * Transfer current copy of Resume (Microsoft Word or PDF format only) and answer work screening survey. **Extra Data** Colorado, Nevada, Connecticut, New York, California, Rhode Island, Washington, Hawaii, Illinois and New Jersey Residents Only - Compensation: Monthly Pay: $6,317.00 - $15,477.00. This pay range is provided as a reasonable estimate of the current starting compensation range for this job. Factors that may be used to determine your actual compensation may include your qualifications, experience, and performance. **Top 10 Interview Questions** * Can you tell us about yourself? * What interests you about this position? * What are your strengths? * What are your weaknesses? * Can you give an example of a time when you solved a problem creatively? * How do you handle stress and pressure? * How would you describe your work style? * Can you tell us about a time when you had to work with a difficult colleague or supervisor? * How do you stay organized and prioritize tasks? * What are your long-term career goals? **Document Required:** * Required Documents for This Recruitment: The candidate should have this Document Before Apply Online. Candidates Are Suggested To Read the Official Notification Before Applying. * Document – Qualifications certificate with mark sheets. * Passport size Photographs * Signature **How to apply:** * All the eligible candidates can apply for This Job as mentioned below * Read the official notification carefully From the Official Website. * Read the Notification Carefully Before Applying. * Fill out The Application Form (The link Is Given Below) * Attach the Required Document and Passport Size Photo with Signature. * Then Submit. Done. Apply Job! Apply for this job