Lead Big Data Engineer – Distributed Computing, Scalable Data Architecture & Enterprise Analytics Platform

Posted 2026-05-06
Remote, USA Full-time Immediate Start

About arenaflex


Welcome to arenaflex, where data-driven innovation meets transformative retail experiences. At arenaflex, we believe that the power of big data can revolutionize how we understand our customers, optimize our operations, and create seamless shopping experiences across all channels. As one of the nation's leading retailers, we handle massive volumes of data every single day—from millions of customer transactions to complex supply chain logistics—and we're looking for a visionary Lead Big Data Engineer to help us harness this data like never before.

When you join the arenaflex Information Science and Engineering team, you're not just taking a job; you're embarking on a career that will challenge you to push the boundaries of what's possible with data at scale. Whether you find your home in our Statistics, Optimization, or Artificial Intelligence groups, you'll be empowered to leverage arenaflex's extraordinary data wealth to build the algorithms that power solutions our partners in Marketing, Supply Chain Optimization, Enterprise Security, and Personalization depend on daily. Your work will directly impact millions of customers and thousands of team members across the organization.

Position Overview


We're seeking an experienced and passionate Lead Big Data Engineer to architect, develop, and maintain our enterprise-grade distributed computing infrastructure. In this critical role, you'll be responsible for building high-performance, scalable data solutions that enable real-time analytics, machine learning model deployment, and business intelligence across the entire organization. You'll lead initiatives that transform raw data into actionable insights, working alongside talented data scientists, analysts, and engineering teams to deliver solutions that drive measurable business value.

This position offers the unique opportunity to work with cutting-edge big data technologies while collaborating with cross-functional teams to solve complex challenges at web scale. You'll be instrumental in defining our data architecture strategy, ensuring that our platforms can handle current demands while being scalable for future growth.

Key Responsibilities



  • Architecture Design & Implementation: Design and implement robust software architecture frameworks to ensure our organization's data solutions are built within a consistent, maintainable, and scalable structure that aligns with enterprise standards.

  • Distributed Computing Leadership: Lead the development of high-performance, distributed computing projects using Big Data technologies including Hadoop, NoSQL databases, text mining frameworks, and other distributed environment technologies based on organizational requirements.

  • Data Pipeline Development: Create and implement models to manage web-scale data and its organization, ensuring efficient data flow between various systems and platforms throughout the enterprise.

  • Technical Strategy Collaboration: Participate in decision-making processes related to the selection of appropriate architecture solutions, evaluating emerging technologies and recommending approaches that balance performance, cost, and maintainability.

  • Code Development & Optimization: Analyze, design, program, debug, and modify software developments as well as new products used in distributed, large-scale analysis solutions, ensuring code quality and performance standards are met.

  • Documentation & Standards: Create and maintain comprehensive documentation that ensures consistency in development practices across the organization, including technical specifications, API documentation, and best practice guidelines.

  • Infrastructure Excellence: Implement and continuously improve core programming infrastructure, establishing monitoring systems, automation frameworks, and deployment pipelines that enhance operational efficiency.

  • Analytics & Reporting: Develop interactive dashboards, reports, and analysis templates that provide stakeholders with meaningful insights into business performance, customer behavior, and operational metrics.

  • Ad-Hoc Access Platform: Implement and enforce platforms that provide on-demand access to massive datasets, enabling self-service analytics while maintaining appropriate security and governance controls.

  • Requirements Translation: Translate key business requirements into effective technical solutions that meet specific business needs, bridging the gap between technical and non-technical stakeholders.

  • Technical Consultation: Provide expert consultation on complex projects, serving as a technical authority while maintaining awareness of both immediate project needs and broader organizational objectives.

  • Specification Review: Review and approve specifications to ensure consistency in approach and utilization of standard methodologies across all data engineering initiatives.

  • Performance Characterization: Perform systems and applications performance characterization and compromise studies through rigorous analysis and simulation, identifying bottlenecks and optimization opportunities.

  • Innovation & Research: Research emerging technologies and enhancements in coding standards, evaluating their potential impact on our data platform and recommending adoption where appropriate.

Essential Qualifications



  • Educational Background: Bachelor's degree in Computer Science, Data Engineering, or a related technical field. Equivalent practical experience will also be considered for exceptional candidates.

  • Programming Expertise: Strong proficiency in at least one of the following programming languages: Java, Scala, or Python, with the ability to write clean, efficient, and maintainable code.

  • Big Data Technology Stack: Demonstrated hands-on experience with Big Data technologies including but not limited to Hadoop ecosystem components, Apache Spark, Druid, and related distributed computing frameworks.

  • System Design & Development: Broad understanding of software development and design principles, including object-oriented programming, design patterns, and system architecture fundamentals.

  • Operational Experience: Extensive experience with operational aspects of complete Big Data platforms, including monitoring and alert management, availability monitoring, capacity management, and service management.

  • Collaboration Skills: Proven ability to collaborate effectively with teams and partners to improve overall operational excellence of the Big Data ecosystem.

  • Global Teamwork: Excellent interpersonal skills with the ability to partner and collaborate effectively with a global, cross-functional team across multiple time zones.

Preferred Qualifications



  • Advanced degree in Computer Science, Data Science, or related technical discipline

  • Experience with cloud-based data platforms (AWS, Azure, or Google Cloud)

  • Knowledge of real-time streaming data processing frameworks such as Apache Kafka or Apache Flink

  • Familiarity with containerization technologies like Docker and Kubernetes

  • Experience with machine learning model deployment and MLOps practices

  • Understanding of data governance, security, and compliance requirements

  • Previous experience in retail, e-commerce, or consumer goods industry

  • Strong background in SQL and relational database systems

  • Experience with data visualization tools such as Tableau, Power BI, or Looker

Skills & Competencies


To thrive in this role at arenaflex, you'll need a unique blend of technical expertise and soft skills that enable you to deliver innovative solutions while leading your team to success:


  • Technical Leadership: The ability to mentor junior engineers, conduct code reviews, and establish technical standards that drive team success.

  • Problem-Solving: Strong analytical skills with the ability to approach complex challenges systematically, breaking down problems into manageable components and developing elegant solutions.

  • Communication: Excellent verbal and written communication skills, with the ability to translate technical concepts into business language for non-technical stakeholders.

  • Adaptability: Comfortable working in a fast-paced, evolving environment where priorities may shift and new technologies emerge rapidly.

  • Initiative: Self-motivated with a proactive approach to identifying improvement opportunities and driving projects forward with minimal supervision.

  • Attention to Detail: Meticulous approach to code quality, documentation, and system reliability, ensuring deliverables meet the highest standards.

Career Growth & Learning Opportunities


At arenaflex, we believe in investing in our people and supporting their professional development. As a Lead Big Data Engineer, you'll have access to extensive growth opportunities including:


  • Technical Career Path: Clear progression routes to Senior Big Data Engineer, Principal Engineer, or Data Architecture leadership positions.

  • Continuous Learning: Access to online learning platforms, industry conferences, and internal technical training sessions to stay current with emerging technologies.

  • Cross-Functional Exposure: Opportunities to work with teams across Marketing, Supply Chain, Security, and Personalization, broadening your understanding of how data drives business decisions.

  • Innovation Labs: Participation in hackathons and innovation initiatives that allow you to experiment with new technologies and approaches.

  • Mentorship Programs: Both receiving mentorship from senior leaders and mentoring junior team members as you advance in your career.

Work Environment & Culture


arenaflex fosters a collaborative, inclusive work environment where diverse perspectives are valued and innovation thrives. Our data engineering teams work in agile squads, fostering close collaboration and rapid iteration. We embrace flexible work arrangements that support work-life balance while maintaining the connection and teamwork that drives our success.

You'll join a community of passionate data professionals who are committed to pushing the boundaries of what's possible. Our culture emphasizes psychological safety, continuous feedback, and celebrating both individual contributions and team achievements. We believe that the best solutions emerge when talented people from different backgrounds and perspectives come together to solve challenging problems.

Compensation & Benefits


arenaflex offers a competitive compensation package that recognizes your expertise and contributions:


  • Competitive Salary: Industry-leading pay with annual performance-based reviews

  • Comprehensive Health Benefits: Medical, dental, and vision coverage for you and your family

  • Retirement Savings: 401(k) plan with company matching contributions

  • Paid Time Off: Generous vacation, sick leave, and personal days

  • Professional Development: Tuition reimbursement and career development resources

  • Employee Discounts: Exclusive discounts on arenaflex products and services

  • Wellness Programs: Access to wellness resources and employee assistance programs

  • Parental Leave: Comprehensive paid leave for new parents

Join Our Team


Are you ready to make an impact with your technical expertise? Are you passionate about building scalable data solutions that power transformative business outcomes? If so, we invite you to apply for this exciting opportunity to join the arenaflex family.

At arenaflex, you'll find more than just a job—you'll find a place where your skills, creativity, and passion can flourish. You'll work alongside talented colleagues who share your commitment to excellence, and you'll see the direct impact of your work on millions of customers every day.

We encourage qualified candidates to apply and become part of our mission to help all Canadians discover the joy of everyday life. Together, we can continue to innovate, grow, and deliver exceptional experiences to our guests while building rewarding careers for our team members.

Apply today and take the first step toward an exciting career at arenaflex!

arenaflex is an equal opportunity employer. We value diversity and inclusion and are committed to creating an environment where all team members can thrive. We comply with the Americans with Disabilities Act (ADA) and will provide reasonable accommodations to qualified individuals with disabilities during the application process.

Similar Jobs

Back to Job Board