Experienced Big Data Engineer – Hadoop, Spark & Cloud Data Platform Development
Posted 2026-05-06About arenaflex
Welcome to arenaflex, a global leader in innovation and technology solutions. For decades, we have been at the forefront of digital transformation, empowering millions of customers worldwide to achieve their financial goals through cutting-edge technology. Our commitment to excellence, inclusion, and continuous learning has made us one of the most respected names in the industry.
At arenaflex, we believe that technology is the backbone of modern business, and our diverse tech team is the heart of our innovation. We engineer, code, and ship programming that makes us an essential part of our customers' digital lives. Here, you'll work alongside talented architects in an open, supportive, and inclusive environment where your voice is valued, and you make your own decisions about what technology to use to solve challenging problems.
We offer a wide range of opportunities to work with the latest technologies and encourage you to contribute to the broader engineering community through open-source initiatives. Because we understand the importance of keeping your skills fresh and relevant, we provide dedicated time to invest in your professional development. Find your place in technology with #TeamArenaflex.
Position Overview
We are seeking a talented and motivated Big Data Engineer to join our dynamic technology team in Phoenix. This is an exciting opportunity to be part of a fast-paced, innovative group that enables batch/real-time analytical solutions using cutting-edge technologies including Hadoop/Big Data, Data Science/ML, Python, SQL, UNIX, and Shell Scripting.
As a Big Data Engineer at arenaflex, you will play a critical role in designing and building advanced data pipelines that process massive volumes of data, powering innovative solutions across multiple lines of business. You will collaborate with cross-functional teams to deliver high-quality software solutions that drive business value and enhance customer experiences.
What Will You Make an Impact In This Role?
Software Development
- Design, develop, and maintain large-scale data processing systems using Hadoop, Spark, and related technologies
- Write clean, efficient, and well-documented code for data pipelines, APIs, and automation tools
- Participate in code reviews and automated testing to ensure code quality and reliability
- Troubleshoot complex data processing issues and identify code defects for remediation
- Enable the deployment, support, and monitoring of software across test, integration, and production environments
- Automate deployments in test or production environments using CI/CD pipelines
- Scale applications automatically based on demand projections and performance metrics
- Develop and test software, including ongoing refactoring of code and drive continuous improvement in code structure and quality
- Apply visualization and other techniques to quick-track concepts and solutions
Technical Leadership
- Lead and mentor a small team of developers, inspiring them to achieve their full potential
- Influence team members with innovative changes and improvements by testing the norm and demonstrating risk-taking
- Serve as a core member of an Agile team, driving client story analysis and elaboration, design and development of programming applications, testing, and build automation tools
- Identify opportunities to adopt innovative technologies and approaches
- Embrace an innovative mindset by looking beyond the obvious for continuous improvement opportunities
- Manage specific platforms/products or work as part of a dynamic resource pool assigned to projects based on demand and business need
Required Qualifications
- Education: Bachelor's degree in Engineering, Computer Science, or related field OR Master's in Computer Applications or equivalent experience
- Experience: 3+ years of software development experience with proven track record of leading teams of developers and Scrum teams
- Technical Skills: 3+ years of hands-on experience working with MapReduce, Hive, and Spark (Core, SQL, and PySpark)
- Data Warehouse: Strong understanding of data warehousing concepts and architectures
- Programming: Hands-on experience in programming using Core Java or Python/Scala
- Big Data Technologies: Mastery of Hadoop and Spark Architecture and its working principles
- Data Processing: Hands-on experience writing and understanding complex SQL (Hive/PySpark DataFrames), optimizing joins while processing large amounts of data
- Scripting: Experience in UNIX shell scripting
- Pipeline Development: Ability to design and develop advanced data pipelines for batch and real-time data processing
- System Development: Experience in analysis, design, development, testing, and implementation of enterprise applications
- Documentation: Demonstrated ability to develop and document technical and functional specifications, and analyze software and system processing flows
Preferred Qualifications
- Knowledge of cloud platforms like GCP/AWS is highly desirable
- Experience building Microservices and scalable solutions
- 3+ years of experience designing and building solutions using Kafka streams or queues
- Experience with GitHub/Bitbucket and using CI/CD pipelines
- Experience with NoSQL databases such as HBase, Couchbase, or MongoDB
- Strong technical and analytical aptitude
- Excellent communication and interpersonal skills
- Exceptional project management abilities
- Knowledge of financial reporting environments is a plus
- Expertise in distributed computing environments
Skills and Competencies Required for Success
To thrive in this role, you should possess the following key skills and competencies:
- Problem-Solving: Strong analytical skills to troubleshoot complex data processing challenges and develop innovative solutions
- Collaboration: Ability to work effectively in cross-functional teams and communicate with stakeholders at all levels
- Adaptability: Comfortable working in a fast-paced, dynamic environment with changing priorities
- Innovation: A proactive mindset that seeks continuous improvement and embraces new technologies
- Attention to Detail: Meticulous approach to code quality, testing, and documentation
- Time Management: Ability to manage multiple projects and meet tight deadlines
- Mentorship: Skills to guide and develop junior team members
Career Growth Opportunities
At arenaflex, we are committed to helping our employees grow and advance in their careers. As a Big Data Engineer, you will have access to numerous opportunities for professional development, including:
- Technical Training: Access to industry-leading certifications and training programs in big data technologies, cloud platforms, and emerging technologies
- Career Advancement: Clear progression paths to senior technical roles, technical lead positions, and management opportunities
- Exposure to Emerging Technologies: Opportunity to work with the latest innovations in big data, machine learning, and cloud computing
- Open Source Contributions: Support and encouragement to contribute to open-source projects and share knowledge with the broader engineering community
- Cross-Functional Experience: Chance to work across different business lines and understand various domains
- Leadership Development: Programs designed to help you develop the skills needed to lead teams and drive strategic initiatives
Work Environment and Culture
arenaflex is more than just a workplace – it's a community where diversity is celebrated, and every voice matters. Our culture is built on these core values:
- Inclusivity: We foster an environment where everyone feels welcome, respected, and valued for their unique perspectives
- Collaboration: We believe that the best solutions come from working together across teams and disciplines
- Innovation: We encourage creative thinking and experimentation, understanding that failure is part of the learning process
- Work-Life Balance: We support flexible work arrangements and prioritize employee well-being
- Continuous Learning: We invest in our people's growth through training, development, and educational opportunities
- Recognition: We celebrate achievements and recognize outstanding contributions
Our Phoenix office offers a modern, state-of-the-art work environment with amenities designed to support your productivity and well-being. While this position is primarily based in Phoenix, we embrace flexible work arrangements that allow our team members to balance their professional and personal lives effectively.
Compensation and Benefits
We recognize that our people are our most valuable asset, and we are committed to providing competitive compensation and comprehensive benefits. In this role, you will receive:
- Competitive Hourly Rate: $28 per hour with opportunities for overtime
- Full-Time Employment: 8-hour workdays with stability and growth potential
- Health and Wellness: Comprehensive health insurance coverage including medical, dental, and vision plans
- Retirement Plans: 401(k) retirement savings plan with company matching
- Paid Time Off: Generous vacation, sick leave, and holiday pay
- Professional Development: Access to training programs, certifications, and educational reimbursement
- Employee Assistance Program: Support for personal and professional challenges
- Various Perks: Additional benefits and perks to support your lifestyle and well-being
Join Our Team
Are you ready to make your mark at arenaflex? We are looking for passionate, high-performing engineers who want to shape the future of technology and make a meaningful impact. If you have the skills, experience, and drive to succeed in this role, we encourage you to apply.
This position offers an exciting opportunity to work with cutting-edge technologies, solve complex challenges, and grow your career in one of the most innovative companies in the industry. You'll be part of a fast-moving, entrepreneurial team that values creativity, collaboration, and excellence.
Note: The proposed employment with arenaflex is conditioned upon the successful completion of a background verification check, subject to applicable laws and regulations.
Apply now and become part of the arenaflex team where innovation meets opportunity!