Benefits:
- Competitive salary
- Opportunity for advancement
- Training & development
Lead Data Engineer – Azure Databricks
Location: Charlotte, North Carolina 28273
Work Arrangement: Onsite, 5 days per week
Work Arrangement: Onsite, 5 days per week
Let’s Create Our Future Together at The AES Group
The AES Group is a technology and engineering consulting company with more than 20 years of experience connecting organizations with skilled professionals and innovative solutions across cloud, data, AI, and engineering.
Why Join This Opportunity?
- Lead high-impact enterprise data engineering initiatives
- Mentor and guide a growing team of data engineers
- Work with modern Azure Databricks and cloud data technologies
- Support large-scale data modernization and legacy migration programs
- Collaborate with technical leaders and business stakeholders
- Gain exposure to Power BI, MicroStrategy, Delta Lake, Azure DevOps, and data governance frameworks
Position Overview
The AES Group Inc. is seeking an experienced Lead Data Engineer to support one of our enterprise clients. This role will lead the design, development, and optimization of scalable cloud data platforms while establishing engineering standards and mentoring team members.
The ideal candidate will have recent hands-on experience with Azure Databricks, Python, PySpark, SQL, ETL/ELT development, and modern data warehouse architecture.
Key Responsibilities
- Design and optimize scalable data pipelines and ETL/ELT workflows using Azure Databricks, PySpark, SQL, and Delta Lake.
- Provide technical leadership, mentoring, and guidance to data engineers.
- Improve CI/CD pipelines using Azure DevOps, Git, Terraform, and automated deployment frameworks.
- Establish standards for development, testing, code quality, and release management.
- Ensure data accuracy through integration, transformation, validation, and cleansing processes.
- Use Python and PySpark for automation, data processing, and performance optimization.
- Support migrations from legacy environments to modern cloud data platforms.
- Translate business and technical requirements into scalable data solutions.
- Apply governance and security practices using Unity Catalog, Azure RBAC, managed identities, and access controls.
- Support Power BI reporting environments and provide exposure to MicroStrategy.
- Participate in on-call support and resolve production issues when required.
Required Qualifications
- Bachelor’s degree in Computer Science, Information Systems, Information Technology, or a related field, or equivalent experience.
- At least 3 years of hands-on Azure Databricks experience.
- Strong knowledge of current Azure Databricks features and capabilities.
- At least 5 years of data warehouse analysis, architecture, and design experience.
- Strong knowledge of dimensional modeling, operational data stores, and enterprise integration.
- At least 5 years of ETL/ELT development using Python, PySpark, and SQL.
- Experience with Terraform, Git, CI/CD pipelines, and Azure DevOps.
- Demonstrated experience leading and mentoring data engineering teams.
- Strong communication, problem-solving, and stakeholder-management skills.
Preferred Qualifications
- Databricks Data Engineer Associate or Professional certification.
- Experience with Unity Catalog, Azure RBAC, managed identities, and data governance.
- Familiarity with Power BI and MicroStrategy architecture.
- Experience in regulated, quality-focused, or compliance-driven environments.
Ready to make an impact? Apply now and join us on our journey!
Compensation: $45.00 - $55.00 per hour
AES is a premier technology consulting company that brings together businesses and talent to deliver the most innovative technology solutions that create the most positive impact to society.
In the last 20 years, we have developed innovative best-in-class technology solutions to the world’s forward-thinking companies on four key service areas:
- Customer Experience: engaging customers with differentiating digital experiences to sustain
business relevance
- Employee Experience: enabling employees to learn, collaborate, and grow to sustain business
performance
- Business Solutions: transforming and optimizing business operations to sustain business resilience
- Emerging Technology: exploring and adopting emerging technology to transform business model
Our team ensures that your favorite coffee shop has the right amount of people serving you at any given time. Our team ensures that the governance board of a global company has the right ESG insights to make the most sensible actions for the world. The list goes on and on. At the core of
what we do is creating the future that is right for everyone, with the right technology, and with the right talent.
In the last 20 years, we have developed innovative best-in-class technology solutions to the world’s forward-thinking companies on four key service areas:
- Customer Experience: engaging customers with differentiating digital experiences to sustain
business relevance
- Employee Experience: enabling employees to learn, collaborate, and grow to sustain business
performance
- Business Solutions: transforming and optimizing business operations to sustain business resilience
- Emerging Technology: exploring and adopting emerging technology to transform business model
Our team ensures that your favorite coffee shop has the right amount of people serving you at any given time. Our team ensures that the governance board of a global company has the right ESG insights to make the most sensible actions for the world. The list goes on and on. At the core of
what we do is creating the future that is right for everyone, with the right technology, and with the right talent.
(if you already have a resume on Indeed)
