Data Engineer

Data Engineer

Position: Advanced Data Engineer Location: Charlotte, NC or Denver, CO (Onsite 4 days/week) Contract Length: 12+ months

Overview

We are seeking an experienced Advanced Data Engineer to join our team in either Charlotte, NC or Denver, CO. This role will focus on building and optimizing data pipelines, enabling automation, and supporting analytics and visualization initiatives. The ideal candidate will be hands-on with modern data engineering tools, cloud platforms, and automation frameworks, with the ability to collaborate across teams and drive efficiency in data workflows.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Prefect to ensure efficient data flow.
• Build and optimize data storage and querying solutions with AWS services (Athena, Redshift, S3, Lambda).
• Develop automation scripts and workflows using Python.
• Manage infrastructure as code with Terraform to ensure consistent, reliable deployments.
• Support CI/CD processes for data engineering workflows.
• Create data visualizations and dashboards using JavaScript frameworks and tools like Tableau.
• Analyze data flows across SAP systems and cloud platforms to optimize performance.
• Partner with internal teams to report and track cloud costs across AWS, GCP, and Azure.
• Troubleshoot pipeline issues, ensuring data integrity and reliability.
• Contribute to ongoing efforts in cloud migration and cloud cost optimization.

Minimum Qualifications

• Proven experience as a Data Engineer or similar role.
• Hands-on expertise with Prefect, AWS (Athena), Python, Terraform, and JavaScript.
• Strong understanding of CI/CD pipelines and automation practices.
• Familiarity with cloud cost optimization across AWS, GCP, and/or Azure.
• Strong problem-solving and troubleshooting skills.
• Excellent communication and collaboration abilities.
• Bachelor's degree in Computer Science, Engineering, or related field (advanced degree a plus).

Preferred Qualifications

• Experience with AWS Redshift, S3, and Lambda.
• Background in FinOps or cloud financial management.
• Familiarity with machine learning frameworks and integration into data pipelines.
• Ability to thrive in a fast-paced, evolving environment.