Data Pipelines Lead Engineer- Manager

Overview

Data Pipelines Lead Engineer- Manager at KPMG US. This hybrid role is part of the Digital Nexus technology organization.

Responsibilities

• Design, implement, and manage data observability and pipeline solutions; develop and maintain data pipelines to ensure efficient data flow and processing
• Work with application, network, server, and security teams to onboard/troubleshoot data sources
• Integrate observability tools with various data sources and destinations, ensuring seamless data ingestion and routing; monitor and troubleshoot observability environments to ensure optimal performance and reliability
• Collaborate with data producers and consumers to understand use cases and refine data processing workflows; conduct proof of concepts (PoCs) to evaluate new tools and techniques for data observability
• Identify and recommend areas for improvement in existing data monitoring and observability processes
• Create and maintain documentation for configurations, processes, and best practices; stay updated with the latest industry trends and best practices in data observability and monitoring
• Act with integrity, professionalism, and personal responsibility to uphold KPMG\'s respectful and courteous work environment

Qualifications

• Minimum five years of recent experience with data observability and pipeline tools (Splunk, Datadog, Cribl)
• Bachelor\'s degree in computer science, information technology, or a related field is preferred; minimum of a high school diploma or GED is required
• Strong scripting skills (e.g., Python, Bash, PowerShell, JavaScript); experience with data observability tools and practices
• In-depth knowledge of data collection, transformation, and routing methodologies; practical experience with system integration and data flow management
• Knowledge of Configuration Management Database (CMDB) practices and tools; proficiency in Linux and Windows operating systems
• Excellent problem-solving and analytical skills; strong communication and collaboration abilities; ability to work independently and as part of a team in a fast-paced environment