Senior Data Engineer

Abbott is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals and branded generic medicines. Our 114,000 colleagues serve people in more than 160 countries.

For years, Abbott's medical device businesses have offered technologies that are faster, more effective, and less invasive. Whether it's glucose monitoring systems, innovative therapies for treating heart disease, or products that help people with chronic pain or movement disorders, our medical device technologies are designed to help people live their lives better and healthier. Every day, our technologies help more than 10,000 people have healthier hearts, improve quality of life for thousands of people living with chronic pain and movement disorders, and liberate more than 500,000 people with diabetes from routine ?ngersticks.

Our location in Sylmar, CA, or Santa Clara, CA , currently has an opportunity for a Senior Data Engineer within the Global Data Science & Analytics organization. The Senior Data Engineer will be responsible for designing, building, and maintaining robust data pipelines using Azure Databricks and PySpark. He or she will develop and optimize ETL pipelines, leverage Apache Spark for data processing, and collaborate with data scientists, clinical scientists, and analysts to deliver tailored solutions. The candidate will craft complex SQL queries, apply python/R for advanced data manipulation, and implement stringent data governance practices. The Data Engineer will manage multiple projects concurrently, establish best practices for data quality and security, and troubleshoot data-related issues promptly. He or she will stay abreast of the latest trends in data engineering and communicate effectively with team members and stakeholders.

Responsibilities

• Data Pipeline Development: ?Design, build, and maintain robust data pipelines using Azure Databricks and PySpark, ensuring optimal performance and scalability.

• ETL Implementation: ?Develop and optimize ETL pipelines utilizing Databricks tools to facilitate efficient data processing and transformation.

• Data Processing: ?Leverage Apache Spark for both batch and incremental data processing, ensuring data integrity and consistency.

• Collaboration: ?Work closely with data scientists and analysts to comprehend data requirements and deliver tailored solutions that meet business needs.

• SQL Development: ?Craft and refine complex SQL queries for effective data extraction, analysis, and reporting.

• R Utilization: ?Apply R for advanced data manipulation and statistical analysis, enhancing data insights (nice to have).

• Data Governance: ?Implement stringent data governance practices using tools such as Unity Catalog to ensure data quality, security, and compliance.

• Cloud Integration: ?Integrate Databricks with cloud platforms, with a preference for Azure, to streamline data workflows and enhance accessibility.

• Project Management: ?Manage multiple projects simultaneously, ensuring timely delivery and adherence to high-quality standards.

• Best Practices: ?Establish and enforce best practices for data quality, security, and governance across various projects.

• Issue Resolution: ?Troubleshoot and resolve data-related issues promptly to maintain operational efficiency.

• Continuous Learning: ?Stay abreast of the latest trends and advancements in data engineering to continuously improve processes and technologies.

• Stakeholder Communication: ?Communicate effectively with team members and stakeholders to ensure alignment and successful project outcomes.

• Advanced Databricks and Azure Integration: Utilize advanced Databricks functionalities and integrate with Azure services to optimize data pipelines, develop high-quality code, and implement automation for CI/CD.

Required Qualifications

• Associates Degree (± 13 yrs) Associates or Bachelor's degree in a technical field (Science, Technology, Engineering, or Mathematics) OR an equivalent combination of education and work experience or relevant software certification (e.g. Udacity Nanodegree)

• Minimum 4 years of experience in software development (combination of programming-heavy coursework, school projects, freelance work and professional experience)

Preferred Educational Background: ?

• Bachelor's degree in Computer Science, Engineering, or a related field.

• Professional Experience: ?Demonstrated experience as a Data Engineer or in a similar role, with a strong track record of successful project delivery and 5-9 years of relevant industry experience or education experience (e.g., Master's).

• Technical Expertise: ?Proficiency in Azure Databricks, PySpark, and SQL is essential. Familiarity with Rest API for data extraction andR for data manipulation and analysis is a plus.

• Python Skills: ?Competence in Python for data manipulation and ETL tasks.

• Platform Experience: ?Experience with the Databricks Lakehouse Platform and Databricks SQL.

• Data Experience: experiencewith healthcare data preferred(insurance Claims, EHR and Med Device data, etc).

• Certifications: ?Databricks Certified Data Engineer Associate or Professional certification is highly desirable.

• Hands-on Experience: ?At least 6+ months of hands-on experience performing data engineering tasks with Databricks.

• Project Management: ?Proven ability to manage multiple projects concurrently, delivering high-quality results within deadlines.

• Independent Work: ?Ability to work independently, providing self-guided solutions and demonstrating initiative.

• Problem-solving: ?Exceptional problem-solving skills and meticulous attention to detail.

• Communication Skills: ?Strong communication and collaboration skills, with the ability to work effectively in team settings and engage with stakeholders.

What We Offer

At Abbott, you can have a good job that can grow into a great career. We offer:

• Training and career development, with onboarding programs for new employees and tuition assistance.

• Financial security through competitive compensation, incentives, and retirement plans.

• Health care and well-being programs including medical, dental, vision, wellness, and occupational health programs.

• Paid time off.

• 401(k) retirement savings with a generous company match.

• The stability of a company with a record of strong financial performance and history of being actively involved in local communities.

The base pay for this position is $86,700.00 - $173,300.00. In specific locations, the pay range may vary from the range posted.

An Equal Opportunity Employer

Abbot welcomes and encourages diversity in our workforce.

We provide reasonable accommodation to qualified individuals with disabilities.

To request accommodation, please call or email