Data Engineer - IT Sustainability

Data Engineer

Costco IT is responsible for the technical future of Costco Wholesale, the third largest retailer in the world with wholesale operations in fourteen countries. Despite our size and explosive international expansion, we continue to provide a family, employee centric atmosphere in which our employees thrive and succeed.

This is an environment unlike anything in the high-tech world and the secret of Costco's success is its culture. The value Costco puts on its employees is well documented in articles from a variety of publishers including Bloomberg and Forbes. Our employees and our members come FIRST. Costco is well known for its generosity and community service and has won many awards for its philanthropy. The company joins with its employees to take an active role in volunteering by sponsoring many opportunities to help others.

Come join the Costco Wholesale IT family. Costco IT is a dynamic, fast-paced environment, working through exciting transformation efforts. We are building the next generation retail environment where you will be surrounded by dedicated and highly professional employees.

Data Engineers are responsible for developing and operationalizing data pipelines to make data available for consumption (reports and advanced analytics). This includes data ingestion, data transformation, data validation/quality, data pipeline optimization, orchestration; and engaging with DevOps Engineer during CI/CD. The role requires a grounding in programming and SQL, followed by expertise in data storage, modeling, cloud, data warehousing, and data lakes. The Data Engineer works closely with Data Architects, Data Scientists and BI Engineers to design and maintain scalable data models and pipelines.

The Data Engineer is responsible for developing data pipelines and/or data integrations across the IT Sustainability stack. This is a new team at Costco and will be fast paced, highly visible, supporting the business goals by being an industry leader in this space. This role is focused on data engineering to build and deliver automated data pipelines from a plethora of internal and external data sources. The Data Engineer will partner with product owners, engineering and data platform teams to design, build, test and automate data pipelines that are relied upon across the company as the single source of truth.

This new team within Costco is primarily focused on providing technical solutions to support Costco's Sustainability Commitment and work towards a more sustainable future for our members, employees, suppliers, shareholders, communities, and the environment. It is a fast-paced and highly visible team, supporting the business goals by being an industry leader in this space.

Builds data models and develops data pipelines to store data in defined data models and structures. Identifies ways to improve data reliability, efficiency and quality of data management. Conducts ad-hoc data retrieval for business reports and dashboards. Assesses the integrity of data from multiple sources. Manages database configuration including installing and upgrading software and maintaining relevant documentation. Develops and operationalizes data pipelines to create enterprise certified data sets that are made available for consumption (BI, Advanced analytics, APIs/Services). Works in tandem with Data Architects, Data Stewards and Data Quality Engineers to design data pipelines and recommends ongoing optimization of data storage, data ingestion, data quality and orchestration. Designs, develops, & implements ETL/ELT processes using Informatica Intelligent Cloud Services (IICS). Uses Google Cloud and Azure services such as Azure SQL DW (Synapse), ADLS, Azure Event Hub, Cosmos, Databricks, Delta Lake to improve and speed up delivery of our data products and services. Implements big data and NoSQL solutions by developing scalable data processing platforms to drive high-value insights to the organization. Identifies, designs, and implements internal process improvements: automating manual processes, optimizing data delivery. Communicates technical concepts to non-technical audiences both in written and verbal form. Performs peer reviews for other data engineer's work.

5+ years' experience engineering and operationalizing data pipelines with large and complex datasets. 3+ years' hands-on experience with Informatica PowerCenter and/or IICS. 4+ years' experience working with Cloud technologies such as Data flow, Data Fusion, Pub/Sub, Dataform, dbt, GCS, Bigquery, Cloud SQL, Firestore/ Datastore, Apigee ADLS, Azure Databricks, Spark, Azure Synapse, Cosmos DB, and other big data technologies. Extensive experience working with various data sources (DB2, SQL,Oracle, flat files (csv, delimited), APIs, XML, JSON. Advanced SQL skills required. Solid understanding of relational databases and business data; ability to write complex SQL queries against a variety of data sources. 3+ years' experience with Data Modeling, ETL, and Data Warehousing. Strong understanding of database storage concepts (data lake, relational databases, NoSQL, Graph, data warehousing).

Azure or Google datacloud certifications. Experience implementing data integration techniques such as event/message-based integration (Kafka, Azure Event Hub), ETL. Experience with Git/Azure DevOps. Experience delivering data solutions through agile software development methodologies. Exposure to the retail industry. Excellent verbal and written communication skills. Experience with UC4 Job Scheduler. Proficient in Google Workspace applications, including Sheets, Docs, Slides, and Gmail.

Cover Letter

Resume

Pay Ranges:

Level 1 - $85,000 - $110,000

Level 2 - $105,000 - $135,000

Level 3 - $130,000 - $160,000

Level SR - $150,000 - $190,000, Bonus and Restricted Stock Unit (RSU) eligible

Level STF - $180,000 - $225,000, Bonus and Restricted Stock Unit (RSU) eligible

We offer a comprehensive package of benefits including paid time off, health benefits - medical/dental/vision/hearing aid/pharmacy/behavioral health/employee assistance, health care reimbursement account, dependent care assistance plan, short-term disability and long-term disability insurance, AD&D insurance, life insurance, 401(k), stock purchase plan to eligible employees.