Sr Architect,Systems

Job Description

Design and build production-grade data pipelines spanning source ingestion, bronze landing, silver transformation, and gold-layer data product delivery within the squad's domain scope. Own pipeline KTLO (Keep the Lights On) for assigned data products, including monitoring, alerting, incident response, and ongoing reliability improvements. Implement data ingestion patterns for assigned source systems including batch file ingestion, API-based ingestion, and event-driven streaming (Kafka, Azure Event Hub) depending on squad scope. Apply medallion architecture (bronze, silver, gold) and Fabric IQ certification standards consistently across all data product builds. Collaborate with System Analysts to implement field-level transformations, business rule logic, and data quality checks as specified in product requirements documentation. Participate in and contribute to pipeline design reviews, ensuring solutions align with the organization's Databricks and Fabric engineering standards. Support the migration and deprecation of legacy platforms including SCOpsBI SQL Server and SAP boundary systems, following the organization's extract, validate, rebuild, cutover, and decommission pattern. Write and maintain comprehensive pipeline documentation including data lineage, transformation logic, SLA definitions, and dependency maps. Contribute to the organization's DevOps and engineering reliability practices including CI/CD pipeline setup, testing frameworks, and incident runbooks. Support and collaborate with junior data engineers within the squad, sharing knowledge and providing guidance on day-to-day engineering tasks.

Required Skills