Data Engineer III – Data Ingestion & Platform Modernization- Remote (Birmingham)
Data Engineer III - Data Ingestion & Platform Modernization Remote (working CST) 6- month contract Pay Rate: $70.00 - $77.00per hr. Our client needs a Data Engineer -This role supports a major enterprise data modernization initiative within a large banking environment. The organization is actively migrating from on-prem systems and a legacy Cloudera-based data lake into a Snowflake-based cloud data platform, while also supporting multiple high-priority business and regulatory initiatives. This position is part of a highly visible engineering team responsible for building and maintaining scalable data ingestion pipelines across multiple enterprise systems. Key Business Initiatives Supported
- Project Turbo (top profitability initiative): improving small business checking processes
- R2 (top deposit initiative): enabling enterprise-wide data availability for testing and iteration
- Open banking regulatory data ingestion (non-Kafka streaming required for this role)
- Enterprise data lake modernization and migration into Snowflake
Core Responsibilities
- Build and support end-to-end data ingestion pipelines from multiple source systems into Snowflake
- Move and transform data from on-prem environments into cloud platforms
- Support ingestion from diverse data sources:
- Flat files
- RDBMS systems (Oracle, SQL Server)
- Mainframe extracts
- SSIS-based pipelines
- Work with ingestion/orchestration tools such as Precisely and Click
- Perform data obfuscation and transformation as required
- Move data into AWS S3 landing zones and Snowflake staging/landing layers
- Develop and optimize SQL for complex transformations and joins
- Support Python-based data engineering scripts and workflows
- Contribute to ingestion pipeline re-engineering and optimization
- Integrate data from enterprise systems including SharePoint and Jira into Snowflake
Required Skills:
- 5+ years of relevant experience
- Strong experience in data engineering and big data environments
- Advanced SQL (complex joins, optimization, performance tuning)
- Python development experience
- Snowflake experience
- Cloudera or similar big data platform experience
- Experience with ingestion tools such as Precisely and Click
- Understanding of enterprise data ingestion patterns
- Experience with multiple data sources (RDBMS, flat files, mainframe, APIs)
Bonus Skills:
- AWS S3 experience
- Experience with Jira and SharePoint data extraction/integration
- Experience working in highly regulated or banking environments