Lead Data Engineer (Big Data)

Company: Wells Fargo
Location: Dublin
Posted on: May 27, 2023

Job Description:

Lead Data Engineer Job Description At Wells Fargo, we are looking for talented people who will put our customers at the center of everything we do. We are seeking candidates who embrace diversity, equity and inclusion in a workplace where everyone feels valued and inspired. Help us build a better Wells Fargo. It all begins with outstanding talent. It all begins with you. About this role: The Enterprise Functions Technology (EFT) group provides technology solutions and support for Risk, Audit, Finance, Marketing, Human Resources, Corporate Properties, and Stakeholder Relations business lines. In addition, EFT provides unique technology solutions and innovation for Wells Fargo Technology, Enterprise Shared Services, and Enterprise Data Management. This combined portfolio of applications and tools are continually engineered to meet the challenges of stability, security, scalability, and speed. Compliance, Legal, Audit & Regulatory Technology (CLAR) provides technology support and development for Legal & Data Controls, Compliance Risk & Audit, Financial Crimes, Front Office and Second Line Risk, Employee Compliance, Regulator Regulations, Market Surveillance, and Regulator Change Management. The Conduct Risk/Complaint Oversight Technology team is seeking a Lead Data Engineer with strong expertise in data pipeline, ETL and Big Data technology. We have multiple exciting new projects using modern frameworks, CI/CD, and cloud technologies to help our business partners to be more efficient and effective in their risk management activities. A successful candidate will be able to demonstrate strong technical skills as well as leadership and mentoring expertise. In this role, you will:

• Lead moderately complex initiatives within Technology and contribute to large scale data processing framework initiatives related to enterprise strategy deliverables
• Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting
• Review and analyze moderately complex business, operational or technical challenges that require an in-depth evaluation of variable factors
• Oversee the data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis
• Resolve moderately complex issues and lead teams to meet data engineering deliverables while leveraging solid understanding of data information policies, procedures and compliance requirements
• Collaborate and consult with colleagues and managers to resolve data engineering issues and achieve strategic goals
• Provide guidance to less experienced staff
• The candidate must be experienced in various Software Development Lifecycle (SDLC) methodologies, including Waterfall and Agile, and have a solid understanding of technology and data.
• Collaborate and consult with peers, colleagues, and mid-level managers to resolve technical challenges and achieve goals Required Qualifications, US:
  • 5+ years of Database Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
  • 5+ years of data management experience.
  • A BS/BA degree or higher
  • 4+ years of experience writing Microsoft SQL Server and/or Oracle relational database queries, stored procedures ,query optimization and performance tuning
  • 2+ years of strong experience in Big Data technologies such as Python, Hive, and Spark
  • 4+ years in development of data pipelines/ETL for data ingestion, data preparation, data integration, data aggregation, feature engineering, etc.
  • 4+ years of experience with Software Development Life Cycle (SDLC) tools
  • 2+ years of experience with Agile in a development environment Desired Qualifications:
    • 3+ years of Autosys experience or scheduling tool experience
    • SSIS or Ab-Initio Experience
    • Experience in development of Scala/Spark frameworks for data ingestion and transformation
    • Data Modelling
    • Good knowledge of real-time streaming via kafka
    • ETL (Extract, Transform, Load) Programming experience.
    • Experience with other scripting languages such as Bash, PowerShell, Shell, or VBScript.
    • Experience with MongoDB and other BigData Tools such as Hadoop etc.
    • Experience with Cloud Environment such as Pivotal Cloud Foundry, GCP or MS Azure
    • Experience leading projects that require integration of multiple technology systems to deliver new online functionality and user experience
    • Knowledge and understanding of technology architecture: leading and designing conceptual, logical and physical architecture
    • Strong verbal, written, and interpersonal communication skills
    • Reporting experience, analytics experience or a combination of both We Value Diversity At Wells Fargo, we believe in diversity, equity and inclusion in the workplace; accordingly, we welcome applications for employment from all qualified candidates, regardless of race, color, gender, national origin, religion, age, sexual orientation, gender identity, gender expression, genetic information, individuals with disabilities, pregnancy, marital status, status as a protected veteran or any other status protected by applicable law. Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements. Candidates applying to job openings posted in US: All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process. Drug and Alcohol Policy Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy to learn more.

Keywords: Wells Fargo, Columbus , Lead Data Engineer (Big Data), Engineering , Dublin, Ohio