Sr Analyst, Data Engineering

Company: Nationwide Insurance
Location: Columbus
Posted on: January 17, 2020

Job Description:

Position Background The Property and Casualty Analytics team at Nationwide Insurance has open positions from entry to senior Big Data Engineers. The team builds curated data sets to provide foundational data to other analytics, machine learning, and statistical teams. The team curates auto and property damage, medical claims and other insurance claims data along with master data views for associates, members, providers, and legal counsel. Our solutions include analytical applications for workflow productivity, financial performance, client and consumer satisfaction, customer journeys, and industry benchmarks. Our data engineers use big data technology to create best-in-industry analytics capabilities. This position is an opportunity to use Spark ecosystem tools and technology for micro-batch and streaming analytics. You will be creating data ingestion, standardization, metadata,, business rules, data augmentation, and statistical computation against data sources that include relational, XML, JSON, streaming, REST API, and unstructured data. The role has responsibility to understand, prepare, process and analyze data to drive operational, analytical and strategic business decisions. The Big Data Engineer will work closely with product owners, business insight team members, data scientists, and data governance positions.-- We look for engineers who start with a base of big data skills in programming and SQL but who also love to learn new tools and techniques in a big data landscape that is endlessly changing. Responsibilities: Build end to end data flows from sources to fully curated and enhanced data sets. This can include the effort to locate and analyze source data, create data flows to extract, profile, and store ingested data, define and build data cleansing and imputation, map to a common data model, transform to satisfy business rules and statistical computations, and validate data content. Produce data building blocks, data models, and data flows for varying client demands such as dimensional data, data feeds, dashboard reporting, and data science research & exploration Understand current SAS and other application processes and determine the best method to enhance or re-factor into Nationwide's AWS data environment. Participate as both leader and learner in team tasks for architecture, design and analysis Automate and support production processes Coordinate within collocated on-site teams as well as remote team members Mentor other data engineers on the team in areas where your skills are advanced Minimum Qualifications -- Unix commands and scripting typically used in programming and automating processes Advanced SQL programming used to build complex data processes Programming experience in a language (preferred Python) Demonstrated capability to communicate the issues, complexities, and usefulness of a business data domain area from a prior role Experience building a data pipeline and understanding of typical data issues and programming solutions Preferred Qualifications Insurance and claims expertise or demonstrated mastery of a business function such as sales, HR. etc. Experience programming in Spark SQL, Dataframes, and PySpark Experience with AWS S3, Glue, and streaming products Experience with DataBricks Experience with development of metadata-driven and fully parameterized programming methods Produce automated tests of data flow components Use knowledge of the business to automate business-specific tests for data content quality Automate code deployment and promotion Build automated orchestration and error handling for use by production operation teams Diagnose and resolve technical issues or defects from production applications built by you and your team Design experience using best practices in building a data pipeline Experience in scrum team and working from business stories to task out and estimate work effort Nice to Have Qualifications Spark ML experience, streaming of Kafka experience

Keywords: Nationwide Insurance, Columbus , Sr Analyst, Data Engineering, Engineering , Columbus, Ohio