Senior Data Engineer

Company: Discover
Location: Crystal Lake
Posted on: May 15, 2022

Job Description:

Discover. A brighter future. With us, you'll do meaningful work from Day 1. Our collaborative culture is built on three core behaviors: We Play to Win, We Get Better Every Day & We Succeed Together. And we mean it "" we want you to grow and make a difference at one of the world's leading digital banking and payments companies. -We value what makes you unique so that you have an opportunity to shine. Come build your future, while being the reason millions of people find a brighter financial future with Discover. Job Description - At Discover, be part of a culture where diversity, teamwork and collaboration reign. Join a company that is just as employee-focused as it is on its customers and is consistently awarded for both. We're all about people, and our employees are why Discover is a great place to work. Be the reason we help millions of consumers build a brighter financial future and achieve yours along the way with a rewarding career. Responsible for applying a hands-on approach with next-generation technologies to contribute to the team by designing and developing the latest data-driven platforms and next-generation analytic technologies. - What You'll Do As part of our Enterprise Data Management team, you'll: Develop data-driven solutions with current and next generation technologies to meet evolving business needs. Provide technical design and develop Extract/Transform/Load (ETL) applications that interface with all key Discover applications. How You'll Do It Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks. - Deploy and provide support for application codes and analytical models. Provide senior-level technical consulting to peer data engineers during design and development for highly complex and critical data projects. Create and enhance data solutions that enable seamless integration and flow of data across the data ecosystem. - Provide business analysis and develop ETL code and scripting to meet all technical specifications and business requirements according to the established designs. - Develop real-time data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark, Python and AWS-based solutions. - Work extensively within the Cloud ecosystem and migrate data from Teradata to AWS-based platform. - Utilize multiple development languages/tools such as Ab Initio,Python, SPARK, Hive, Java to build prototypes and evaluate results for effectiveness and feasibility. - Develop application systems that comply with the standard system development methodology and concepts for design, programming, backup, and recovery to deliver solutions that have superior performance and integrity. - Contribute to determining programming approach, tools, and techniques that best meet the business requirements. - Provide subject matter expertise in the analysis, preparation of specifications and plans for the development of data processes. - Offer system support as part of a support rotation with other team members. - Operationalize open source data-analytic tools for enterprise use. - Ensure data governance policies are followed by implementing or validating data lineage, quality checks, and data classification. - Understand and follow the company development lifecycle to develop, deploy and deliver the solutions. - - Qualifications You'll Need The Basics: - Bachelor's degree in computer science, or related field - 2+ years of experience in data platform administration/engineering - Bonus Points If You Have 4+ years of experience in data platform administration/engineering - Knowledge and experience using query languages (SQL, Cypher) for relational, No SQL and graph databases - Willingness to continuously learn & share learnings with others - Capability to collaborate with stakeholders and project leaders to understand requirements, deliverables, and set expectations on tasks that you will be responsible for Strong analytical and problem solving skills Execute tasks with quality Ability to work in a fast-paced, rapidly changing environment Experience working in an agile and collaborative team environment - Excellent written and verbal communication, presentation and professional speaking skills Passion for learning and interest in pursuing classroom training and self-discovery on a variety of emerging technologies Hands-on experience with Amazon Web Services (AWS)-based solutions such as Lambda, Dynamodb and S3. Experience with Ab Initio or other ETL tools and components Experience in agile processes and methodology - Experienced with Kafka and Python Demonstrated experience with transforming business needs into data design and solutions Expertise with open-source, ETL scripting and processes and related tools Hands-on experience with Snowflake and Teradata Experience in migrating ETL processes (not just data) from relational warehouse databases to AWS-based solutions Experience within the financial industry - #Remote #BI-Remote #LI -CM At Discover , be part of a culture where diversity, teamwork and collaboration reign. Join a company that is just as employee-focused as it is on its customers and is consistently awarded for both. We are all about people, and our employees are why Discover is a great place to work. Be the reason we help millions of consumers build a brighter financial future and achieve yours along the way with a rewarding career. What are you waiting for? Apply today! The same way we treat our employees is how we treat all applicants - with respect. Discover Financial Services is an equal opportunity employer (EEO is the law) . We thrive on diversity & inclusion. You will be treated fairly throughout our recruiting process and without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status in consideration for a career at Discover.

Keywords: Discover, Crystal Lake , Senior Data Engineer, Engineering , Crystal Lake, Illinois