CrystalLakeRecruiter Since 2001
the smart solution for Crystal Lake jobs

Lead Software Engineer - Streaming Data

Company: Discover
Location: Crystal Lake
Posted on: January 15, 2021

Job Description:

Discover. A brighter future.With Discover, you'll have the chance to make a difference at one of the world's leading digital banking and payments companies. From Day 1, you'll do meaningful work you're passionate about, with the support and resources you need for success. We value what makes each employee unique and provide a collaborative, team-based culture that gives everyone an opportunity to shine. Be the reason millions of people find a brighter financial future, while building the future you want, here at Discover.Job Description----As a Lead Software Engineer - Streaming Data, you will provide engineering leadership to build products that will support our streaming data pipelines and other real-time based solutions.-- You will be on the cutting edge of finding and integrating new technologies/platforms to be used by a large community of companywide engineers.-- We are looking for a talented individual that is strong technically, creative, and can work across many new technologies. ----You will be expected to drive innovation, R&D new solutions and must be able to operate without prescriptive directives from management.Some examples of initiatives you will work on include building out our Change Data Capture platform, Kafka/KSQL DB, and developing our real time data transformation/consumption frameworks. The products your team develops mush have user experience top of mind as we strive to create products that bring delight and efficiencies to our users. You will work with technologies such as Java, Python, Spark & Spark streaming APIs, SQL, Kafka, Qlik Replicate, Snowflake, AWS/Google Cloud services and CI/CD tools.------------------------------Responsibilities

  • Develop data driven solutions utilizing current and next generation technologies to meet evolving business needs.
    • Ability to quickly identify an opportunity and recommend possible technical solutions.
    • Strong desire and capability to automate EVERYTHING
    • Utilize multiple development languages & tools such as Qlik Replicate, Python, Java and SQL to build prototypes and evaluate results for effectiveness and feasibility.
    • Operationalize open source data-analytic tools for enterprise use.
    • Utilize tools available to you across AWS and Google Services
    • Develop real-time data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark, Python, AWS/Google Services
      • Custom Data pipeline development (Cloud and locally hosted)
      • Provide support for deployed data applications and analytical models by being a trusted advisor to Data Scientists and other data consumers by identifying data problems and guiding issue resolution with partner Data Engineers and source data providers.
      • Provide subject matter expertise in the analysis, preparation of specifications and plans for the development of data processes.
        • Ensure proper data governance policies are followed by implementing or validating Data Lineage, Quality checks, classification, etc.
        • Develops and maintains complex front-ends with a focus on user experience
        • Develops and maintains backend systems
        • Works with key stakeholders to design complex solutions and lead from inception to production
        • Creates and maintains DevOps processes, application infrastructure, and utilizes cloud services (including database systems and models)
        • Innovates on and advocates for best practices and improved team processes; mentors junior team members
        • Supports live systems to ensure business continuityRequired Skills
          • Bachelor's Degree in Information Technology, Business, or related field
          • 6+ years of experience in Computer Science, Information Technology, or other related field
          • In lieu of a degree, 8+ years of experience in Computer Science, Information Technology, or other related fieldDesired Skills
            • Deep level understanding and implementation experience across AWS Data Services such as Lambda, Kinesis, SQS/SNS, EMR, S3, Cloudwatch etc..
            • Experience with ELK stack
            • Snowflake MPP Database
            • Deep level understanding and efficiency in the Hadoop technology stack
            • Proficient in Spark application coding
            • Proficient in Java or Python development
            • Expert level knowledge in SQL, and relational databases
            • Strong in Unix / shell scripting
            • Ab Initio experience
            • 4+ years of experience of being a lead engineer amongst a team of equal or junior level developers
            • Excellent written and verbal communication, presentation and professional speaking skills
            • Collaborative individual who excels in working within a team and with business partners --identify, develop and deliver innovative data solutions
            • Ability to demonstrate leadership to managers, and peer level staff.----#LI-KEWhat are you waiting for? Apply today!The same way we treat our employees is how we treat all applicants - with respect. Discover Financial Services is an equal opportunity employer . We thrive on diversity & inclusion. You will be treated fairly throughout our recruiting process and without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status in consideration for a career at Discover.

Keywords: Discover, Crystal Lake , Lead Software Engineer - Streaming Data, IT / Software / Systems , Crystal Lake, Illinois

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Other IT / Software / Systems Jobs

Entry Level Customer Service Representative - $11.00 -
Description: Entry Level Call Center Professional br br Our client located in Itasca is in immediate need for 40 individuals with a customer service background to become part of their fast paced call center. (more...)
Location: Itasca
Posted on: 01/28/2021

Manager of Information Security - Exceptional Direct Placement Job / Downtown Chicago
Description: lt span gt Modis is currently seeking a lt B gt Manager of Information Security lt /B gt for an exceptional Direct Placement opportunity with our Global Legal client, located in the heart of Downtown (more...)
Location: Chicago
Posted on: 01/28/2021

Information Security Architect
Description: Qualifications: br Bachelor's or Master's Degree in Computer Science, Information Systems or other related field or equivalent work experience 7 to 10 years of information security experience. CISSP (more...)
Location: Chicago
Posted on: 01/28/2021

Sr Tester - Restful/API Testing
Description: lt span gt I am looking for a Sr Tester that has experience in Testing Web Services and APIs that are built in house. amp nbsp Must have the following experience: lt br gt amp nbsp lt br gt This MUST (more...)
Location: Northbrook
Posted on: 01/28/2021

Sr. Software Engineer
Description: lt span gt This is a truly special opportunity for any and all .NET Developers in Chicago. amp nbsp This is a brand new opening for senior and mid-level .NET Developers. amp nbsp This positions are (more...)
Location: Chicago
Posted on: 01/28/2021

MS Office Consultant
Description: Dress Attire: PROFESSIONAL EVERY DAY MAKE SURE TO LET THE CANDIDATES KNOW THIS br br Role: We have a need of a MS Office Consultant for a 4 month opportunity located in downtown Chicago IL. The (more...)
Location: Chicago
Posted on: 01/28/2021

Healthcare Business Analysis Specialist
Description: lt span gt lt B gt Job Title: lt /B gt Business Analysis Specialist amp nbsp amp nbsp lt br gt lt B gt Length: lt /B gt Contract lt br gt lt B gt Location: lt /B gt Downtown Chicago, IL (more...)
Location: Chicago
Posted on: 01/28/2021

HRIS Business Analyst
Description: Extrinsic has a direct client in Chicago, IL looking for a junior HRIS Business Analyst to join their full-time
Location: Chicago
Posted on: 01/28/2021

Hiring Immediately-CSR Call Center-$12.26/HR-Rolling Meadows, IL 60008
Description: HIRING IMMEDIATELY-CSR CALL CENTER POSITION- 12.26/HR-ROLLING MEADOWS, IL 60008 br br Job Title: Customer Service Coordinator br br Job Location: Rolling Meadows, IL 60008 Public transport (more...)
Location: Rolling Meadows
Posted on: 01/28/2021

Microsoft Access Developer Job
Description: lt span gt lt B gt Do you love working in the financial industry Do you enjoy being the lead developing user tools for a Fortune 500 company lt /B gt lt br gt amp nbsp lt br gt lt B gt Modis (more...)
Location: Chicago
Posted on: 01/28/2021

Log In or Create An Account

Get the latest Illinois jobs by following @recnetIL on Twitter!

Crystal Lake RSS job feeds