Big Data Engineer (Java or Python, ETL)

Senior Software EngineerLocation: Remote/MA/NH/RI/NJ/NC/TX/UT/KYWill be doing API Development, stream processing and model deployments. API Development experience (will be deploying API's into AWS) and understanding of Kinesis and stream processing. MUST HAVE: Java OR Python, AWS and ETL experience.MANAGER NOTES:Project Information: Will be on the Content Recommendation Engineer Squad and building out processes, recommending content to customer's. Will be doing API Development, stream processing and model deployments.Top must have skills: AWS, Java (middle tier and back end 30/70) and python programming & experience with data movement technologies (ETL/ELT)Preferred skills: API Development experience (will be deploying API's into AWS) and understanding of Kinesis and stream processing.Selling point: Will work with modern cutting edge technologies and work to develop content the customer's see. Also, this role has potential to convert to a FTE down the road and also participate in Learning Day Tuesday.Job Description:The Role:The Customer Data Technology group within CLIENT’s Personal Investing (PI) organization is seeking a Senior Software Engineer to build and maintain large scale data processing systems. In this role, you will apply variety of technologies to develop innovative Big data solutions. This position is a critical element to delivering CLIENT’s promise of creating the best customer experiences in financial services.If you are an experienced Software engineer with a passion for designing and delivering big data solutions using groundbreaking technologies, want to be a part of exciting data simplification journey, looking for a collaborative team environment where you will have wealth of opportunities to innovate and have intellectual curiosity to learn, a career in Customer Data Technologies in PI may be right for you!The Expertise and Skills You BringBachelor’s or Master’s degree in a technology related field (e.g. Engineering, Computer Science, etc.) required.6+ years of experience in software engineering and development4+ years of experience in implementing Big data solutions in data analytics spaceExtensive experience in Object Oriented Programming (Java, Scala, Python)Experience with building data pipelines in getting the data required to build and evaluate ML models, using tools like Apache Spark or other distributed data processing frameworks.Experience Data movement technologies (ETL/ELT), Messaging/Streaming Technologies (AWS SQS, Kinesis/Kafka), Relational and NoSQL databases (Cassandra, Elastic search, Graph database), API and in-memory technologies.Solid understanding of developing highly scalable distributed systems using Open-source technologiesExperience with DevOps, Continuous Integration and Continuous Delivery (Maven, Jenkins, Stash, Ansible, Docker)Solid experience in Agile methodologies (Kanban and SCRUM)Experience in developing applications in Cloud is a plusStrong technical design and analysis skillSolid understanding and technology trends in implementing of Big data ecosystemSolid understating of data architecture patterns such as Lambda, Kappa, Event driven Architecture, Data as a Service, Microservice etc.Designing, Building and supporting mission critical applications to provide the best customer experienceDelivering system automation by setting up continuous integration/continuous delivery pipelinesThe Team: Customer Data Technology in PI supports the platforms that enable business users to collect and analyze the customer data needed to provide the best customer experience.