Sr. Data Engineer
TC for this role is around $450k (base approx. low 200s)
Overview: Senior Data Engineer
We are looking for a highly motivated Senior Data Engineer to be part of the Data Architecture team who’ll work on designing and building robust, scalable data infrastructure to support AI and machine learning projects.
Responsibilities:
Qualifications:
Overview: Senior Data Engineer
We are looking for a highly motivated Senior Data Engineer to be part of the Data Architecture team who’ll work on designing and building robust, scalable data infrastructure to support AI and machine learning projects.
Responsibilities:
- Design and build robust, scalable data infrastructure to support AI and machine learning projects.
- Work closely with business analysts and data scientists to understand complex business problems and translate them into technical solutions.
- Develop and maintain data pipelines for batch and real-time data processing.
- Ensure data quality and integrity by implementing best practices and data governance strategies.
- Optimize data storage for efficient querying and analysis.
- Work closely with a cross section of users in front office, middle office, finance and data governance teams to develop reporting and data analytics capabilities.
- Take requirements for new enhancements, designing, developing, testing and deploying across the front and backend.
- Be able to design, develop, modify, implement, and support software components anywhere in the software stack.
- Determine root cause for the most complex software issues and develop practical, efficient, and permanent technical solutions.
- Stay up to date with emerging technologies and industry trends to drive innovation and maintain competitive advantage.
Qualifications:
- Bachelors/master’s degree in computer science or related engineering fields.
- 5+ years of experience in data engineering with a focus on analytics and AI.
- Proficiency in programming languages such as Python, C#, Scala, Java
- Knowledge of cloud platforms (e.g., AWS, Azure, GCP) and their data-related services.
- Expert with relational database such as MS SQL and one or more of the no-SQL databases such as Hadoop, Cassandra, MemSQL etc.
- Expertise in data modeling, ETL development, and data warehousing.
- Experience with big data tools and frameworks (e.g., Hadoop, Spark).
- Familiarity with machine learning frameworks and libraries.
- Strong analytical and problem-solving skills.
- Experience building distributed systems architecture.
- Experience building 24x7 mission critical systems that have been successfully delivered to customers.
- Experience with software engineering best practices like clean coding, test driven development for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing and operations.
- Understanding of various financial data domains such as reference data, transactional data, market data, derived data such as curves, volatility structures etc. is required.
- Experience working with front office, middle office, risk management functional areas.
- Experience working in an agile environment.
- Excellent analytical and problem-solving skills.
- Excellent organization and time management skills.
- Excellent written and verbal communication skills.
- Ability to exercise discretion and independent judgment in the performance of duties.
- Excellent communication and collaboration abilities.
Apply to this Job
How It Works
Connect.
Meet your dedicated recruiter in person to explore your experience and goals + identify opportunities that fit your skillset and expectations.
Intro call
Be prepared to discuss your background, career goals and expectations. If you’re a fit for our open roles, we’ll schedule an in-person meeting.
Meet & match
Meet your dedicated recruiter in person to explore your experience and goals + identify opportunities that fit your skillset and expectations.
Interview & place
Your Recruiter will work closely with you to submit your resume to open roles and work to secure interviews at top companies.
What our clients are saying about us
Healthcare Startup
We have consistently received excellent service and candidates every time we ask. It has been the best experience I have ever had with an agency.
The LGB&T Community Center
Great support and values alignment with Clarity and our organization.
Simons Foundation
They are great at what they do! Experts in the field and I trust them.They respond quickly to my emails and send over great candidates. I can always count on them!
NS1
Great candidate sourcing, timely responses and making sure that we were satisfied with our chosen candidate. It was a really easy recruitment experience.
DonorsChoose
Working with Clarity has been a really great experience. They really looked for jobs that suit my interest and they’ve been really helpful in the process.
Lincoln Center for the Performing Arts
Clarity has been wonderful! They are responsive, positive, and treat job seekers like people rather than skillsets.
Bain & Co.
I am always giving Clarity Recruiting contact information out to people. This recruiting company changed my life and I am so happy to be where I am now. I couldn’t have done it without you all!
Communications Agency
"Working with Clarity is just easy...they just get it. It's also a two-way relationship. They work to help us find great candidates, and we help them by giving them feedback. Plus, it's fun to work with them!"
Rover
Clarity provided a great pool of vetted candidates and a super helpful and responsive team!
Metropolitan Public Strategies
We chose Clarity because they're a local, women owned firm with an excellent reputation!
Brit + Co.
Clarity is always extremely easy to get in contact with even with last minute requests.
AKQA
Clarity has not only placed me in my current role, they have helped me place other candidates in roles across AKQA as our recruitment partner. Occasionally we need last minute temporary placements for our Reception desk, and Matt always brings in the best candidates.
SYPartners
Always have had great experiences, met strong candidates, and have built wonderful partnerships with the Clarity Team!
Rover
Clarity is awesome! Definitely the best staffing agency I've ever worked with. Highest quality candidates and best communication.
Landor
Every candidate that Clarity sends to Landor has been first-rate!