inhousefyi
← Back to listings

Senior Data Engineer

Berkadia IndiaBengaluru, Karnataka, India · Posted 3 months ago
Full-time
Apply now

Description

Berkadia Services India Pvt Ltd

-----------------------------------------------------------------------------------------------

Integrity is Everything I We Take the Long View I We believe People Matter I We Stand for Excellence I We Love our Jobs I We Innovate

Job title: Senior Data Engineer

Department: Innovation Technology

Location: Bangalore

Full Time – Hybrid work model (subject to Berkadia policy changes)

Working Hours Split Shift (3:00pm to 12:00am)

The Opportunity

As a member of the Data Pipeline team you’ll be at the center of building our platform that enables us to redefine the Commercial Real Estate industry. We’re building a data pipeline that merges with the tested design of data warehousing and the latest big data technologies. You will be designing and building data projects while securing core data elements.

In this role, individual will be required to work on one or multiple aspects of Innovation verticals with the following key responsibilities –

  • Research new technology and share knowledge with team and peers
  • Design, implement and release data applications in AWS using big data technologies
  • Coordinate development efforts across the organization
  • Influence team in development standards and processes
  • Teach and mentor peers
  • Other duties as assigned

Your Qualification

Education:

  • Bachelor’s degree in information technology, Computer Science, Data Engineering, Information Systems, or a closely related technology field; or equivalent practical experience.
  • Preferably Post Graduate degree with a focus in Computer Science, Machine Learning, Data Engineering or Data Science.

Qualifications:

Qualifications to perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the experience required:

  • 7+ years of professional experience in data engineering or a closely related field.
  • 5 - 7 years of hands-on data engineering with end-to-end ownership of optimized ingestion & transformation data flows.
  • Proven experience building and maintaining ETL/ELT pipelines using tools/frameworks such as PostgreSQL, Docker, Apache Airflow, AWS Step Functions, or similar.
  • 5+ years of experience building high-performance algorithms in scalable languages such as Scala, Python and R
  • Strong expertise in SQL (complex queries, performance tuning, analytical functions) & Python (PySpark).
  • Proven ability to understand complex requirements, provide concise updates and maintain project timelines.
  • Proven experience mentoring junior engineers and performing code reviews
  • Strong logical, analytical, problem solving and reporting skills
  • 5+ years’ experience with cloud computing in AWS (EMR, AirFlow, Spark, S3, etc…)

Similar jobs

MachinifyRemote

Est. 140,000 USD

Machinify is a leading healthcare intelligence company with expertise across the payment continuum, delivering unmatched value, transparency, and efficiency to health plan clients across the country. Deployed by over 85…

Full-timeRemote

Est. 140,000 USD

At Diverge Health we are passionate about improving health access and outcomes for those most in need. We partner with primary care providers to improve the engagement and management of their Medicaid patients, offering…

Full-timeRemote
Vulcan ElementsDurham, North Carolina, United States

Est. 124,000 USD

Vulcan Elements is manufacturing American rare-earth permanent magnets for a secure, resilient future. With a focus on national security and economic resiliency, we serve critical industries such as defense, aerospace, a…

Full-time
K2 SpaceLos Angeles, California, United States

Est. 140,000 USD

K2 is building the largest and highest-power satellites ever flown, unlocking performance levels previously out of reach across every orbit. Backed by over $1 billion in total funding from leading investors including Alt…

Full-time
FleetworthyRemote

Fleetworthy offers the only complete technology suite for fleet readiness, uniting safety and compliance, toll management, and weigh station bypass solutions. We help fleets streamline operations, control costs, and oper…

Full-timeRemote
Accordion IndiaHyderabad, India

Company Overview Accordion works at the intersection of sponsors and management teams throughout every stage of the investment lifecycle, providing hands-on, execution-focused support to elevate data and analytics capabi…

Full-time
CoupangMountain View, California, United States

Est. 175,000 USD

Company Introduction We exist to wow our customers. We know we’re doing the right thing when we hear our customers say, “How did I ever live without Coupang?” Born out of an obsession to make shopping, eating, and living…

Full-time
ZafinTrivandrum, India

Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered. Our technology enables organizations to move faster while maintaining the governance, accou…

Full-time
CentralReachRemote

Est. 124,000 USD

CentralReach is a leading provider of autism and IDD care software for Applied Behavior Analysis (ABA), multidisciplinary therapy, and special education. Trusted by more than 200,000 users, we enable therapy providers, e…

Full-timeRemote
FanDuelEdinburgh, Scotland, United Kingdom

Est. 60,000 GBP

THE POSITION Our roster has an opening with your name on it We're looking for a Software Engineer to join one of our Core Marketing Platforms teams, where you'll build and optimize high-performance microservices that pow…

Full-time
TRG Screen (Referrals)Bengaluru, India

Role Overview We are seeking a Senior Java Backend Engineer to join TRG Screen’s engineering team. You will design, develop, and maintain backend components of our software products, working on large, complex codebases a…

Full-time
Data Engineer1 month ago
KonovoBengaluru, Karnataka, India

Konovo is a global healthcare intelligence company on a mission to transform research through technology- enabling faster, better, connected insights. Konovo provides healthcare organisations with access to over 2 millio…

Full-time
HyporiRemote

Est. 140,000 USD

Hypori, Inc. is a high-growth cybersecurity SaaS company transforming how organizations think about secure mobility. Our virtual workspace platform enables users to access enterprise apps and data from any mobile device—…

Full-timeRemote
NortalRemote

Est. 100,000 USD

Explore the Nortal experience! Join our close-knit LATAM remote team: Connect through fun activities like coffee breaks, tech talks, and games with your team-mates and management. Say goodbye to micromanagement! We champ…

Full-timeRemote
Spaulding RidgeToronto, Ontario, Canada

Spaulding Ridge is an advisory and IT implementation firm. We help global organizations get financial clarity into the complex, daily sales, and operational decisions that impact profitable revenue generations, efficient…

Full-time
Spaulding RidgeChicago, Illinois, United States

Est. 140,000 USD

Spaulding Ridge is an advisory and IT implementation firm. We help global organizations get financial clarity into the complex, daily sales, and operational decisions that impact profitable revenue generations, efficient…

Full-time
Java Developer1 month ago
IntelliDyneWashington, District of Columbia, United States

Est. 124,000 USD

Java Developer Location: Washington, DC Classification: Exempt Clearance: Secret Position Overview We are seeking a highly motivated and detail-oriented Java Developer to support the design, development, and maintenance…

Full-time
Java Developer1 month ago
IntelliDyne Jobs for VeteransWashington, District of Columbia, United States

Est. 124,000 USD

Java Developer Location: Washington, DC Classification: Exempt Clearance: Secret Position Overview We are seeking a highly motivated and detail-oriented Java Developer to support the design, development, and maintenance…

Full-time
AutoTrader.caToronto, Ontario, Canada

We are a Canadian leader in digital automotive solutions. Our flagship brands -AutoTrader.ca, AutoSync, Dealertrack Canada and CMS - help Canadians buy, sell, and finance vehicles with confidence. AutoTrader.ca is Canada…

Full-time

Est. 155,000 USD

Elite is the trusted automation platform for law firm operations across most of the world’s largest and most successful law firms. Elite has guided firms through every technology shift and today delivers the only cloud-n…

Full-timeRemote
SRS AcquiomRemote

Est. 152,500 USD

About SRS Acquiom SRS Acquiom delivers the smartest way to run a deal™ through a platform and services designed to help deal parties manage complex M&A and loan agency transactions more efficiently. Based in Denver,…

Full-timeRemote
AgodaBangkok, Thailand

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore…

Full-time
AgodaBangkok, Thailand

About Agoda At Agoda, we bridge the world through travel. Our story began in 2005, when two lifelong friends and entrepreneurs, driven by their passion for travel, launched Agoda to make it easier for everyone to explore…

Full-time
Lightspeed DMSSouth Jordan, Utah, United States

Est. 115,000 USD

Company Overview: Lightspeed is the leading provider of cloud-based software for dealerships, serving the Powersport, Marine, RV, Trailer, and Golf Car industries adding hundreds of dealerships to the Lightspeed communit…

Full-time
TruvetaRemote

Est. 115,000 USD

Solutions Analyst Truveta is the world’s first health provider led data platform with a vision of Saving Lives with Data. Our mission is to enable researchers to find cures faster, empower every clinician to be an expert…

Full-timeRemote
Data Engineer6 months ago
Inspire11Remote

Est. 114,000 USD

Data Engineer – Inspire11 Elevens, as we call ourselves here, are curiously smart, creative, and dedicated to the highest standard of quality. By being true to ourselves and others, we create a respectful environment tha…

Full-timeRemote
Genius SportsLondon, England, United Kingdom

Est. 90,000 GBP

By bringing together next-gen technology and the finest live data available, Genius Sports is enabling a new era of sports for fans worldwide, delivering experiences that are more immersive, interactive and personalized…

Full-time
Anduril IndustriesBroomfield, Colorado, United States

Est. 124,000 USD

Anduril Industries is a defense technology company with a mission to transform U.S. and allied military capabilities with advanced technology. By bringing the expertise, technology, and business model of the 21st century…

Full-time
Anduril IndustriesWaltham, Massachusetts, United States

Est. 124,000 USD

Anduril Industries is a defense technology company with a mission to transform U.S. and allied military capabilities with advanced technology. By bringing the expertise, technology, and business model of the 21st century…

Full-time
OnBoardRemote

Est. 141,000 USD

Senior Cloud Engineer Function: Engineering Reports to: Director, Platform Engineering Location: Remote - based in the United States, working EST hours Position Summary: As a Sr. Cloud Engineer, you will provide guidance…

Full-timeRemote