Description
Position Purpose: To be part of an existing team to create, maintain, support and improve upon existing internal production applications to speed up delivery of products to our customers. This will also include the implementation of new business rules and functionality the business deems required.
Key Responsibilities:
- Develop technical solutions that help achieve business and customer goals. Be able to provide clear feedback to technical and project teams upon encountering technological limitations.
- Be part of the ongoing development and support of any new solutions, as well as existing legacy production processing systems to agreed estimates and schedules.
- A demonstrated focus on continuous improvement and process optimisation of new and existing systems.
- Work with project management to assist in work breakdowns and estimates as required.
- Ensure documentation is created and maintained with a view to enabling ongoing development support (and where possible improvement) as well as handing over ongoing processing to the existing production team.
- Ensure ongoing code quality, data quality checking, error reporting and correction occurs.
Essential Subject Skills and Experience:
- 2+ years of E2E In-depth Databricks experience on a real project(s) that have gone to production
- Databricks Genie, AI/BI Dashboards and Analytics reporting.
- Databricks pipelines, warehouse, jobs.
- Databricks Platform set up and admin, cost reduction.
- Databricks ELT, CDC, Streaming - general ETL and ELT and ETL/ELT scaling. Databricks Ingestion tools, e.g., SQL Server Connect
- Development of Databricks applications, ‘App’ and ‘One’ experience.
- Strong experience with Delta Lake, Lakehouse and Medallion architectures, Data architecture
- Meta data catalogs and data governance - Databricks Unity catalog.
- Strong data modelling/data expertise.
- Understanding of AI and Ml.
- General computing experience, AWS, S3, CI/CD, Git, SDLCs, Agile/Iterative.
- Excellent communication and time management skills
- Strong analytical and problem-solving skills
- Be flexible/adaptable and can embrace change
Desirable Skills and Experience:
- DB/Spark performance and optimization.
- Strong Apache Spark and pyspark - created Spark clusters, Spark (and Kafka) Streaming, Data pipelines/orchestration.
- Strong Python and Dash development experience.
- Advance SQL, with materialized views, Common Table Expressions.
- Statistics, Machine Learning, data mining, Experimental design.
- MLFlow, AI training/testing/evaluation and its orchestration.
- GenAI, LLMs, Prompt Engineering, RAG, Fine Tuning, Agents.
- AI ways of working, e.g. CRISP-DM, TDSP etc.
Similar jobs
CSQ327R50 Databricks is redefining what organisations can achieve with data and AI. As the unified platform powering the world's most ambitious data-driven enterprises, we sit at the intersection of cloud migrations, AI…
CSQ227R215 As a Senior Designated Engineer and tech subject matter expert, you will partner closely with our Field and Engineering teams to deliver high-touch specialized support and tailored technical solutions for Data…
CSQ227R215 As a Staff Designated Engineer and tech subject matter expert, you will partner closely with our Field and Engineering teams to deliver high-touch specialised support and tailored technical solutions for Datab…
CSQ427R211 Databricks is redefining what organisations can achieve with data and AI. As the unified platform powering the world's most ambitious data-driven enterprises, we sit at the intersection of cloud migrations, AI…
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
FEQ427R339 Location: Melbourne or Sydney As a Specialist Solutions Architect (SSA), you will be the trusted technical ML & AI expert to both Databricks customers and the Field Engineering organization. You will work…
FEQ427R98Location: Sydney At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data…
CSQ127R179 Mission The Manager (Data & AI) for Technical Solutions Engineering will be responsible for leading and growing a regional team of Data & AI technical experts in India, focused on providing resiliency…
Est. 84,000 PLN
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…
CSQ327R30 At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the the Databricks Data Intelligence Platform. As a Delivery Solutions Architect (DSA), you w…
CSQ327R141 As a Resident Solutions Architect in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will…
P-1377 Mission As a Senior ML and AI Technical Solutions Engineer, you play a critical role by helping customers debug and maintain stable GenAI and ML Workloads with AI agent systems using the Databricks Platform. You w…
Est. 120,000 GBP
ReqID: FEQ327R328 Recruiter: Kanwal Matharu Location: London, United Kingdom - Hybrid Skills: Data Science, Machine Learning, AI, LLM, GenAI As a Senior Specialist Solutions Engineer (SSE), ML Engineering, you will be th…
CSQ327R248 As a Forward Deployed Engineer in our Forward Deployed Engineering team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You w…
CSQ427R20 At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the the Databricks Data Intelligence Platform. As a Sr. Delivery Solutions Architect (Sr. DSA…
Est. 165,000 USD
P-1388 As a Sr. Manager of the Data & AI Support Engineering team, you will lead and manage a team of Technical Solutions Engineers responsible for driving deep technical resolutions for complex customer issues acros…
Est. 120,000 GBP
CSQ427R31 At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the the Databricks Data Intelligence Platform. As a Delivery Solutions Architect (DSA), you w…
Est. 90,000 GBP
Req ID: FEQ327R439 x 2 New roles Recruiter: Dina Hussain Location: London (or surrounding areas) At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer-cen…
Est. 120,000 GBP
ReqID: FEQ327R501 Location: London Skills: Data Science, Machine Learning, AI, LLM, GenAI Mission As a Senior Specialist Solutions Architect (ML & AI), you will serve as the trusted technical ML and AI expert for Dat…
P-1562 As a Leader within the Premier Support team at Databricks, you’ll be responsible for leading and managing a team of Designated Support Engineers which deliver white-glove support experiences for Databricks’ enterp…
FEQ327R87 Location: Melbourne At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes…
Est. 80,000 EUR
CSQ427R196 At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the the Databricks Data Intelligence Platform. As a Delivery Solutions Architect (DSA), you…
Est. 120,000 GBP
JOB ID: FEQ227R117 Location: London, United Kingdom Industry: Professional Business Services (Consultancy, Legal, etc) At Databricks, our core values are at the heart of everything we do. A culture of proactiveness and a…
FEQ427R64 Location: Brisbane At Databricks, our core principles are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes d…
Project Description We are looking for an experienced Data Engineer with deep expertise in Databricks to join our advanced analytics and data engineering team. The ideal candidate will play a key role in designing, build…
Est. 90,000 EUR
P-1448 About the Role Databricks is seeking an experienced Sr. Designated Support Engineer/Premier Support Engineer with a strong technical foundation in Apache Spark and a passion for customer engagement. This self-moti…
CSQ227R247 The Engagement Manager is responsible for helping customers accelerate value through the adoption of the Databricks platform working with them defining and orchestrating the required engagement to ensure succe…
Est. 120,000 PLN
Company Background Our client is a global leader in access solutions and smart home technologies. With over a decade of innovation in the IoT space, the company is a pioneer in connected home solutions, including garage…
Est. 25,000 USD
The Job in short The Data Enablement team is here to enable every team in the organisation with their data needs. Our job starts the moment that data enters our platform and ends when it reaches whoever needs it. We are…
FEQ427R364 Location: Sydney As a Sr. Manager, Field Engineering, you will lead a diverse team of technical pre-sales Solutions Architects covering the APJ region. You’ll play a key leadership role at the intersection of…