Description
Data Engineer
Particle41 is seeking a talented Data Engineer to join our team. You will design, build, and maintain data pipelines and infrastructure, support client-facing data visualization, and contribute to AI-assisted data workflows. You will work across the full data lifecycle — from raw ingestion to polished, decision-ready output — in collaboration with cross-functional teams.
In This Role You Will
Software Development
- Design, develop, and maintain scalable ETL/ELT pipelines to process large volumes of data from diverse sources.
- Build and optimize data storage solutions — data lakes and data warehouses — for efficient retrieval and processing.
- Integrate structured and unstructured data from internal and external systems into a unified view for analysis.
- Ensure data accuracy, consistency, and completeness through validation, cleansing, and transformation.
- Maintain clear documentation for data processes, tools, and systems.
Data Visualization
- Build and maintain Tableau dashboards and reports that translate complex datasets into clear, decision-ready visuals.
- Design data models and extracts optimized for Tableau performance, including live connections and published data sources.
- Apply data visualization best practices — chart selection, layout, color, and interactivity — to produce client-ready output.
- Partner with stakeholders to understand reporting needs and translate them into visual solutions.
- Support ad hoc analysis using Tableau, Python-based charting (matplotlib, seaborn, plotly), or similar tools.
AI and Data Support
- Support AI/ML workflows by building and maintaining the data pipelines that feed model training, inference, and evaluation.
- Assist with data preparation for LLM and machine learning projects, including feature engineering, tokenization pipelines, and vector store integration.
- Help teams adopt AI-assisted data tooling — copilots, intelligent search, automated reporting — by ensuring clean, well-structured data is available upstream.
- Contribute to prompt engineering and evaluation frameworks where data context is a key input.
Requirements Gathering and Analysis
- Work with product managers and stakeholders to gather requirements and translate them into technical solutions.
- Provide technical input during requirements sessions to align data capabilities with business needs.
Agile Development
- Participate in sprint planning, stand-ups, and sprint reviews.
- Deliver solutions on time and within scope. Adapt when priorities shift.
Testing and Debugging
- Write unit and integration tests to validate pipeline reliability and data accuracy.
- Identify and resolve defects, performance bottlenecks, and data quality issues.
Continuous Learning
- Stay current with cloud platforms (AWS, Azure, GCP) and emerging data engineering tools.
- Propose solutions to improve performance, security, and scalability.
Skills and Experience We Value
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 3+ years of experience as a Data Engineer.
- Strong Python proficiency.
- Experience with SQL (MySQL, PostgreSQL) and NoSQL (MongoDB) databases.
- Hands-on experience with Tableau — dashboard development, data source management, and performance optimization.
- Familiarity with data warehousing and lakehouse principles; experience with Databricks, Spark, PySpark, and pandas.
- Experience building or supporting ML/AI data pipelines, including feature stores, vector databases, or model serving infrastructure.
- Familiarity with at least one cloud data stack (Azure, AWS, or GCP).
- Working knowledge of the ELK stack, Redis, and distributed task queues.
- Proficiency with Python libraries including Flask, scikit-learn, requests, pytest, and logging utilities.
- Comfortable working in Linux and writing shell scripts.
- Familiarity with Git and collaborative development workflows.
- Strong communication skills and the ability to work across technical and non-technical teams.
About Particle41
Our core values of Empowering, Leadership, Innovation, Teamwork, and Excellence drive everything we do — ELITE.
E — Empowering: Enabling individuals to reach their full potential
L — Leadership: Taking initiative and guiding each other toward success
I — Innovation: Embracing creativity and new ideas to stay ahead
T — Teamwork: Collaborating with empathy to achieve common goals
E — Excellence: Striving for the highest quality in everything we do
Particle41 welcomes individuals from all backgrounds committed to our mission and values. We provide equal employment opportunities to all employees and applicants. Hiring and employment decisions are based on merit and qualifications — without discrimination based on race, color, religion, caste, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, local, or international laws.
For assistance during the application or interview process, contact us at careers@Particle41.com
Similar jobs
Data Engineer Particle41 is seeking a talented and versatile Data Engineer to join our innovative team. As a Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and infra…
Data Engineer - Power BI Particle41 is looking for a skilled and adaptable Data Engineer (Power BI) to join our growing team. In this role, you will be responsible for building and maintaining scalable ETL/ELT pipelines,…
Data Science & Engineering Lead Lead the charge in AI and data innovation as our Data Science & Engineering Lead. Here, you’ll work hands-on with our talented team to build and deploy high-impact ML models, optim…
AI Engineer Role Overview: As an AI Engineer at Particle41 you will design, develop and deploy machine-learning and deep-learning models/solutions (including generative-AI) that address complex business problems. You wil…
Est. 141,000 USD
AI Engineer Role Overview: As an AI Engineer at Particle41 you will design, develop and deploy machine-learning and deep-learning models/solutions (including generative-AI) that address complex business problems. You wil…
DevOps Engineer As a DevOps Engineer at Particle41, you will play a crucial role in enhancing our software development and IT operations processes. The ideal candidate will have a strong background in both software devel…
Full Stack Javascript & Database Developer Particle41 is seeking a talented and versatile Full Stack Developer to join our innovative team. As a Full Stack Developer, you will play a key role in designing, developing…
Full Stack Javascript Developer Particle41 is seeking a talented and versatile Full Stack Developer to join our innovative team. As a Full Stack Developer, you will play a key role in designing, developing, and maintaini…
Est. 231,500 USD
Who We Are Lightning AI is the company behind PyTorch Lightning. Founded in 2019, we build an end-to-end platform for developing, training, and deploying AI systems—designed to take ideas from research to production with…
As a DevOps Engineer (AWS) at Particle41, you will play a crucial role in enhancing our software development and IT operations processes. The ideal candidate will have a strong background in both software development and…
Join phData, a remote-first data and AI consultancy company with employees across the United States, Latin America, and India. We partner with industry leaders, including Snowflake, AWS, Anthropic, Glean, and dbt, to sol…
As a DevOps Engineer (Azure) at Particle41, you will play a crucial role in enhancing our software development and IT operations processes. The ideal candidate will have a strong background in both software development a…
As a DevOps Engineer (Azure) at Particle41, you will play a crucial role in enhancing our software development and IT operations processes. The ideal candidate will have a strong background in both software development a…
Est. 60,000 USD
Who We Are Konrad is a next generation digital consultancy. We are dedicated to solving complex business problems for our global clients with creative and forward-thinking solutions. Our employees enjoy a culture built o…
Who we are DigiCert is a global leader in intelligent trust. We protect the digital world by ensuring the security, privacy, and authenticity of every interaction. Our AI-powered DigiCert ONE platform unifies PKI, DNS, a…
Frontend Developer Particle41 is seeking a talented and versatile Frontend developer to join our innovative team. As a frontend developer, you will play a key role in designing, developing, and maintaining end-to-end sof…
Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for ou…
Est. 85,000 GBP
Our Why At Dotmatics At Dotmatics, a Siemens company, we believe science, data, and decision-making must be deeply intertwined for innovation to thrive. Our Portfolio includes Luma, LumaLab Connect, ELN Platform, Graphpa…
Est. 114,000 USD
At Ardent, we hire people who want more than a job — they want to serve a mission that matters. Our teams support the federal government’s most critical national security and defense priorities, helping protect the natio…
Est. 80,000 GBP
Spaulding Ridge is an advisory and IT implementation firm. We help global organizations get financial clarity into the complex, daily sales, and operational decisions that impact profitable revenue generations, efficient…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Netw…
Join phData, a remote-first data and AI consultancy company with employees across the United States, Latin America, and India. We partner with industry leaders, including Snowflake, AWS, Anthropic, Glean, and dbt, to sol…
About Workato Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform. A leader in Enterprise…
As a DevOps Engineer (GCP) at Particle41, you will play a crucial role in enhancing our software development and IT operations processes. The ideal candidate will have a strong background in both software development and…
As a DevOps Engineer (GCP) at Particle41, you will play a crucial role in enhancing our software development and IT operations processes. The ideal candidate will have a strong background in both software development and…
As a DevOps Engineer (GCP) at Particle41, you will play a crucial role in enhancing our software development and IT operations processes. The ideal candidate will have a strong background in both software development and…
Est. 124,000 USD
CTEC is a leading technology firm that provides modernization, digital transformation, and application development services to the U.S. Federal Government. Headquartered in McLean, VA, CTEC has over 300 team members work…
.NET Full Stack Developer Particle41 is seeking a skilled and experienced .NET Developer to join our dynamic team. As a .NET Developer, you will be responsible for designing, developing, and maintaining software solution…