Skip to main content
Skip to main content

Senior Data Engineer

Location United States - California - Alameda Category Research & Development
Apply Now
JOB DESCRIPTION

Abbott is a global healthcare leader that helps people live more fully at all stages of life. Our portfolio of life-changing technologies spans the spectrum of healthcare, with leading businesses and products in diagnostics, medical devices, nutritionals and branded generic medicines. Our 114,000 colleagues serve people in more than 160 countries.

Meet Lingo, a new biosensing technology that provides users a window into their body. Lingo tracks key biomarkers – such as glucose, ketones, and lactate – to help people make better decisions about their health and nutrition. Biowearable technology will digitize, decentralize and democratize healthcare, enabling consumers to take control of their own health.

At Abbott, you can do work that matters, grow and learn, care for yourself and family, be your true self, and live a full life. You’ll also have access to:

  • Career development with an international company where you can grow the career you dream of.

  • Employees can qualify for free medical coverage in our Health Investment Plan (HIP) PPO medical plan in the next calendar year

  • An excellent retirement savings plan with high employer contribution

  • Tuition reimbursement, the Freedom 2 Save student debt program and FreeU education benefit - an affordable and convenient path to getting a bachelor’s degree.

  • A company recognized as a great place to work in dozens of countries around the world and named one of the most admired companies in the world by Fortune.

  • A company that is recognized as one of the best big companies to work for as well as a best place to work for diversity, working mothers, female executives, and scientists.

The Opportunity

We are seeking a Senior Data Engineer for Lingo based in Alameda, CA (San Francisco Bay Area), our product headquarters.

We are seeking a Senior Data Engineer with deep expertise in Apache Spark to join our team. You will play a critical role in helping us deliver clinically validated, regulatory-grade digital health products and solutions in preventive care using Bio-Wearables. As a senior leader in data engineering, you will help design, develop, and optimize a large-scale real-time data processing system. You will work closely with data analysts, scientists, system designers, and software developers to build scalable data services, pipelines, and interfaces to support our mission. This is a hands-on technical role requiring strong problem-solving skills and deep knowledge of distributed systems.

What You’ll Work On 

  • Design, implement, and optimize Apache Spark jobs to define, schedule, monitor, and control data processes.

  • Develop, test and deploy algorithms for large-scale machine learning in a production environment.

  • Optimize Spark jobs to maximize speed, scalability and compliance with data-use regulations.

  • Manage robust data pipelines: acquisition, transformation, and processing workflows.

  • Perform advanced data processing and exploratory analysis • Build and deploy machine learning models using Spark or MapReduce, and present results through intuitive visualizations.

  • Collaborate with other spark developers and back-end data engineers to design and develop interactive Spark pipelines.

  • Develop and maintain REST APIs to manage Spark jobs and facilitate data workflows.

  • Ensure seamless integration of pipelines with distributed file and database systems.

Required Qualifications 

  • Bachelor's degree in Computer Science, Engineering, or a related field.

  • Minimum 6 years of experience in building and optimizing data processing pipelines.

  • Expertise in Apache Spark, including Spark SQL, RDD, DataFrame, Dataset APIs, and PySpark.

  • Proficiency in programming languages such as Python, and Java (Scala is a plus).

  • In-depth understanding of Spark internals and real-time streaming technology (e.g., Kafka, KSQL, etc.)

  • Strong experience with big data processing tools (Experience with Apache Druid is a huge plus).

  • Familiarity with ETL tools and expertise in managing post-loading transformations.

  • Advanced knowledge of distributed file systems like HDFS, S3, or Ceph.

  • Experience with cloud platforms such as AWS or Azure for building Apache Spark clusters.

  • Understanding of machine learning algorithms and their application in large-scale data environments.

  • Familiarity with data visualization tools (e.g., Tableau, Power BI, or others).

  • Strong communication and collaboration skills, with a proven ability to work cross-functionally with analysts, scientists, and developers.

#software

Apply Now 

Learn more about our health and wellness benefits, which provide the security to help you and your family live full lives:  www.abbottbenefits.com  

Follow your career aspirations to Abbott for diverse opportunities with a company that can help you build your future and live your best life. Abbott is an Equal Opportunity Employer, committed to employee diversity. 

Connect with us at www.abbott.com, on Facebook at www.facebook.com/Abbott and on Twitter @AbbottNews. 



The base pay for this position is $112,000.00 – $224,000.00. In specific locations, the pay range may vary from the range posted.

Close the popup

No locations found

Apply Now

Get notified for similar jobs

You'll receive updates once a week

Email should not be empty Please enter valid email
Success! Successfully subscribed for similar jobs Failure! You have already subscribed for this job Failure! Failed to subscribed for similar jobs

Get tailored job recommendations based on your interests.

Job seekers Also Viewed

  • Sr. Staff AI/Machine Learning Engineer

    Location United States - California - San Diego Category Research & Development

    Develop and implement industry leading GenAI, statistical models and machine learning algorithms to analyze diverse sources of data, ensuring they meet business requirements and are delivered on time....

  • Senior AI-Machine Learning Engineer

    Location United States - Minnesota - Plymouth Category Research & Development

    Hands-on experience with a variety of supervised, semi-supervised and unsupervised machine learning methods. Experience in preparation and manipulation of training and validation datasets, including d...

  • Data/Cloud Engineer

    Location United States of America : Remote Category Research & Development

    Foster a culture of sharing, reuse, design for scale stability, and operational efficiency of data and analytical solutions. Minimum 6 years of relevant experience in data engineering/analytics space....

  • Principal Software Engineer

    Location United States - Texas - Irving Category Research & Development

    Demonstrates expert knowledge and proficiency in the complete software development process; leads and is accountable for the software architecture and interfaces for all features of a subsystem. Defin...

  • Senior SDET

    Category Research & Development

    Perform exploratory testing, system level end to end testing, develop test datasets and execute automation scripts (to ensure application software releases are of high quality). 4-6 years’ experience...

No recommendations found

Similar Jobs

No recommendations found

Job Id 31110319 Location United States - California - Alameda Medical surveillance Not Applicable Division LNGO Lingo Travel No Additional Location Significant work activities Continuous sitting for prolonged periods (more than 2 consecutive hours in an 8 hour day); Keyboard use (greater or equal to 50% of the workday)

CREATING POSSIBILITIES

sales-static-events
INNOVATIVE BENEFITS
We support our colleagues around the world as they care for themselves and their families with offerings tailored to their unique needs.
sales-working-phenom
DIVERSITY & INCLUSION
We strive to provide environments where all employees feel welcome and able to bring their full selves to work. To do this we integrate diversity, equity, and inclusion across Abbott.
sales-working-phenom
SUSTAINABILITY FOR OUR FUTURE
At Abbott, sustainability means managing our efforts so we can help the greatest number of people around the world live fuller lives through better health.

WE'RE RECOGNIZED AROUND THE WORLD

img1
DOW JONES SUSTAINABILITY INDEX
img1
BEST CORPORATE CITIZENS
img1
FORTUNE CHANGE
THE WORLD
img1
FORTUNE'S MOST ADMIRED COMPANIES
img1

JOIN OUR TALENT COMMUNITY
We will notify you about relevant positions, and keep you in mind when we have interesting opportunities.
JOIN NOW
AN EQUAL OPPORTUNITY EMPLOYER

Abbott welcomes and encourages diversity in our workforce including Minorities, Women, Individuals with Disabilities and Protected Veterans.

> EEO (ENGLISH)               > EEO (SPANISH)                > PAY TRANSPARENCY NONDISCRIMINATION PROVISION

We provide reasonable accommodation to qualified individuals with disabilities. U.S. residents only: To request accommodation, please call 224-667-4913 or email corpjat@abbott.com.