Middle/Senior Data Engineer (#2477)

1 Week ago • 4 Years + • Data Analyst

About the job

Summary

This role involves designing, implementing, and maintaining scalable data pipelines in Palantir Foundry, collaborating with cross-functional teams, developing and optimizing ETL processes, troubleshooting data pipeline issues, and staying current with emerging technologies. The ideal candidate will have 4+ years of data engineering experience, preferably in pharmaceuticals or life sciences, strong Python and PySpark skills, and experience with cloud services (AWS Glue, Azure Data Factory, Google Cloud Dataflow). Responsibilities include ensuring data integrity, optimizing workflows, translating data requirements into efficient solutions, implementing data governance, and ensuring data availability. The position requires expertise in data modeling, database design, and problem-solving skills.
Must have:
  • 4+ years data engineering experience
  • Strong Python & PySpark skills
  • Cloud services experience (AWS, Azure, GCP)
  • Data modeling & database design expertise
  • ETL process development & optimization
  • Data pipeline maintenance & troubleshooting
Good to have:
  • Cloud certifications
  • Containerization (Docker, Kubernetes)
  • Apache Lucene, REST API experience
  • Veeva CRM, Reltio, SAP, Palantir Foundry familiarity
  • Pharmaceutical regulations knowledge
  • JavaScript and TypeScript proficiency
Perks:
  • Flexible working format
  • Competitive salary & compensation
  • Personalized career growth
  • Professional development tools
  • Active tech communities
  • Education reimbursement
  • Corporate events & team buildings
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

We are seeking a proactive Middle Strong/Senior Data Engineer to join our vibrant team. In this role, you will take on a pivotal position, collaborating closely with senior data engineers to architect, develop, and maintain sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges.

Responsibilities:

  • Design, implement, and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows.
  • Collaborate with cross-functional teams to gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering.
  • Develop and optimize ETL processes to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information.
  • Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes.
  • Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes.

Requirements:

  • 4+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industry
  • Proven experience as a Data Engineer with a focus on cloud-based solutions.
  • Strong proficiency in Python, and PySpark
  • Hands-on experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow).
  • Expertise in data modeling, database design, and optimization.
  • Familiarity with Big Data technologies (e.g., Apache Spark, Hadoop) is a plus.
  • Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities.
  • US working hours

Nice to have:

  • Certification in Cloud platforms, or related areas.
  • Proficiency in containerization technologies (e.g., Docker, Kubernetes).
  • Experience with search engine Apache Lucene, Webservice Rest API
  • Familiarity with Veeva CRM, Reltio, SAP, and/or Palantir Foundry.
  • Knowledge of pharmaceutical industry regulations, such as data privacy laws, is advantageous.
  • Previous experience working with JavaScript and TypeScript

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits
View Full Job Description

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug