hero

Exceptional people. Asymmetric outcomes.

Our portfolio companies are always looking for talented people to join their teams.

Senior Data Engineer

Adonis

Adonis

Data Science
New York, NY, USA
Posted on Friday, October 27, 2023
At Adonis, we are building a medical billing engine that automates billing workflows and improves reimbursement rates for medical providers. Billing and insurance related activities represent nearly $1 in every $7 collected by medical providers - and the high costs of collecting payments, as well as and other costs that stem from the administrative challenges within the space, unfortunately get passed down to the consumer. This is why healthcare costs continue to rise, with no end to that in sight. We’re set on helping to mitigate these challenges.

Responsibilities

  • Design, build, maintain, and enhance Adonis’s data platform, data lakehouse, and internal data-focused APIs
  • Build and maintain ETL data pipelines involving homogenous and heterogenous data from external healthcare data sources and our internal databases in a medallion architecture
  • Design data solutions using various big data technologies and low latency architectures
  • Collaborate with data scientists, product managers, and frontend engineers to develop, implement, and validate deployed data solutions
  • Understand and implement data engineering best practices
  • Improve, manage, and teach standards for code maintainability and performance in code submitted and reviewed
  • Mentor and provide guidance to other engineers on the job

Qualifications

  • Expert at writing and optimizing SQL queries, especially when using PostgreSQL databases
  • Expert in writing and optimizing Python 3.x focused on data processing and providing REST APIs
  • Familiarity with event-driven architectures to stitch workflows together in a more reactive fashion over purely CRON-based triggers
  • Familiarity with streaming workflows to process datasets at low latencies
  • Familiarity with data engineering and data science development tools and libraries (i.e. Pandas, NumPy, Jupyter)
  • Familiarity with data and API engineering offerings of Amazon Web Services (i.e. Athena, Fargate, Lambda, RDS, Redshift, SageMaker, Step Functions)
  • Familiarity with data warehousing concepts
  • Familiarity with basic principles of distributed computing (able to optimize partitioning, distribution and MPP of high-level data structures)
  • Authoritative in ETL optimization, designing, coding, and tuning big data processes
  • Experience in Prefect, Airflow, or other workflow orchestrators
  • Experience in working with large databases, efficiently moving billions of rows, and complex data modeling
  • Experience in managing data lineage, quality, and discovery
  • Experience with big data & concurrency technologies like PySpark, Ray, or others

At Adonis, we adopt an in-person culture. It is expected you will be in the office 5 days per week.

Salary Range: $150,000 - $180,000