[Remote] Staff Software Engineer - Data Processing & Execution Platform
Note: The job is a remote job and is open to candidates in USA. Dotmatics is a company dedicated to intertwining science, data, and decision-making for innovation. As a Staff Software Engineer, you will lead the technical direction for the data processing and execution platform, ensuring reliable execution of user-initiated operations across shared compute infrastructure. This role involves defining system architecture, improving engineering standards, and managing existing services within a distributed, event-driven system.
Responsibilities
- Define and drive system architecture for event-driven data processing services, leading the migration of key components to a Node.js/TypeScript and Python ecosystem
- Contribute to and improve engineering standards, patterns, and best practices for distributed systems, observability, and reliability across a multi-service platform coordinated through Kafka, GraphQL and RESTful APIs
- Architect and implement asynchronous data processing pipelines for high-volume scientific data, with attention to at-least-once delivery guarantees, backpressure, and graceful degradation
- Guarantee the scalability, maintainability, and security of software solutions running on Kubernetes and AWS
- Take ownership of existing services, develop a deep understanding of their behavior, and make pragmatic decisions about how to evolve them
Skills
- 12+ years experience in engineering preferably in a SaaS environment
- Degree in Computer Science, Software Engineering, or equivalent
- Language-agnostic engineering mindset
- Advanced working experience in Asynchronous processing
- Strong proficiency in Node.js/TypeScript and Python for building production backend services
- Proven experience designing and implementing distributed, event-driven systems coordinated through message buses, GraphQL and RESTful APIs
- Experience implementing automated testing platforms, unit tests, and integration tests
- Advanced working experience with large data processing platforms such as Spark, Databricks, or Snowflake
- Experience managing state across multiple stores (e.g. a message bus, a relational database, and a cache)
- Hands-on experience with AWS in production environments
- Solid understanding of Kubernetes for orchestrating workloads
- Proficiency with CI/CD tools such as GitHub Actions
- Knowledge of Agile software development practices
- Setting technical direction, leading cross-team initiatives, and leveling up other engineers through mentoring and architectural guidance
- Scala or other JVM languages
- Message-based architectures using Kafka
- Background in complex data pipelines, schema management, and incremental processing
- Exposure to AWS and/or GCP or designing systems portable across multiple cloud providers
- Building scalable distributed systems using Kubernetes and other cloud-native technologies
- Experience within Life Sciences or R&D data management
Benefits
- Medical, Dental, Vision, Insurance
- Health Spending Accounts
- Wellness Benefits (Mental Health Apps and Fitness Perks)
- Company-paid Life and Disability Insurance
- 401k Retirement Plan (with 4% company match; immediate vesting)
- Flexible Time off Plan (for US exempt employees)
- Certain positions are also eligible for variable pay; your recruiter will discuss the full compensation package details.
Company Overview
Company H1B Sponsorship