About the Role
Optimizing data infrastructure at scale lies in providing breakthrough data processing acceleration to the bottomline that drives up costs: the software deployed at scale by data engineering teams.
As a Senior Software Engineer for this role, you will collaborate with the founding team in the implementation of a next-generation accelerator for Apache Spark, the most widely used Big Data processing engine at petabyte-scale.
Working at the intersection of compilers and Big Data analytics, you’ll drive state-of-the-art implementation of algorithms and techniques that span across the entire software stack, from SQL pushdown to enhancements in low-level C++ data processing APIs and beyond.

Requirements:

• 7+ years of hands-on commercial software development experience
• 3+ years of strong Scala experience
• experience with Java
• 2+ years of solid C++ experience
• Upper-Intermediate (B2+) English with confidence in active communication (meetings, discussions)
  

Responsibilities:

• Take full ownership of SQL acceleration features — from architecture and design to implementation and measurable performance gains
• Design, build, and optimize Big Data processing algorithms using Scala, Java, and C++
• Develop high-performance, low-latency components at the intersection of Big Data and compiler technologies
• Work with custom DSLs and code generation frameworks to extend and enhance query execution capabilities
• Contribute to cross-language integrations (Java ↔ C++ via JNI) and drive system-wide performance improvements