Senior Research Engineer (Remote)

HackerRank is at the forefront of innovation in machine learning and AI. We are launching an ambitious data commercialization program where we are creating a comprehensive benchmark to assess the performance of large language models (LLMs) on software development tasks and generating new content and data specifically to improve state-of-the-art LLMs on software engineering tasks. We are seeking a highly skilled and motivated research engineer to join our team and help us drive this initiative forward. This position is Full-Time and Remote within North America.

Key Responsibilities:

• Design & develop evaluation metrics and benchmark methodologies and conduct experiments to evaluate the performance of various LLMs on software engineering tasks.
• Develop & deploy data pipelines for LLM training and evaluation datasets.
• Contribute to the development and deployment of state-of-the-art machine learning models.
• Collaborate with cross-functional teams to ensure the seamless integration of the benchmark into our broader data commercialization strategy.
• Stay abreast of the latest machine learning and LLMs advancements to ensure our benchmarks and models remain cutting-edge.

Qualifications:

• Advanced degree (Master’s) in Computer Science, Machine Learning, Data Science, or a related field.
• Proven experience in machine learning, with a strong emphasis on LLMs and natural language processing.
• Demonstrated experience in preparing and conducting evaluations of machine learning models.
• Experience developing large-scale data pipelines for research datasets.
• Proficiency in programming languages such as Python and familiarity with machine learning frameworks (e.g., TensorFlow, PyTorch).

Preferred Qualifications:

• Experience in benchmarking and performance evaluation of LLMs & designing high-scale data pipelines
• Published research in relevant fields.
• Familiarity with coding challenges and competitive programming.

Benefits & Perks:

We have a full package of competitive benefits and perks, which include the following:

• One-time home office set up stipend
• Monthly Remote Work Enablement Stipend
• Professional Development Reimbursement
• Wellbeing Benefits (Headspace, etc)
• Flexible paid time off, paid leave for new parents, and flexible work hours
• Insurance for all employees (term life, personal accident, medical) along with medical insurance for their dependents
• Employee stock options