LLM Java Developer

• Design, develop, and maintain efficient, high-quality code to train and optimize AI models.
• Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
• Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
• Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
• Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
• Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
• Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
• Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
• Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
• Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
• Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.

• Train LLM models with high-quality, stable, and scalable back-end components using the newest coding best practices in a variety of languages and frameworks.
• Participate in code reviews to ensure that the standards for code quality are met
• Demonstrate your proficiency with your language of choice, while covering all bases
• Provide clear, clean, well-organized, correct, and clearly annotated/classifiable code in the responses
• Demonstrable experience with developing web apps using modular development and scalable architectures as well as a strong focus on code readability and security/stability (i.e. testing)
• Proficiency with Java's syntax and conventions

• Some prior software Quality Assurance and Test Planning experience

RequiredAlso useful

Project and contracting process: Turing. Applications continue on the provider's website.