We are looking for Senior Python Developer candidates for a project delivered through Turing.
What you'll do
- Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models.
- Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
- Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
- Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
- Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
- Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
- Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
- Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
- Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
- Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
- Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.
What you need
- 3+ years of strong experience with Python programming language.
- Industry experience and knowledge of code quality, formatting, and best practices of software development
- Experience with Python’s testing ecosystem, including unit, integration, and property-based testing.
- Knowledge of multi-threading and asynchronous programming in Python.
- Ability to work with architectural patterns and refactor code without introducing regressions.
- Strong debugging skills, including fixing memory and concurrency issues.
- Fluent in conversational and written English communication skills
Nice to have
- Familiarity with Python frameworks and libraries
Expertise
Who you work with
Project and contracting process: Turing. Applications continue on the provider's website.