Research Engineering Intern – AI Evaluations

Round 1: Online aptitude and coding test → Round 2: Technical interview focusing on ML/NLP concepts and Python coding → Round 3: HR interview covering motivation, cultural fit, and internship logistics

Karya promotes a collaborative and research‑focused environment where interns are treated as valued contributors. The company encourages continuous learning through weekly tech talks and mentorship, while maintaining a healthy work‑life balance with flexible hours and remote‑friendly policies.

Karya’s interview process typically starts with a timed online test covering aptitude and coding, followed by a technical interview that probes your understanding of machine‑learning fundamentals, NLP pipelines, and Python proficiency. The final HR round assesses cultural fit and communication skills. Overall difficulty is moderate, with emphasis on clear problem‑solving explanations and practical knowledge of AI evaluation techniques.

Currently pursuing or recently completed a Bachelor's or Master's degree in Computer Science, Machine Learning, Natural Language Processing, or a related technical field. Minimum aggregate of 60% (or CGPA 6.0/10) in the qualifying degree. Open to candidates from the 2024, 2025, or 2026 graduating batches. No active backlogs allowed at the time of joining. Candidates should have a strong foundation in programming, algorithms, and basic machine‑learning concepts.

Karya is an emerging AI‑driven technology startup headquartered in Bengaluru, focused on building data‑centric platforms that enable businesses to harness the power of large language models (LLMs) and other advanced machine‑learning solutions. Founded by a team of seasoned researchers and engineers, Karya has quickly positioned itself as a bridge between cutting‑edge AI research and real‑world product deployments, serving clients across finance, healthcare, and e‑commerce sectors. The company culture emphasizes rapid experimentation, open collaboration, and a strong commitment to ethical AI, encouraging interns and fresh graduates to contribute meaningfully from day one. The Research Engineering Intern – AI Evaluations role is designed for students or recent graduates who are passionate about assessing and improving the performance of AI and language models. Interns will work closely with Karya’s research and engineering teams to design, implement, and refine evaluation pipelines that measure model accuracy, robustness, and fairness across a variety of benchmarks. This position offers a unique blend of hands‑on engineering, data analysis, and research support, providing a solid foundation for a career in AI research or applied machine learning. Key responsibilities include: 1. Designing and developing automated tools for evaluating LLMs and other AI models. 2. Curating and preprocessing datasets used for benchmark testing. 3. Running large‑scale evaluation experiments and logging results. 4. Analyzing model outputs to identify systematic errors and quality gaps. 5. Implementing statistical analysis and visualisation of evaluation metrics. 6. Collaborating with research scientists to propose improvements based on evaluation findings. 7. Maintaining documentation of evaluation workflows and best practices. 8. Assisting in the creation of new evaluation benchmarks tailored to specific industry use‑cases. 9. Contributing to internal knowledge‑sharing sessions and code reviews. 10. Supporting the deployment of evaluation pipelines in cloud environments. The tech stack primarily revolves around Python, with extensive use of libraries such as PyTorch, TensorFlow, Hugging Face Transformers, Pandas, NumPy, and evaluation‑specific tools like EvalAI and MLflow. Familiarity with cloud platforms (AWS/GCP) and containerisation (Docker) is advantageous. Interns will gain exposure to state‑of‑the‑art LLMs, data annotation pipelines, and rigorous scientific evaluation methods. Growth path at Karya is clearly defined: high‑performing interns may transition to full‑time Research Engineer or Machine Learning Engineer roles, with opportunities to lead independent research projects, publish findings, and influence product direction. Joining Karya offers the chance to work on impactful AI problems, learn from seasoned researchers, and become part of a fast‑growing startup that values innovation, learning, and ethical AI development.