Project Background
Student Role
- Understand the current state of the art and practice. The student will perform a focused software and literature review of current approaches regarding AI's role in the research process. Existing qualitative data analysis software with embedded AI tools do not generate useful themes. Simultaneously, scientific approaches to studying AI's efficacy are limited to evaluating how well AI performs compared to expert humans and do not propose new ways to combine manual and AI tools.
- Conduct empirical studies to assess the quality of work enabled by AI. The student will use a combination of qualitative and quantitative methods to study multiple AI tools' codes and themes compared to trained human coders. Questions include: Are the results generated by AI reliable, valid, and reproducible? To what extent do hallucinations occur? Can the AI tool extract emotional themes from the data?
- Design new techniques to improve the quality of human-AI collaboration. The student will design techniques that identify and rectify challenges when using AI as a research method. For example, how can the context of use be embedded in the output from such tools? Who will use such a tool? What are the various users' needs?
Student Learning Outcomes and Benefits
Vineet Pandey
My mentoring philosophy is rooted in creative growth, scientific rigor, and the collaborative pursuit of knowledge that leads to impact. I am committed to fostering an environment that promotes socially responsible research, academic and professional development, and intellectual curiosity. I intend to help mentees grow to be independent thinkers who can design, engineer, and implement high-quality approaches to challenging problems. Mentees will be expected to be present, speak up, and to always be professional. Regular interaction, openness to feedback, and a willingness to learn quickly are essential. I strive to be accessible and supportive, tailoring guidance to mentee's unique background and goals. I seek early conversations over possibly challenging interpersonal aspects of research including authorship, data collection and analysis, and plans for submitting research that maximally benefits the mentee's growth. Specific mentoring activities include discussing and agreeing on a compact for the working relationship between mentees and mentors at the beginning of the SPUR experience, and regular (typically, weekly) meetings with the mentee. Mentees are expected to attend weekly lab meetings where they will present and answer questions about their project. During lab meetings, mentors will answer questions and guide the mentee through the project and engage in the mentee's professional development. Mentees will complete CITI IRB training.