This job was posted by https://www.vermontjoblink.com : For moreinformation, please see: https://www.vermontjoblink.com/jobs/1119111Data Scientist, GenAI Studio
College Board - Data Science/Strategy
Remote
*This is a full-time employee role with an initial one-year term
About the Team
The Strategy Team is responsible for developing and executing thestrategic vision and direction of the College Board. We work closelywith the executive leadership team, business units, and externalpartners to identify opportunities and challenges, evaluate options, andimplement solutions that advance our mission of expanding access tohigher education. Our expertise is applying analytical frameworks,data-driven insights, and innovative thinking to address complex anddynamic issues in the education sector. We are a diverse andcollaborative team of strategists, analysts, and project managers whoenjoy learning from each other and sharing our knowledge and skills. Ourteam culture is based on trust, respect, and continuous improvement. Wecelebrate our successes and learn from our failures. We are passionateabout making a positive impact on students, educators, and society.
The GenAI Studio is a new initiative co-led by Strategy and Data Scienceto create the conditions necessary to responsibly experiment with andmake informed decisions about generative AI with the goal ofcapitalizing on innovation that advances our work with students,educators, and members.
About the Opportunity
As a Data Scientist for our GenAI Studio initiative, you are passionateabout applying new ideas and technologies to creatively solvechallenging, real-world problems. You are an early-adopter who isenthusiastic about finding high-value applications for emerging toolsand new technology. You are highly capable at evaluating large data setsand telling a story with data. You are versatile, adaptable, andcomfortable with uncertainty and ambiguity. You are resourceful and ableto forge ahead even when faced with incomplete information. Whilerepresenting our Data Science functional team, you will work day-to-daywithin our Strategy team where you will experiment with differentgenerative AI techniques and tools to find the best solution for thestudents and teachers who use our services. You will work oncross-functional projects that involve data analysis, machine learning,natural language processing, large language models, model evaluation,and more. You will also help us define and build infrastructure tosupport rapid prototyping and testing of AI solutions. You will have theopportunity to learn from and collaborate with other data scientists,strategists, analysts, and project managers who share your passion forinnovation and impact.
In this role, you will:
Prototype new tools leveraging emerging technologies and models (50%)
Engage directly with users and stakeholders to deeply understandneedsCreatively solution to rapidly test hypotheses using emerging AItechnologiesIndependently manage and complete all the work needed to deliver ina rapid-prototyping environmentBuild out preliminary infrastructure to communicate with variousAPIsCraft basic user interfaces to test out ideasCreate customized or multi-staged models to address nuanced usecasesEngage in prompt engineering as appropriateEvaluate generative AI models and tools (30%)
Utilize state of the art techniques to evaluate the performance ofoff-the-shelf, open source, and custom models leveraging andenhancing our existing governance frameworkJudiciously evaluate the effectiveness and fairness of models andarticulate considerations and concerns around implementing models inthe context of the business applicationLearning, ideating, and sharing (20%)
Keep abreast of rapid technological devel pments and relevantproduct offerings, especially within the Generative AI spaceWorkshop new ideas with the immediate team and program stakeholdersShare knowledge of new developments with the team via chats,recurring meetings, and presentations when appropriateCommunicate clearly with non-technical stakeholders to enhance theirunderstanding of what the technology is and is not capable ofAbout You
You have:
5+ years\' experience working in business and technology includingexperience as a Data Scientist with a primary focus on user-facingproducts
Proven experience in developing Machine Learning, Deep Learning, andGenerative AI solutions to solve real-world problems
Programming expertise in Python and/or R
Experience in data and statistical analysis including experience workingwith and evaluating text data
Experience with SQL and NoSQL databases
Knowledge of Agile
Knowledge in developing applications on a Serverless or Microservicescloud platform (AWS/Azure/GCP, etc.)
Excellent communication and listening skills with comfort presenting tobo