AI Auditing Engineer (Temporary) - Penn Center for Media, Technology, and Democracy - Penn Engineering

The University of Pennsylvania is a world-renowned leader in education, research, and innovation. They are seeking a part-time AI Auditing Engineer to develop and productionize auditing and monitoring of large language models, creating tools for longitudinal monitoring of LLMs.

Responsibilities

• Develop and deploy an interoperable set of tools that is generally useful for longitudinal monitoring of LLMs
• Design and manage appropriate databases for LLM monitoring
• Advance research methods for LLM monitoring of political topics

Skills

• Bachelor's degree in a relevant field of study
• Required proficiency in developing efficient and scalable data pipelines in Python
• Required proficiency in designing and managing NoSQL databases
• Required proficiency in working with cloud computing platforms
• Preferred understanding or prior experience working with LLM APIs
• Preferred understanding or experience with natural language processing methods for LLM evaluation
• Preferred understanding or experience with cloud cost engineering and other aspects of DevOps, especially cost efficient use of LLMs
• Preferred experience with data visualization in interactive dashboards
• Interest in the political outputs and impacts of large language models (LLMs) is a bonus

Benefits

• Health and Life: Penn offers comprehensive medical, prescription, behavioral health, dental, vision, and life insurance benefits to protect you and your family’s health and welfare.
• Retirement: Penn offers generous retirement plans to help you save for your future. Penn’s Basic, Matching, and Supplemental retirement plans allow you to save for retirement on a pre-tax or Roth basis. Choose from a wide variety of investment options through TIAA and Vanguard.

Company Overview

Company H1B Sponsorship