Position Overview & Specifications
About GitHub
As the global home for all developers, GitHub is the complete AI-powered developer platform to build, scale, and deliver secure software. Over 100 million people, including developers from 90 of the Fortune 100 companies, use GitHub to build amazing things together across 330+ million repositories. With all the collaborative features of GitHub, it has never been easier for individuals and teams to write faster, better code.
Locations
In this role you can work from Remote, United States
Overview
GitHub Copilot has changed the way software is built, and we have a unique opportunity to look further ahead to identify how software development can be faster, safer, easier, and more accessible. We’re looking for talented and passionate applied scientists to join us in this mission!
Our team, GitHub Copilot Applied Science, has a crucial role in advancing the core intelligence solutions within Copilot. Our responsibilities encompass various areas such as LLM fine-tuning generation, prompt engineering, and the development of end-to-end AI features using cutting-edge technologies. In this role, you will collaborate closely with a diverse and highly skilled group of researchers, scientists, and software engineers within our team, while partnering with multiple teams across Github and Microsoft. Together, we are dedicated to shaping the future of software development by continuously enhancing AI-powered capabilities in Copilot.
Responsibilities
Drive research initiatives for online metrics development to continuously assess and improve the real-time performance of Copilot productsDevelop and implement methodologies for offline quality measurement, ensuring robust evaluation of large language model outputs in diverse scenarios.Lead the development of tools for automating quality analysis, streamlining the assessment process, and enhancing the efficiency of large-scale model evaluations.Integrate Responsible AI principles into the development lifecycle of Copilot products.Design and execute experiments to evaluate the impact of model changes, ensuring continuous refinement and advancement.Hands-on engagement with model training activities to elevate the performance of the Copilot product.
Qualifications
Required Qualifications:
Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research)OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related fieldOR equivalent experience1+ years experience in applied science, machine learning, deep learning, natural language processing or large-scale data mining. Strong programming skills in languages such as Python, and experience with relevant libraries and frameworks
Preferred Qualifications:
These are more specific abilities we’re looking for . Think of this as a descriptive sketch, not a checklist of requirements. Be comfortable applying even if you don’t have all of them.
Ph.D in computer science, machine learning, or a related field. Experience working with LLM and OpenAI models.Understanding of Responsible AI principles and their application in AI product development.Have significant experience with large-scale data analysis and experimentationExpertise in developing tools for automation and familiarity with quality analysis frameworks.Excellent analytical and problem-solving skills with a keen attention to detailExcellent written and verbal communication skills
Compensation Range
The base salary range for this job is USD $75,000.00 - USD $115,100.00 /Yr.
In addition, certain roles also have the opportunity to earn sales incentives based on revenue or utilization, depending on the terms of the plan and the employee's role.
These pay ranges are intended to cover roles based across the United States. An individual's base pay depends on various factors including geographical location and review of experience, knowledge, skills, abilities of the applicant. At GitHub certain roles are eligible for benefits and additional rewards, including annual bonus and stock. These rewards are allocated based on individual impact in role. In addition, certain roles also have the opportunity to earn sales incentives based on revenue or utilization, depending on the terms of the plan and the employee's role.
GitHub values
Customer-obsessedShip to learnGrowth mindsetOwn the outcomeBetter togetherDiverse and inclusive
Manager fundamentals
ModelCoachCare
Leadership principles
Create clarityGenerate energyDeliver success
Who We Are
GitHub is the world’s leading AI-powered developer platform with 100 million developers and counting. We’re also home to the biggest open-source community on earth (and 99% of the world’s software has open-source code in its DNA). Many of the apps and programs you use every day are built on GitHub.
Our teams are dreamers, doers, and pioneers, leading the way in AI, driving humanitarian efforts around the globe, and even sending open source to Mars (and beyond!). At GitHub, our goal is to create the space you need to do your best work. We’re remote-first and offer competitive pay, generous learning and growth opportunities, and excellent benefits to support you, wherever you are—because we know that people flourish when they can work on their own terms.
Join us, and let’s change the world, together.
EEO Statement
GitHub is made up of people from a wide variety of backgrounds and lifestyles. We embrace diversity and invite applications from people of all walks of life. We don't discriminate against employees or applicants based on gender identity or expression, sexual orientation, race, religion, age, national origin, citizenship, disability, pregnancy status, veteran status, or any other differences. Also, if you have a disability, please let us know if there's any way we can make the interview process better for you; we're happy to accommodate!
As the global home for all developers, GitHub is the complete AI-powered developer platform to build, scale, and deliver secure software. Over 100 million people, including developers from 90 of the Fortune 100 companies, use GitHub to build amazing things together across 330+ million repositories. With all the collaborative features of GitHub, it has never been easier for individuals and teams to write faster, better code.
Locations
In this role you can work from Remote, United States
Overview
GitHub Copilot has changed the way software is built, and we have a unique opportunity to look further ahead to identify how software development can be faster, safer, easier, and more accessible. We’re looking for talented and passionate applied scientists to join us in this mission!
Our team, GitHub Copilot Applied Science, has a crucial role in advancing the core intelligence solutions within Copilot. Our responsibilities encompass various areas such as LLM fine-tuning generation, prompt engineering, and the development of end-to-end AI features using cutting-edge technologies. In this role, you will collaborate closely with a diverse and highly skilled group of researchers, scientists, and software engineers within our team, while partnering with multiple teams across Github and Microsoft. Together, we are dedicated to shaping the future of software development by continuously enhancing AI-powered capabilities in Copilot.
Responsibilities
Drive research initiatives for online metrics development to continuously assess and improve the real-time performance of Copilot productsDevelop and implement methodologies for offline quality measurement, ensuring robust evaluation of large language model outputs in diverse scenarios.Lead the development of tools for automating quality analysis, streamlining the assessment process, and enhancing the efficiency of large-scale model evaluations.Integrate Responsible AI principles into the development lifecycle of Copilot products.Design and execute experiments to evaluate the impact of model changes, ensuring continuous refinement and advancement.Hands-on engagement with model training activities to elevate the performance of the Copilot product.
Qualifications
Required Qualifications:
Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 2+ years related experience (e.g., statistics, predictive analytics, research)OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 1+ year(s) related experience (e.g., statistics, predictive analytics, research)OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related fieldOR equivalent experience1+ years experience in applied science, machine learning, deep learning, natural language processing or large-scale data mining. Strong programming skills in languages such as Python, and experience with relevant libraries and frameworks
Preferred Qualifications:
These are more specific abilities we’re looking for . Think of this as a descriptive sketch, not a checklist of requirements. Be comfortable applying even if you don’t have all of them.
Ph.D in computer science, machine learning, or a related field. Experience working with LLM and OpenAI models.Understanding of Responsible AI principles and their application in AI product development.Have significant experience with large-scale data analysis and experimentationExpertise in developing tools for automation and familiarity with quality analysis frameworks.Excellent analytical and problem-solving skills with a keen attention to detailExcellent written and verbal communication skills
Compensation Range
The base salary range for this job is USD $75,000.00 - USD $115,100.00 /Yr.
In addition, certain roles also have the opportunity to earn sales incentives based on revenue or utilization, depending on the terms of the plan and the employee's role.
These pay ranges are intended to cover roles based across the United States. An individual's base pay depends on various factors including geographical location and review of experience, knowledge, skills, abilities of the applicant. At GitHub certain roles are eligible for benefits and additional rewards, including annual bonus and stock. These rewards are allocated based on individual impact in role. In addition, certain roles also have the opportunity to earn sales incentives based on revenue or utilization, depending on the terms of the plan and the employee's role.
GitHub values
Customer-obsessedShip to learnGrowth mindsetOwn the outcomeBetter togetherDiverse and inclusive
Manager fundamentals
ModelCoachCare
Leadership principles
Create clarityGenerate energyDeliver success
Who We Are
GitHub is the world’s leading AI-powered developer platform with 100 million developers and counting. We’re also home to the biggest open-source community on earth (and 99% of the world’s software has open-source code in its DNA). Many of the apps and programs you use every day are built on GitHub.
Our teams are dreamers, doers, and pioneers, leading the way in AI, driving humanitarian efforts around the globe, and even sending open source to Mars (and beyond!). At GitHub, our goal is to create the space you need to do your best work. We’re remote-first and offer competitive pay, generous learning and growth opportunities, and excellent benefits to support you, wherever you are—because we know that people flourish when they can work on their own terms.
Join us, and let’s change the world, together.
EEO Statement
GitHub is made up of people from a wide variety of backgrounds and lifestyles. We embrace diversity and invite applications from people of all walks of life. We don't discriminate against employees or applicants based on gender identity or expression, sexual orientation, race, religion, age, national origin, citizenship, disability, pregnancy status, veteran status, or any other differences. Also, if you have a disability, please let us know if there's any way we can make the interview process better for you; we're happy to accommodate!