{"id":66861,"date":"2022-09-07T09:00:28","date_gmt":"2022-09-07T16:00:28","guid":{"rendered":"https:\/\/github.blog\/?p=66861"},"modified":"2024-05-21T11:32:25","modified_gmt":"2024-05-21T18:32:25","slug":"research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness","status":"publish","type":"post","link":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/","title":{"rendered":"Research: quantifying GitHub Copilot\u2019s impact on developer productivity and happiness"},"content":{"rendered":"<p>Everyday, we use tools and form habits to achieve more with less. Software development produces such a high number of tools and technologies to make work efficient, to the point of inducing decision fatigue. When we first launched a technical preview of GitHub Copilot in 2021, our hypothesis was that it would improve developer productivity and, in fact, early users shared reports that it did. In the months following its release, we wanted to better understand and measure its effects with quantitative and qualitative research. To do that, we first had to grapple with the question: what does it mean to be productive?<\/p>\n<h2 id=\"why-is-developer-productivity-so-difficult-to-measure\"><a class=\"heading-link\" href=\"#why-is-developer-productivity-so-difficult-to-measure\">Why is developer productivity so difficult to measure?<span class=\"heading-hash pl-2 text-italic text-bold\" aria-hidden=\"true\"><\/span><\/a><\/h2>\n<p>When it comes to measuring developer productivity, there is little consensus and there are far more questions than answers. For example:<\/p>\n<ul>\n<li>What are the \u201cright\u201d productivity metrics? [<a href=\"https:\/\/link.springer.com\/article\/10.1007\/s10664-020-09820-z\">1<\/a>, <a href=\"https:\/\/ieeexplore.ieee.org\/abstract\/document\/8643844\">2<\/a>]<\/li>\n<li>How valuable are self-reports of productivity? [<a href=\"https:\/\/dl.acm.org\/doi\/abs\/10.1145\/2635868.2635892?casa_token=j1_2RtHeHBoAAAAA:Ic_ycWwPvzW2a4SPzZ6vFrHQG4N7PzjoCP9cb1CaljCmGge4DNmYiSC2d_Lc7a5rz-9Otiph1nSm\">3<\/a>]<\/li>\n<li>Is the traditional view of productivity\u2014outputs over inputs\u2014a good fit for the complex problem solving and creativity involved in development work? [<a href=\"https:\/\/link.springer.com\/book\/10.1007\/978-1-4842-4221-6\">4<\/a>].<\/li>\n<\/ul>\n<p>In a 2021 study, we found that developers\u2019 own view of productivity has a twist\u2013it\u2019s more akin to having <a href=\"https:\/\/github.blog\/2021-05-25-octoverse-spotlight-good-day-project\/\">a good day<\/a>. The ability to stay focused on the task at hand, make meaningful progress, and feel good at the end of a day\u2019s work make a real difference in developers\u2019 satisfaction and productivity.<\/p>\n<p>This isn\u2019t a one-off finding, either. Other academic research shows that these outcomes are important for developers [<a href=\"https:\/\/discovery.ucl.ac.uk\/id\/eprint\/10090507\/1\/Barr_Today%20was%20a%20Good%20Day.%20The%20Daily%20Life%20of%20Software%20Developers_AAM2.pdf\">5<\/a>] and that satisfied developers perform better [<a href=\"https:\/\/arxiv.org\/pdf\/1505.00922.pdf\">6<\/a>, <a href=\"https:\/\/arxiv.org\/pdf\/1405.4422.pdf\">7<\/a>]. Clearly, there\u2019s more to developer productivity than inputs and outputs.<\/p>\n<h2 id=\"how-do-we-think-about-developer-productivity-at-github\"><a class=\"heading-link\" href=\"#how-do-we-think-about-developer-productivity-at-github\">How do we think about developer productivity at GitHub?<span class=\"heading-hash pl-2 text-italic text-bold\" aria-hidden=\"true\"><\/span><\/a><\/h2>\n<p>Because AI-assisted development is a relatively new field, as researchers we have little prior research to draw upon. We wanted to measure GitHub Copilot\u2019s effects, but what are they? After early observations and interviews with users, we surveyed more than 2,000 developers to learn at scale about their experience using GitHub Copilot. We designed our research approach with three points in mind:<\/p>\n<ul>\n<li><strong>Look at productivity holistically.<\/strong> At GitHub we like to think <a href=\"https:\/\/github.swoogo.com\/2021\/session\/692592\/the-sustainable-future-of-developer-productivity\">broadly and sustainably<\/a> about developer productivity and the many factors that influence it. We used the <a href=\"https:\/\/queue.acm.org\/detail.cfm?id=3454124\">SPACE productivity framework<\/a> to pick which aspects to investigate.<\/li>\n<li><strong>Include developers\u2019 first-hand perspective.<\/strong> We conducted multiple rounds of research including qualitative (perceptual) and quantitative (observed) data to assemble the full picture. We wanted to verify: (a) Do users\u2019 actual experiences confirm what we infer from telemetry? (b) Does our qualitative feedback generalize to our large user base?<\/li>\n<li><strong>Assess GitHub Copilot\u2019s effects in everyday development scenarios.<\/strong> When setting up our studies, we took extra care to recruit professional developers, and to design tests around typical tasks a developer might work through in a given day.<\/li>\n<\/ul>\n<p><a href=\"https:\/\/github.com\/features\/copilot?utm_source=blog&amp;utm_medium=blogB&amp;utm_campaign=cta&amp;utm_content=copilot\"><img data-recalc-dims=\"1\" decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-large wp-image-74436 width-fit\" src=\"https:\/\/github.blog\/wp-content\/uploads\/2023\/08\/1200x300-Blog_Ad-Master-1-1.png?w=1024&#038;resize=1024%2C257\" alt=\"\" width=\"1024\" height=\"257\" srcset=\"https:\/\/github.blog\/wp-content\/uploads\/2023\/08\/1200x300-Blog_Ad-Master-1-1.png?w=1200 1200w, https:\/\/github.blog\/wp-content\/uploads\/2023\/08\/1200x300-Blog_Ad-Master-1-1.png?w=300 300w, https:\/\/github.blog\/wp-content\/uploads\/2023\/08\/1200x300-Blog_Ad-Master-1-1.png?w=768 768w, https:\/\/github.blog\/wp-content\/uploads\/2023\/08\/1200x300-Blog_Ad-Master-1-1.png?w=1024 1024w\" sizes=\"auto, (max-width: 1000px) 100vw, 1000px\" \/><\/a><\/p>\n<p>Let\u2019s dig in and see what we found!<\/p>\n<h3 id=\"finding-1-developer-productivity-goes-beyond-speed\"><a class=\"heading-link\" href=\"#finding-1-developer-productivity-goes-beyond-speed\">Finding 1: Developer productivity goes beyond speed<span class=\"heading-hash pl-2 text-italic text-bold\" aria-hidden=\"true\"><\/span><\/a><\/h3>\n<p>Through a large-scale survey, we wanted to see if developers using GitHub Copilot see benefits in other areas beyond speeding up tasks. Here\u2019s what stood out:<\/p>\n<ul>\n<li><strong>Improving developer satisfaction.<\/strong> Between 60\u201375% of users reported they feel more fulfilled with their job, feel less frustrated when coding, and are able to focus on more satisfying work when using GitHub Copilot. That\u2019s a win for developers feeling good about what they do!<\/li>\n<li><strong>Conserving mental energy.<\/strong> Developers reported that GitHub Copilot helped them stay in the flow (73%) and preserve mental effort during repetitive tasks (87%). That\u2019s developer happiness right there, since we know from previous research that context switches and interruptions can ruin a developer\u2019s day, and that certain types of work are draining [<a href=\"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2635868.2635892?casa_token=QSunRfpWvOQAAAAA:2HVi9JV6N7A5KKMRXe23pT8j71mFXoxdzKwwMiBXd_UdqvAClkQ1H_w3DJx-AJbz9AD9PRHiSYau\">8<\/a>, <a href=\"https:\/\/github.blog\/2021-05-25-octoverse-spotlight-good-day-project\/\">9<\/a>].<\/li>\n<\/ul>\n<aside class=\"p-4 p-md-6 post-aside--large\"><p class=\"h5-mktg gh-aside-title\">What the charts show, and how to read them<\/p><p>\n\ud83d\udcdd <strong>Helpful context:<\/strong> In the survey, we included statements that covered all dimensions of the SPACE framework. SPACE is the acronym for a multidimensional framework that describes several aspects of developer productivity: (1) Satisfaction and well-being; (2) Performance; (3) Activity; (4) Communication and collaboration; and (5) Efficiency and flow. In this post, we focus on the results from the dimensions of &#8220;Satisfaction and well-being&#8221; and &#8220;Efficiency and flow.&#8221;\u2009Both dimensions are critical to developer productivity and are often overlooked. We&#8217;re also preparing more publications of our findings and data, so we can&#8217;t share everything today!<\/p>\n<p>\ud83d\udcca <strong>What the charts show:<\/strong> The charts below show the percentage of respondents who agreed with the corresponding statement (strongly agree + agree). The &gt;2,000 responses we received came from developers that were signed up in the Technical Preview. They were primarily professional developers (~60%), though we also received responses from students (~30%), and developers who identified as hobbyists (~7%).<\/p>\n<p>If you want a refresher on how we also correlated the productivity results to how much developers use GitHub Copilot, check out our <a href=\"https:\/\/github.blog\/2022-07-14-research-how-github-copilot-helps-improve-developer-productivity\">previous blog post<\/a>, and our <a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3520312.3534864\">academic paper<\/a>.<\/p>\n<\/aside>\n<h4 id=\"table-survey-responses-measuring-dimensions-of-developer-productivity-when-using-github-copilot\"><a class=\"heading-link\" href=\"#table-survey-responses-measuring-dimensions-of-developer-productivity-when-using-github-copilot\">Table: Survey responses measuring dimensions of developer productivity when using GitHub Copilot<span class=\"heading-hash pl-2 text-italic text-bold\" aria-hidden=\"true\"><\/span><\/a><\/h4>\n<p><img data-recalc-dims=\"1\" decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-full wp-image-66862 width-fit\" src=\"https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?resize=1024%2C1024\" alt=\"Survey responses measuring dimensions of developer productivity--perceived productivity, satisfaction and well-being, and efficiency and flow--when using GitHub Copilot\" width=\"1024\" height=\"1024\" srcset=\"https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?w=1200 1200w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?w=150 150w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?w=300 300w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?w=768 768w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?w=1024 1024w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?w=600 600w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?w=400 400w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?w=200 200w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?w=1000 1000w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?w=90 90w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copilot1.png?w=116 116w\" sizes=\"auto, (max-width: 1000px) 100vw, 1000px\" \/><br \/>\n<em>All questions were modeled off of <a href=\"https:\/\/queue.acm.org\/detail.cfm?id=3454124\">the SPACE framework<\/a>.<\/em><\/p>\n<p>Developers see GitHub Copilot as a productivity aid, but there\u2019s more to it than that. One user described the overall experience:<\/p>\n<figure class=\"gh-full-blockquote mx-0 pl-6 mt-6 mt-md-7 mb-7 mb-md-8\"><blockquote><p>(With Copilot) I have to think less, and when I have to think it\u2019s the fun stuff. It sets off a little spark that makes coding more fun <b>and<\/b> more efficient.<\/p><\/blockquote><figcaption class=\"text-mono color-fg-muted f5-mktg mt-3\"> - Senior Software Engineer<\/figcaption><\/figure>\n<p>The takeaway from our qualitative investigation was that <strong>letting GitHub Copilot shoulder the boring and repetitive work of development reduced cognitive load<\/strong>. This makes room for developers to enjoy the more meaningful work that requires complex, critical thinking and problem solving, leading to greater happiness and satisfaction.<\/p>\n<h3 id=\"finding-2-but-speed-is-important-too\"><a class=\"heading-link\" href=\"#finding-2-but-speed-is-important-too\">Finding 2: \u2026 but speed is important, too<span class=\"heading-hash pl-2 text-italic text-bold\" aria-hidden=\"true\"><\/span><\/a><\/h3>\n<p>In the survey, we saw that developers reported they complete tasks faster when using GitHub Copilot, especially repetitive ones. That was an expected finding (GitHub Copilot writes faster than a human, after all), but &gt;90% agreement was still a pleasant surprise. Developers overwhelmingly perceive that GitHub Copilot is helping them complete tasks faster\u2014can we observe and measure that effect in practice? For that we conducted a controlled experiment.<\/p>\n<h4 id=\"figure-summary-of-the-experiment-process-and-results\"><a class=\"heading-link\" href=\"#figure-summary-of-the-experiment-process-and-results\">Figure: Summary of the experiment process and results<span class=\"heading-hash pl-2 text-italic text-bold\" aria-hidden=\"true\"><\/span><\/a><\/h4>\n<p><img data-recalc-dims=\"1\" decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-full wp-image-66863 width-fit\" src=\"https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copitlot2.png?resize=1024%2C870\" alt=\"Summary of the experiment process and results (described in following paragraph)\" width=\"1024\" height=\"870\" srcset=\"https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copitlot2.png?w=1600 1600w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copitlot2.png?w=300 300w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copitlot2.png?w=768 768w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copitlot2.png?w=1024 1024w, https:\/\/github.blog\/wp-content\/uploads\/2022\/09\/copitlot2.png?w=1536 1536w\" sizes=\"auto, (max-width: 1000px) 100vw, 1000px\" \/><br \/>\nWe recruited 95 professional developers, split them randomly into two groups, and timed how long it took them to write an HTTP server in JavaScript. One group used GitHub Copilot to complete the task, and the other one didn\u2019t. We tried to control as many factors as we could\u2013all developers were already familiar with JavaScript, we gave everyone the same instructions, and we leveraged GitHub Classroom to automatically score submissions for correctness and completeness with a test suite. We\u2019re sharing a behind-the-scenes blog post soon about how we set up our experiment!<\/p>\n<p>In the experiment, we measured\u2014on average\u2014how successful each group was in completing the task and how long each group took to finish.<\/p>\n<ul>\n<li>The group that used GitHub Copilot had a <strong>higher rate of completing the task<\/strong> (78%, compared to 70% in the group without Copilot).<\/li>\n<li>The striking difference was that <strong>developers who used GitHub Copilot completed the task significantly faster\u201355% faster than the developers who didn\u2019t use GitHub Copilot<\/strong>. Specifically, the developers using GitHub Copilot took on average 1 hour and 11 minutes to complete the task, while the developers who didn\u2019t use GitHub Copilot took on average 2 hours and 41 minutes. These results are statistically significant (<em>P=.0017<\/em>) and the 95% confidence interval for the percentage speed gain is [21%, 89%].<\/li>\n<\/ul>\n<p>There\u2019s more to uncover! We\u2019re conducting more experiments and a more thorough analysis of the experiment data we already collected\u2014looking into heterogeneous effects, or potential effects on the quality of code\u2014and we are planning further academic publications to share our findings.<\/p>\n<h2 id=\"what-do-these-findings-mean-for-developers\"><a class=\"heading-link\" href=\"#what-do-these-findings-mean-for-developers\">What do these findings mean for developers?<span class=\"heading-hash pl-2 text-italic text-bold\" aria-hidden=\"true\"><\/span><\/a><\/h2>\n<p>We\u2019re here to support developers while they build software\u2014that includes working more efficiently and finding more satisfaction in their work. In our research, we saw that <strong>GitHub Copilot supports faster completion times, conserves developers\u2019 mental energy, helps them focus on more satisfying work, and ultimately find more fun in the coding they do.<\/strong><\/p>\n<p>We\u2019re also hearing that these benefits are becoming material to engineering leaders in companies that ran early trials with GitHub Copilot. When they consider how to keep their engineers healthy and productive, they are thinking through the same lens of holistic developer wellbeing and promoting the use of tools that bring delight.<\/p>\n<figure class=\"gh-full-blockquote mx-0 pl-6 mt-6 mt-md-7 mb-7 mb-md-8\"><blockquote><p>The engineers\u2019 satisfaction with doing edgy things and us giving them edgy tools is a factor for me. Copilot makes things more exciting.<\/p><\/blockquote><figcaption class=\"text-mono color-fg-muted f5-mktg mt-3\"> - CTO, Large Engineering Org<\/figcaption><\/figure>\n<p>With the advent of GitHub Copilot, we\u2019re not alone in exploring the impact of AI-powered code completion tools! In the realm of productivity, we recently saw <a href=\"https:\/\/tianyi-zhang.github.io\/files\/chi2022-lbw-copilot.pdf\">an evaluation with 24 students<\/a>, and <a href=\"https:\/\/ai.googleblog.com\/2022\/07\/ml-enhanced-code-completion-improves.html\">Google\u2019s internal assessment of ML-enhanced code completion<\/a>. More broadly, the research community is trying to understand GitHub Copilot\u2019s implications in a number of contexts: <a href=\"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3511861.3511863\">education<\/a>, <a href=\"https:\/\/arxiv.org\/abs\/2208.09727\">security<\/a>, <a href=\"https:\/\/github.com\/github\/developer-policy\/issues\/5\">labor market<\/a>, as well as developer <a href=\"https:\/\/ieeexplore.ieee.org\/document\/9796235\">practices<\/a> and <a href=\"https:\/\/arxiv.org\/abs\/2206.15000\">behaviors<\/a>. We are all currently learning by trying GitHub Copilot in a variety of settings. This is an evolving field, and we\u2019re excited for the findings that the research community\u2009\u2014\u2009including us\u2009\u2014\u2009will uncover in the months to come.<\/p>\n<h2 id=\"acknowledgements\"><a class=\"heading-link\" href=\"#acknowledgements\">Acknowledgements<span class=\"heading-hash pl-2 text-italic text-bold\" aria-hidden=\"true\"><\/span><\/a><\/h2>\n<p>We are very grateful to all the developers who participated in the survey and experiments\u2013we would be in the dark without your input! <a href=\"https:\/\/githubnext.com\/\">GitHub Next<\/a> conducted the experiment in partnership with the Microsoft Office of the Chief Economist, and specifically in collaboration with <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/people\/sidpeng\/\">Sida Peng<\/a> and <a href=\"https:\/\/aadharshkannan.com\/\">Aadharsh Kannan<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>When the GitHub Copilot Technical Preview launched just over one year ago, we wanted to know one thing: Is this tool helping developers? The GitHub Next team conducted research using a combination of surveys and experiments, which led us to expected and unexpected answers.<\/p>\n","protected":false},"author":1892,"featured_media":65782,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_gh_post_show_toc":"no","_gh_post_is_no_robots":"no","_gh_post_is_featured":"no","_gh_post_is_excluded":"no","_gh_post_is_unlisted":"no","_gh_post_related_link_1":"","_gh_post_related_link_2":"","_gh_post_related_link_3":"","_gh_post_sq_img":"","_gh_post_sq_img_id":"","_gh_post_cta_title":"","_gh_post_cta_text":"","_gh_post_cta_link":"","_gh_post_cta_button":"Click Here to Learn More","_gh_post_recirc_hide":"no","_gh_post_recirc_col_1":"gh-auto-select","_gh_post_recirc_col_2":"70306","_gh_post_recirc_col_3":"65303","_gh_post_recirc_col_4":"65316","_featured_video":"","_gh_post_additional_query_params":"","_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"_wpas_customize_per_network":false,"_links_to":"","_links_to_target":""},"categories":[3321,3326],"tags":[2535,2842],"coauthors":[2192],"class_list":["post-66861","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news-insights","category-research","tag-github-copilot","tag-research"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.5 (Yoast SEO v27.5) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Research: quantifying GitHub Copilot\u2019s impact on developer productivity and happiness - The GitHub Blog<\/title>\n<meta name=\"description\" content=\"When the GitHub Copilot Technical Preview launched just over one year ago, we wanted to know one thing: Is this tool helping developers? The GitHub Next team conducted research using a combination of surveys and experiments, which led us to expected and unexpected answers.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Research: quantifying GitHub Copilot\u2019s impact on developer productivity and happiness\" \/>\n<meta property=\"og:description\" content=\"When the GitHub Copilot Technical Preview launched just over one year ago, we wanted to know one thing: Is this tool helping developers? The GitHub Next team conducted research using a combination of surveys and experiments, which led us to expected and unexpected answers.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/\" \/>\n<meta property=\"og:site_name\" content=\"The GitHub Blog\" \/>\n<meta property=\"article:published_time\" content=\"2022-09-07T16:00:28+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-05-21T18:32:25+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/github.blog\/wp-content\/uploads\/2022\/06\/Copilot.jpeg?fit=1200%2C630\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Eirini Kalliamvakou\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/github.blog\/wp-content\/uploads\/2022\/06\/Copilot.jpeg?fit=1200%2C630\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Eirini Kalliamvakou\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/\"},\"author\":{\"name\":\"Eirini Kalliamvakou\",\"@id\":\"https:\\\/\\\/github.blog\\\/#\\\/schema\\\/person\\\/e62d37d5cfc5754750ba351eb9024108\"},\"headline\":\"Research: quantifying GitHub Copilot\u2019s impact on developer productivity and happiness\",\"datePublished\":\"2022-09-07T16:00:28+00:00\",\"dateModified\":\"2024-05-21T18:32:25+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/\"},\"wordCount\":1558,\"image\":{\"@id\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/github.blog\\\/wp-content\\\/uploads\\\/2022\\\/06\\\/Copilot.jpeg?fit=1200%2C630\",\"keywords\":[\"GitHub Copilot\",\"research\"],\"articleSection\":[\"News &amp; insights\",\"Research\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/\",\"url\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/\",\"name\":\"Research: quantifying GitHub Copilot\u2019s impact on developer productivity and happiness - The GitHub Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/github.blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/github.blog\\\/wp-content\\\/uploads\\\/2022\\\/06\\\/Copilot.jpeg?fit=1200%2C630\",\"datePublished\":\"2022-09-07T16:00:28+00:00\",\"dateModified\":\"2024-05-21T18:32:25+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/github.blog\\\/#\\\/schema\\\/person\\\/e62d37d5cfc5754750ba351eb9024108\"},\"description\":\"When the GitHub Copilot Technical Preview launched just over one year ago, we wanted to know one thing: Is this tool helping developers? The GitHub Next team conducted research using a combination of surveys and experiments, which led us to expected and unexpected answers.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/#primaryimage\",\"url\":\"https:\\\/\\\/github.blog\\\/wp-content\\\/uploads\\\/2022\\\/06\\\/Copilot.jpeg?fit=1200%2C630\",\"contentUrl\":\"https:\\\/\\\/github.blog\\\/wp-content\\\/uploads\\\/2022\\\/06\\\/Copilot.jpeg?fit=1200%2C630\",\"width\":1200,\"height\":630,\"caption\":\"GitHub Copilot logo.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/github.blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"News &amp; insights\",\"item\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Research\",\"item\":\"https:\\\/\\\/github.blog\\\/news-insights\\\/research\\\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Research: quantifying GitHub Copilot\u2019s impact on developer productivity and happiness\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/github.blog\\\/#website\",\"url\":\"https:\\\/\\\/github.blog\\\/\",\"name\":\"The GitHub Blog\",\"description\":\"Updates, ideas, and inspiration from GitHub to help developers build and design software.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/github.blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/github.blog\\\/#\\\/schema\\\/person\\\/e62d37d5cfc5754750ba351eb9024108\",\"name\":\"Eirini Kalliamvakou\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f8a70dd4d71e203f5bb4c633b65d2ea8f459a83d77a562debd2e363a27ebb2b1?s=96&d=mm&r=g09b26bfdffc08582169e6e0c96e23b33\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f8a70dd4d71e203f5bb4c633b65d2ea8f459a83d77a562debd2e363a27ebb2b1?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/f8a70dd4d71e203f5bb4c633b65d2ea8f459a83d77a562debd2e363a27ebb2b1?s=96&d=mm&r=g\",\"caption\":\"Eirini Kalliamvakou\"},\"description\":\"Dr. Eirini Kalliamvakou is a Research Advisor at GitHub, and leads research that deciphers developers' motivations, needs, behavior, and how tools support them. Her insights shape product thinking, strategic storytelling, and leadership decisions across the company. Eirini holds a PhD in Computer Science from the University of Victoria, and speaks about developer productivity, happiness, and the impact of AI on individuals, teams, and organizations.\",\"url\":\"https:\\\/\\\/github.blog\\\/author\\\/ikaliam\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Research: quantifying GitHub Copilot\u2019s impact on developer productivity and happiness - The GitHub Blog","description":"When the GitHub Copilot Technical Preview launched just over one year ago, we wanted to know one thing: Is this tool helping developers? The GitHub Next team conducted research using a combination of surveys and experiments, which led us to expected and unexpected answers.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/","og_locale":"en_US","og_type":"article","og_title":"Research: quantifying GitHub Copilot\u2019s impact on developer productivity and happiness","og_description":"When the GitHub Copilot Technical Preview launched just over one year ago, we wanted to know one thing: Is this tool helping developers? The GitHub Next team conducted research using a combination of surveys and experiments, which led us to expected and unexpected answers.","og_url":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/","og_site_name":"The GitHub Blog","article_published_time":"2022-09-07T16:00:28+00:00","article_modified_time":"2024-05-21T18:32:25+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/github.blog\/wp-content\/uploads\/2022\/06\/Copilot.jpeg?fit=1200%2C630","type":"image\/jpeg"}],"author":"Eirini Kalliamvakou","twitter_card":"summary_large_image","twitter_image":"https:\/\/github.blog\/wp-content\/uploads\/2022\/06\/Copilot.jpeg?fit=1200%2C630","twitter_misc":{"Written by":"Eirini Kalliamvakou","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/#article","isPartOf":{"@id":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/"},"author":{"name":"Eirini Kalliamvakou","@id":"https:\/\/github.blog\/#\/schema\/person\/e62d37d5cfc5754750ba351eb9024108"},"headline":"Research: quantifying GitHub Copilot\u2019s impact on developer productivity and happiness","datePublished":"2022-09-07T16:00:28+00:00","dateModified":"2024-05-21T18:32:25+00:00","mainEntityOfPage":{"@id":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/"},"wordCount":1558,"image":{"@id":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/#primaryimage"},"thumbnailUrl":"https:\/\/github.blog\/wp-content\/uploads\/2022\/06\/Copilot.jpeg?fit=1200%2C630","keywords":["GitHub Copilot","research"],"articleSection":["News &amp; insights","Research"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/","url":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/","name":"Research: quantifying GitHub Copilot\u2019s impact on developer productivity and happiness - The GitHub Blog","isPartOf":{"@id":"https:\/\/github.blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/#primaryimage"},"image":{"@id":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/#primaryimage"},"thumbnailUrl":"https:\/\/github.blog\/wp-content\/uploads\/2022\/06\/Copilot.jpeg?fit=1200%2C630","datePublished":"2022-09-07T16:00:28+00:00","dateModified":"2024-05-21T18:32:25+00:00","author":{"@id":"https:\/\/github.blog\/#\/schema\/person\/e62d37d5cfc5754750ba351eb9024108"},"description":"When the GitHub Copilot Technical Preview launched just over one year ago, we wanted to know one thing: Is this tool helping developers? The GitHub Next team conducted research using a combination of surveys and experiments, which led us to expected and unexpected answers.","breadcrumb":{"@id":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/#primaryimage","url":"https:\/\/github.blog\/wp-content\/uploads\/2022\/06\/Copilot.jpeg?fit=1200%2C630","contentUrl":"https:\/\/github.blog\/wp-content\/uploads\/2022\/06\/Copilot.jpeg?fit=1200%2C630","width":1200,"height":630,"caption":"GitHub Copilot logo."},{"@type":"BreadcrumbList","@id":"https:\/\/github.blog\/news-insights\/research\/research-quantifying-github-copilots-impact-on-developer-productivity-and-happiness\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/github.blog\/"},{"@type":"ListItem","position":2,"name":"News &amp; insights","item":"https:\/\/github.blog\/news-insights\/"},{"@type":"ListItem","position":3,"name":"Research","item":"https:\/\/github.blog\/news-insights\/research\/"},{"@type":"ListItem","position":4,"name":"Research: quantifying GitHub Copilot\u2019s impact on developer productivity and happiness"}]},{"@type":"WebSite","@id":"https:\/\/github.blog\/#website","url":"https:\/\/github.blog\/","name":"The GitHub Blog","description":"Updates, ideas, and inspiration from GitHub to help developers build and design software.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/github.blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/github.blog\/#\/schema\/person\/e62d37d5cfc5754750ba351eb9024108","name":"Eirini Kalliamvakou","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/f8a70dd4d71e203f5bb4c633b65d2ea8f459a83d77a562debd2e363a27ebb2b1?s=96&d=mm&r=g09b26bfdffc08582169e6e0c96e23b33","url":"https:\/\/secure.gravatar.com\/avatar\/f8a70dd4d71e203f5bb4c633b65d2ea8f459a83d77a562debd2e363a27ebb2b1?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/f8a70dd4d71e203f5bb4c633b65d2ea8f459a83d77a562debd2e363a27ebb2b1?s=96&d=mm&r=g","caption":"Eirini Kalliamvakou"},"description":"Dr. Eirini Kalliamvakou is a Research Advisor at GitHub, and leads research that deciphers developers' motivations, needs, behavior, and how tools support them. Her insights shape product thinking, strategic storytelling, and leadership decisions across the company. Eirini holds a PhD in Computer Science from the University of Victoria, and speaks about developer productivity, happiness, and the impact of AI on individuals, teams, and organizations.","url":"https:\/\/github.blog\/author\/ikaliam\/"}]}},"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/github.blog\/wp-content\/uploads\/2022\/06\/Copilot.jpeg?fit=1200%2C630","jetpack_shortlink":"https:\/\/wp.me\/pamS32-hop","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/posts\/66861","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/users\/1892"}],"replies":[{"embeddable":true,"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/comments?post=66861"}],"version-history":[{"count":29,"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/posts\/66861\/revisions"}],"predecessor-version":[{"id":78115,"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/posts\/66861\/revisions\/78115"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/media\/65782"}],"wp:attachment":[{"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/media?parent=66861"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/categories?post=66861"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/tags?post=66861"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/github.blog\/wp-json\/wp\/v2\/coauthors?post=66861"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}