{"id":62778,"date":"2022-09-30T12:00:00","date_gmt":"2022-09-30T03:00:00","guid":{"rendered":"https:\/\/smilegate.ai\/?p=62778"},"modified":"2023-07-10T07:39:17","modified_gmt":"2023-07-09T22:39:17","slug":"bigcode","status":"publish","type":"post","link":"https:\/\/smilegate.ai\/cn\/2022\/09\/30\/bigcode\/","title":{"rendered":"BigCode"},"content":{"rendered":"<p>[\ubd84\uc11d\uc9c0\ub2a5\uac1c\ubc1c\ud300 \uc774\ud604\uc815]<\/p>\n\n\n\n<p>Huggingface\uc640 ServiceNow Research\uac00 \ud568\uaed8 \uc9c0\ub09c 27\uc77c \uc0c8\ub86d\uac8c \ub7f0\uce6d\ud55c \ud504\ub85c\uc81d\ud2b8 BigCode\uc5d0 \ub300\ud574 \uc18c\uac1c\ud558\uace0\uc790 \ud569\ub2c8\ub2e4.<\/p>\n\n\n\n<p>BigCode\ub294 Code\ub97c \uc704\ud55c \ub300\uaddc\ubaa8 \uc5b8\uc5b4\ubaa8\ub378\uc758 \ucc45\uc784\uc788\ub294 \uac1c\ubc1c\uc744 \uc704\ud574 \uc791\uc5c5\ud558\ub294 Open Scientific Colloboration \ub77c\uace0 \ud569\ub2c8\ub2e4.<br>(BigCode is an open scientific colloboration working on the responsible development of large language models for code.)<\/p>\n\n\n\n<p>\uc774\ubbf8 Code\ub97c \uc0dd\uc131\ud574\uc8fc\uac70\ub098 Code \uc791\uc131\uc5d0 \ub3c4\uc6c0\uc744 \uc8fc\ub294 Codex (OpenAI), AlphaCode (DeepMind), CodeWhisperer (Amazon), Copilot (GitHub), DeepDev (Microsoft) \uac19\uc740 \ud234\uc774 \uc788\uace0, \uadf8 \uae30\ub2a5\uacfc \ud6a8\uacfc\uc5d0 \ub300\ud574\uc11c \uc18c\uc704 &#8216;\uac1c\ubc1c\uc790\ubcf4\ub2e4 \ub354 \ucf54\ub529\uc744 \uc798\ud558\ub294&#8217; \uc790\uc870 \uc11e\uc778 \ud3c9\uac00\ub97c \ubc1b\uc744 \uc815\ub3c4\ub85c \uc778\uc815\uc744 \ubc1b\uace0 \uc788\uc5c8\uc73c\ub098, \uc77c\ubd80 \uae30\ub2a5\ub9cc \ubb34\ub8cc\ub85c \uc81c\uacf5\ub418\uac70\ub098 \ud55c\uc2dc\uc801\uc73c\ub85c\ub9cc \ubb34\ub8cc \uc81c\uacf5\ud558\ub294 \ub4f1\uc758 \uc81c\ud55c\uc774 \uc788\uace0, \ubb34\uc5c7\ubcf4\ub2e4 \uc0c1\ub2f9\uc218\ub294 \uc624\ud508\uc18c\uc2a4\uc5d0\uc11c \uc0ac\uc6a9\ud560 \uc218 \uc5c6\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-29-\u110b\u1169\u1112\u116e-4.45.22-1024x442.png\" alt=\"\" class=\"wp-image-62780\" width=\"866\" height=\"374\" srcset=\"https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-29-\u110b\u1169\u1112\u116e-4.45.22-1024x442.png 1024w, https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-29-\u110b\u1169\u1112\u116e-4.45.22-300x130.png 300w, https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-29-\u110b\u1169\u1112\u116e-4.45.22-768x332.png 768w, https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-29-\u110b\u1169\u1112\u116e-4.45.22-1536x664.png 1536w, https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-29-\u110b\u1169\u1112\u116e-4.45.22-18x8.png 18w, https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-29-\u110b\u1169\u1112\u116e-4.45.22.png 1926w\" sizes=\"(max-width: 866px) 100vw, 866px\" \/><\/figure>\n\n\n\n<p>\uc774\uc5d0 Hugging face\uc640 ServiceNow\uac00 &#8216;\uacf5\uac1c\uc801\uc774\uace0 \ucc45\uc784\uc788\ub294 \ubc29\uc2dd'(an open and responsible way)\uc758 \ucf54\ub4dc \uc0dd\uc131 AI\ubaa8\ub378\uc744 \uac1c\ubc1c\ud558\uae30 \uc704\ud55c \ubaa9\uc801\uc73c\ub85c BigCode \ud504\ub85c\uc81d\ud2b8\ub97c \uc2dc\uc791\ud55c\ub2e4\uace0 \ud569\ub2c8\ub2e4.<br>BigCode\uc758 \uccab \ubc88\uc9f8 \ubaa9\ud45c\ub294 \ucf54\ub4dc\uc5d0 \ub300\ud55c SOTA\uae09(a state-of-the-art) \uc5b8\uc5b4 \ubaa8\ub378\uc744 \ud2b8\ub808\uc774\ub2dd \ud560 \uc218 \uc788\uc744 \ub9cc\ud07c \ucda9\ubd84\ud788 \ud070 \ub370\uc774\ud130 \uc14b\uc744 \uac1c\ubc1c\ud558\uace0 \ucd9c\uc2dc\ud558\ub294 \uac83\uc774\ub77c\uace0 \ud569\ub2c8\ub2e4.<br>\uc774 \ub370\uc774\ud130 \uc14b\uc744 \uc774\uc6a9\ud558\uc5ec \ucf54\ub4dc\uc5d0 \ub300\ud55c 150\uc5b5 \ub9e4\uac1c\ubcc0\uc218 \uc5b8\uc5b4 \ubaa8\ub378\uc744 \ud2b8\ub808\uc774\ub2dd\ud558\uace0, NVIDIA\uc758 Megatron-LM\uc758 \uac1c\uc870\ub41c \ubc84\uc804\uc744 \uc0ac\uc6a9\ud558\uc5ec \ubd84\uc0b0 \uc778\ud504\ub77c\uc5d0\uc11c LLM(Large Language Model)\uc744 \ud2b8\ub808\uc774\ub2dd \ud560 \uac83\uc774\ub77c\uace0 \ud569\ub2c8\ub2e4.<\/p>\n\n\n\n<p>BigCode\uce21\uc740 &#8216;AI\uc804\ubb38\uac00\uc774\uba74\uc11c \ud504\ub85c\uc81d\ud2b8\uc5d0 \uc2dc\uac04\uc744 \ud560\uc560\ud560 \uc218 \uc788\ub294 \ubaa8\ub4e0 \uc0ac\ub78c\uc5d0\uac8c \uc624\ud508\ub418\uc5b4 \uc788\ub2e4&#8217; \uba74\uc11c \uc544\ub798 \uc8fc\uc81c\ub97c \ud568\uaed8 \ud560 AI\uc804\ubb38\uac00 \uc790\uc6d0\ubd09\uc0ac\uc790 \ubaa8\uc9d1\uc744 \uc2dc\uc791\ud588\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\ub2e4\uc591\ud55c \uc791\uc5c5 \ubc0f \ud504\ub85c\uadf8\ub798\ubc0d \uc5b8\uc5b4\ub97c \ub2e4\ub8e8\ub294 \ucf54\ub4dc LLM\uc744 \uc704\ud55c \ub300\ud45c\uc801\uc778 \ud3c9\uac00 \uc81c\ud488\uad70 (A representative evaluation suite for code LLMs covering a diverse set of tasks and programming languages)<\/li>\n\n\n\n<li>\ucf54\ub4dc LLM\uc6a9 \ub370\uc774\ud130 \uc14b\uc758 \ucc45\uc784\uc788\ub294 \uac1c\ubc1c \ubc0f \ud611\ub825 (Responsible development and governance of data sets for code LLMs)<\/li>\n\n\n\n<li>LLM\uc744 \uc704\ud55c \ub354 \ube60\ub978 \ud2b8\ub808\uc774\ub2dd \ubc0f \ucd94\ub860 \ubc29\ubc95 (Faster training and inference methods for LLMs)<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-30-\u110b\u1169\u110c\u1165\u11ab-10.58.48-1024x486.png\" alt=\"\" class=\"wp-image-62782\" width=\"587\" height=\"279\" srcset=\"https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-30-\u110b\u1169\u110c\u1165\u11ab-10.58.48-1024x486.png 1024w, https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-30-\u110b\u1169\u110c\u1165\u11ab-10.58.48-300x142.png 300w, https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-30-\u110b\u1169\u110c\u1165\u11ab-10.58.48-768x365.png 768w, https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-30-\u110b\u1169\u110c\u1165\u11ab-10.58.48-18x9.png 18w, https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/\u1109\u1173\u110f\u1173\u1105\u1175\u11ab\u1109\u1163\u11ba-2022-09-30-\u110b\u1169\u110c\u1165\u11ab-10.58.48.png 1436w\" sizes=\"(max-width: 587px) 100vw, 587px\" \/><figcaption class=\"wp-element-caption\">AI\uc804\ubb38\uac00 \uc790\uc6d0\ubd09\uc0ac\uc790 \ubaa8\uc9d1 \ud398\uc774\uc9c0<\/figcaption><\/figure>\n\n\n\n<p>BigCode \uc8fc\ucd5c\uc790\ub4e4\uc740 \ub77c\uc774\uc120\uc2a4 \ubb38\uc81c\uac00 \ud574\uacb0\ub41c \ub9ac\ud3ec\uc9c0\ud1a0\ub9ac\uc758 \ud30c\uc77c\ub9cc \ud2b8\ub808\uc774\ub2dd \ub370\uc774\ud130 \uc14b\uc5d0 \ud3ec\ud568\ub418\ub3c4\ub85d \ud560 \uac83\uc774\uba70, \uc774 \uacfc\uc815\uc5d0\uc11c \ubaa8\ub4e0 \uc720\ud615\uc758 \ucf54\ub4dc \uc0dd\uc131 \uc2dc\uc2a4\ud15c\uc744 \ud2b8\ub808\uc774\ub2dd\ud558\uace0 \uacf5\uc720\ud558\uae30 \uc704\ud55c \uc724\ub9ac\uc801\uc73c\ub85c \uacf5\uc815\ud55c AI\uad00\ud589\uc744 \uc218\ub9bd\ud560 \uac83\uc774\ub77c\uace0 \ud588\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n<p>\ud504\ub85c\uc81d\ud2b8\uc758 \uc644\ub8cc\uc2dc\uae30 \ub300\ud574\uc11c\ub294 BigCode \uad00\ub828 \ube14\ub85c\uadf8\ub098 \uc0ac\uc774\ud2b8\uc5d0\uc11c\ub294 \ucc3e\uc744 \uc218 \uc5c6\uc5c8\uc73c\ub098, \ubc95\uc801, \uc724\ub9ac\uc801\uc73c\ub85c \uc0ac\uc6a9\uc774 \uc790\uc720\ub85c\uc6b4 AI\uae30\ubc18\uc758 \ucf54\ub529 \ud234\uc740 \uc5b4\ub5a4 \ubc29\uc2dd\uc774\ub4e0 \uac1c\ubc1c \ube44\uc6a9\uc744 \uc0c1\ub2f9\ud788 \ub0ae\ucd9c \uac83\uc774\ub77c\uace0 \uc0dd\uac01\ub418\uba70, \uac1c\ubc1c\uc790\/\ube44\uac1c\ubc1c\uc790 \uad6c\ubd84 \uc5c6\uc774 \ucc3d\uc758\uc801\uc778 \uc791\uc5c5\uc5d0 \uc9d1\uc911\ud558\ub294\ub370 \ud070 \ub3c4\uc6c0\uc774 \ub420 \uac83\uc774\ub77c\uace0 \uae30\ub300\ud558\uace0 \uc788\uc5b4\uc11c \uac1c\uc778\uc801\uc73c\ub85c\ub3c4 \uc774 \ud504\ub85c\uc81d\ud2b8\uac00 \uc131\uacf5\ud558\uc5ec, \ub2e4\uc591\ud55c \ud504\ub85c\uadf8\ub798\ubc0d \uc5b8\uc5b4\uc640, \ub2e4\uc591\ud55c \ucf00\uc774\uc2a4\ub97c \ud574\uc18c\ud560 \uc218 \uc788\ub294 \ud68d\uae30\uc801\uc778 AI\uae30\ubc18\uc758 \uc624\ud508\uc18c\uc2a4 \ucf54\ub529 \ud234\uc774 \ud0c4\uc0dd\ud558\uae38 \ubc14\ub78d\ub2c8\ub2e4.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p>\u53c2\u8003<\/p>\n\n\n\n<p>https:\/\/www.bigcode-project.org\/<br>https:\/\/www.servicenow.com\/blogs\/2022\/bigcode-large-language-models.html<br>https:\/\/twitter.com\/BigCodeProject<br>https:\/\/techcrunch.com\/2022\/09\/26\/hugging-face-and-servicenow-launch-bigcode-a-project-to-open-source-code-generating-ai-systems\/<br>https:\/\/enterprisetalk.com\/quick-bytes\/hugging-face-and-servicenow-introduce-bigcode-a-project-to-open-source-code-generating-ai-systems\/<br>https:\/\/github.com\/NVIDIA\/Megatron-LM<br>http:\/\/www.aitimes.com\/news\/articleView.html?idxno=147019<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n<div class=\"likebtn_container\" style=\"\"><!-- LikeBtn.com BEGIN --><span class=\"likebtn-wrapper\"  data-identifier=\"post_62778\"  data-site_id=\"5f255b28943ec9a60bed08fd\"  data-lang=\"ko\"  data-dislike_enabled=\"false\"  data-icon_dislike_show=\"false\"  data-tooltip_enabled=\"false\"  data-white_label=\"true\"  data-rich_snippet=\"true\"  data-popup_disabled=\"true\"  data-i18n_like=\"Like\"  data-style=\"\"  data-unlike_allowed=\"\"  data-show_copyright=\"\"  data-item_url=\"https:\/\/smilegate.ai\/cn\/2022\/09\/30\/bigcode\/\"  data-item_title=\"BigCode\"  data-item_image=\"https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/bigcode-main-1024x510.jpeg\"  data-item_date=\"2022-09-30T12:00:00+09:00\"  data-engine=\"WordPress\"  data-plugin_v=\"2.6.55\"  data-prx=\"https:\/\/smilegate.ai\/wp-admin\/admin-ajax.php?action=likebtn_prx\"  data-event_handler=\"likebtn_eh\" ><\/span><!-- LikeBtn.com END --><\/div>","protected":false},"excerpt":{"rendered":"<p>[\ubd84\uc11d\uc9c0\ub2a5\uac1c\ubc1c\ud300 \uc774\ud604\uc815] Huggingface\uc640 ServiceNow Research\uac00 \ud568\uaed8 \uc9c0\ub09c 27\uc77c \uc0c8\ub86d\uac8c \ub7f0\uce6d\ud55c \ud504\ub85c\uc81d\ud2b8 BigCode\uc5d0 \ub300\ud574 \uc18c\uac1c\ud558\uace0\uc790 \ud569\ub2c8\ub2e4. BigCode\ub294 Code\ub97c \uc704\ud55c \ub300\uaddc\ubaa8 \uc5b8\uc5b4\ubaa8\ub378\uc758 \ucc45\uc784\uc788\ub294 \uac1c\ubc1c\uc744 \uc704\ud574 \uc791\uc5c5\ud558\ub294 Open Scientific Colloboration \ub77c\uace0 \ud569\ub2c8\ub2e4.(BigCode is an open scientific colloboration working on the responsible development of large language models for code.) \uc774\ubbf8 Code\ub97c \uc0dd\uc131\ud574\uc8fc\uac70\ub098 Code \uc791\uc131\uc5d0 \ub3c4\uc6c0\uc744 \uc8fc\ub294 Codex (OpenAI), AlphaCode&hellip;<\/p>\n<div class=\"likebtn_container\" style=\"\"><!-- LikeBtn.com BEGIN --><span class=\"likebtn-wrapper\"  data-identifier=\"post_62778\"  data-site_id=\"5f255b28943ec9a60bed08fd\"  data-lang=\"ko\"  data-dislike_enabled=\"false\"  data-icon_dislike_show=\"false\"  data-tooltip_enabled=\"false\"  data-white_label=\"true\"  data-rich_snippet=\"true\"  data-popup_disabled=\"true\"  data-i18n_like=\"Like\"  data-style=\"\"  data-unlike_allowed=\"\"  data-show_copyright=\"\"  data-item_url=\"https:\/\/smilegate.ai\/cn\/2022\/09\/30\/bigcode\/\"  data-item_title=\"BigCode\"  data-item_image=\"https:\/\/smilegate.ai\/wp-content\/uploads\/2022\/09\/bigcode-main-1024x510.jpeg\"  data-item_date=\"2022-09-30T12:00:00+09:00\"  data-engine=\"WordPress\"  data-plugin_v=\"2.6.55\"  data-prx=\"https:\/\/smilegate.ai\/wp-admin\/admin-ajax.php?action=likebtn_prx\"  data-event_handler=\"likebtn_eh\" ><\/span><!-- LikeBtn.com END --><\/div>","protected":false},"author":1,"featured_media":62779,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"rank_math_lock_modified_date":false,"footnotes":""},"categories":[532,19,196],"tags":[446,622,623,624],"class_list":["post-62778","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-nlp","category-tech04","category-code","tag-huggingface","tag-bigcode","tag-servicenow","tag-codingtool","category-532","category-19","category-196","description-off"],"_links":{"self":[{"href":"https:\/\/smilegate.ai\/cn\/wp-json\/wp\/v2\/posts\/62778","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/smilegate.ai\/cn\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/smilegate.ai\/cn\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/smilegate.ai\/cn\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/smilegate.ai\/cn\/wp-json\/wp\/v2\/comments?post=62778"}],"version-history":[{"count":5,"href":"https:\/\/smilegate.ai\/cn\/wp-json\/wp\/v2\/posts\/62778\/revisions"}],"predecessor-version":[{"id":63816,"href":"https:\/\/smilegate.ai\/cn\/wp-json\/wp\/v2\/posts\/62778\/revisions\/63816"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/smilegate.ai\/cn\/wp-json\/wp\/v2\/media\/62779"}],"wp:attachment":[{"href":"https:\/\/smilegate.ai\/cn\/wp-json\/wp\/v2\/media?parent=62778"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/smilegate.ai\/cn\/wp-json\/wp\/v2\/categories?post=62778"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/smilegate.ai\/cn\/wp-json\/wp\/v2\/tags?post=62778"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}