{"id":4292,"date":"2022-11-29T09:47:05","date_gmt":"2022-11-29T00:47:05","guid":{"rendered":"https:\/\/kakaoenterprise.com\/?post_type=about&p=4292"},"modified":"2022-12-09T15:45:19","modified_gmt":"2022-12-09T06:45:19","slug":"%ec%9e%90%ec%97%b0%ec%96%b4%ec%b2%98%eb%a6%ac-%eb%b6%84%ec%95%bc-%ea%b8%80%eb%a1%9c%eb%b2%8c-%ec%b5%9c%ea%b3%a0-%ed%95%99%ed%9a%8c-emnlp%ec%97%90%ec%84%9c-%eb%85%bc%eb%ac%b8-3","status":"publish","type":"about","link":"https:\/\/kakaoenterprise.com\/about\/%ec%9e%90%ec%97%b0%ec%96%b4%ec%b2%98%eb%a6%ac-%eb%b6%84%ec%95%bc-%ea%b8%80%eb%a1%9c%eb%b2%8c-%ec%b5%9c%ea%b3%a0-%ed%95%99%ed%9a%8c-emnlp%ec%97%90%ec%84%9c-%eb%85%bc%eb%ac%b8-3\/","title":{"rendered":"\uc790\uc5f0\uc5b4\ucc98\ub9ac \ubd84\uc57c \uae00\ub85c\ubc8c \ucd5c\uace0 \ud559\ud68c \u2018EMNLP\u2019\uc5d0\uc11c \ub17c\ubb38 3\ud3b8 \ubc1c\ud45c"},"content":{"rendered":"\n

\uce74\uce74\uc624\uc5d4\ud130\ud504\ub77c\uc774\uc988\uac00 \uc790\uc5f0\uc5b4\ucc98\ub9ac(NLP) \ubd84\uc57c \uae00\ub85c\ubc8c \ucd5c\uace0 \ud559\ud68c \u2018EMNLP\u2019\uc5d0\uc11c \ucd1d 3\ud3b8\uc758 \ub17c\ubb38\uc744 \ubc1c\ud45c\ud588\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n

1) LittleBird: Efficient Faster & Longer Transformer for Question Answering<\/strong><\/p>\n\n\n\n

BERT\ub97c \ube44\ub86f\ud55c \uc77c\ubc18\uc801\uc778 Transformer \ubaa8\ub378\ub4e4\uc740 \uae34 \uc785\ub825\uc744 \ucc98\ub9ac\ud558\ub294 \ub370\uc5d0 \ub9e4\uc6b0 \ube44\ud6a8\uc728\uc801\uc778 \uad6c\uc870\ub97c \uac00\uc9c0\uace0 \uc788\uc2b5\ub2c8\ub2e4. \uc774\ub85c \uc778\ud574 \uae34 \ubb38\uc11c\uc5d0 \ub300\ud55c \uc9c8\uc758\uc751\ub2f5'(Long Document Question Answering)\uc744 \ucc98\ub9ac\ud558\ub294 \ub370\uc5d0 \ud55c\uacc4\uac00 \uc788\ub294\ub370\uc694.<\/p>\n\n\n\n

\uc774 \ub17c\ubb38\uc5d0\uc11c\ub294 \uc774\ub7ec\ud55c \ubb38\uc81c\ub97c \uadf9\ubcf5\ud558\uae30 \uc704\ud574 \uce74\uce74\uc624\uc5d4\ud130\ud504\ub77c\uc774\uc988\uac00 \uac1c\ubc1c\ud55c LittleBird \ubaa8\ub378\uc5d0 \ub300\ud574 \ub2e4\ub8f9\ub2c8\ub2e4. LittleBird\ub294 BigBird, ALiBi, LUNA \ub4f1\uc758 \ucd5c\uc2e0 \ubaa8\ub378\uc758 \uc7a5\uc810\uc744 \uc735\ud569\ud558\uc5ec \uae34 \uc785\ub825\uc5d0 \ub300\ud55c \ucc98\ub9ac\uc18d\ub3c4\ub294 \ub192\uc774\ub418, \uc815\ud655\ub3c4\ub294 \uc783\uc9c0 \uc54a\ub294 \uc0c8\ub85c\uc6b4 \ubaa8\ub378\uc785\ub2c8\ub2e4. \uc774 \ubaa8\ub378\uc744 \ud65c\uc6a9\ud558\uc5ec \uae34 \ubb38\uc11c\uc5d0 \ub300\ud55c \ud55c\uad6d\uc5b4 \uc9c8\uc758\uc751\ub2f5 \ub370\uc774\ud130\uc14b\uc778 KorQuAD2.0\uc5d0\uc11c 1\uc704\ub97c \ub2ec\uc131\ud558\ub294 \uc131\uacfc\ub3c4 \uac70\ub454 \ubc14 \uc788\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n

? \uc790\uc138\ud788 \ubcf4\uae30<\/a><\/p>\n\n\n\n

2) Normalizing Mutual Information for Robust Adaptive Training for Translation<\/strong><\/p>\n\n\n\n

\uae30\uacc4\ubc88\uc5ed\uc5d0\uc11c \ubc88\uc5ed\ubb38\uc758 \uc720\ucc3d\uc131\uacfc \ud0c0\ub2f9\uc131 \ub450 \uac00\uc9c0 \uae30\uc900\uc744 \ucda9\uc871\ud558\ub294 \uac83\uc740 \uc5ec\uc804\ud788 \ub9e4\uc6b0 \uc5b4\ub824\uc6b4 \ubb38\uc81c\uc785\ub2c8\ub2e4. \ubcf8 \ub17c\ubb38\uc5d0\uc11c\ub294 \uc774 \uae30\uc900\uc744 \ucda9\uc871\uc2dc\ud0a4\uae30 \uc704\ud574 \uac01 \ub370\uc774\ud130\ub9c8\ub2e4 \ub2e4\ub978 \uac00\uc911\uce58\ub97c \uc801\uc6a9\ud574 \ud559\uc2b5\uc2dc\ud0a4\ub294 \ubc29\uc2dd\uc5d0\uc11c \uc0c8\ub85c\uc6b4 \uc815\uaddc\ud654(Normalization)\ub41c \uac00\uc911\uce58 \uba54\ud2b8\ub9ad\uc744 \uc81c\uc548\ud558\uc600\uc2b5\ub2c8\ub2e4. Normalized Pointwise Mutual Information (NPMI) \ubc29\uc2dd\uc740 \ucd9c\ubc1c\uc5b4\uc758 \uc5b8\uc5b4\ubaa8\ub378\ub3c4 \ucd94\uac00\uc801\uc73c\ub85c \ud568\uaed8 \uc0ac\uc6a9\ud558\uc5ec \ucd9c\ubc1c-\ub3c4\ucc29 \ubb38\uc7a5 \uc0ac\uc774\uc758 joint likelihood\ub97c \uc608\uce21\ud569\ub2c8\ub2e4. \uc6d0\ubb38\uacfc \ubc88\uc5ed\ubb38 \ubaa8\ub450 \uac19\uc774 \ubc1c\uc0dd\ud560 \ud655\ub960\uc774 \ub192\uc73c\uba74 \ub354 \ubbff\uc744 \uc218 \uc788\ub294 \ub370\uc774\ud130\ub85c \ubd05\ub2c8\ub2e4. \uc989 \uc774 \ub370\uc774\ud130\ub85c \ubaa8\ub378\uc744 \ud559\uc2b5\uc2dc \ub354 \ub192\uc740 \uac00\uc911\uce58\ub97c \ubaa9\uc801\ud568\uc218\uc5d0 \ubd80\uc5ec\ud569\ub2c8\ub2e4. \ub610\ud55c \uc2a4\ucf54\uc5b4\ub97c \uc815\uaddc\ud654\uc2dc\ucf1c \ud559\uc2b5\uc744 \uc548\uc815\ud654\uc2dc\ucf1c \ubc88\uc5ed \uc131\ub2a5 \ud5a5\uc0c1\uc5d0 \ub3c4\uc6c0\uc744 \uc90d\ub2c8\ub2e4.<\/p>\n\n\n\n

? \uc790\uc138\ud788 \ubcf4\uae30<\/a><\/p>\n\n\n\n

3) APEACH: Attacking Pejorative Expressions with Analysis on Crowd-Generated Hate Speech Evaluation Datasets<\/strong><\/p>\n\n\n\n

\uc628\ub77c\uc778 \uc0c1\uc5d0 \ubb38\uc81c\uc2dc \ub418\uace0 \uc788\ub294 \ud610\uc624\uc131 \ud45c\ud604\uacfc \uad00\ub828\ub41c \uc5f0\uad6c \uc131\uacfc\ub97c \ub2e4\ub8ec \ub17c\ubb38\uc785\ub2c8\ub2e4. \ubd88\ud2b9\uc815 \ub2e4\uc218\uc758 \uc720\uc800\ub85c\ubd80\ud130 \ud610\uc624\uc131 \ubc1c\ud654\ubd84\ub958 \ub370\uc774\ud130\uc14b\uc744 \uc0dd\uc131\ud558\ub294 \ubc29\ubc95\ub860\uc744 \uc81c\uc548\ud558\uc600\uc2b5\ub2c8\ub2e4. \uc544\uc6b8\ub7ec \ud55c\uad6d\uc5b4 \uae30\ubc18 \ud3c9\uac00 \ub370\uc774\ud130\uc14b\uc744 \uacf5\uac1c\ud568\uc73c\ub85c\uc368 \uc5b8\uc5b4\ubaa8\ub378\uc758 \uce58\ud305 \ubb38\uc81c\uc5d0\uc11c \uc790\uc720\ub86d\uace0 \ud504\ub77c\uc774\ubc84\uc2dc\uc640 \uc724\ub9ac\uc774\uc288\ub97c \uacbd\uac10\uc2dc\ud0a4\ub294 \ud3c9\uac00\uc14b\uc744 \ub9cc\ub4dc\ub294 \ubc29\ubc95\uc744 \uc0c8\ub86d\uac8c \uc81c\uc2dc\ud558\uc600\uc2b5\ub2c8\ub2e4.<\/p>\n\n\n\n

? \uc790\uc138\ud788 \ubcf4\uae30<\/a><\/p>\n\n\n\n

\uc55e\uc73c\ub85c\ub3c4 \uce74\uce74\uc624\uc5d4\ud130\ud504\ub77c\uc774\uc988\ub294 \uace0\ub3c4\ud654\ub41c AI \uae30\uc220 \uc5f0\uad6c\uc0ac\ub840\ub97c \uc9c0\uc18d\uc801\uc73c\ub85c \uacf5\uc720\ud558\uace0, \ub354\uc6b1 \ubc1c\uc804\ub41c \uc11c\ube44\uc2a4\uc758 \ubaa8\uc2b5\uc73c\ub85c \uc120\uc21c\ud658\uc2dc\ud0ac \uc608\uc815\uc785\ub2c8\ub2e4. \ub9ce\uc740 \uad00\uc2ec\uacfc \uc131\uc6d0 \ubd80\ud0c1\ub4dc\ub9bd\ub2c8\ub2e4.<\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

\uce74\uce74\uc624\uc5d4\ud130\ud504\ub77c\uc774\uc988\uac00 \uc790\uc5f0\uc5b4\ucc98\ub9ac(NLP) \ubd84\uc57c \uae00\ub85c\ubc8c \ucd5c\uace0 \ud559\ud68c \u2018EMNLP\u2019\uc5d0\uc11c \ucd1d 3\ud3b8\uc758 \ub17c\ubb38\uc744 \ubc1c\ud45c\ud588\uc2b5\ub2c8\ub2e4. 1) LittleBird: Efficient Faster & Longer Transformer for Question Answering BERT\ub97c \ube44\ub86f\ud55c \uc77c\ubc18\uc801\uc778 Transformer \ubaa8\ub378\ub4e4\uc740 \uae34 \uc785\ub825\uc744 \ucc98\ub9ac\ud558\ub294 \ub370\uc5d0 \ub9e4\uc6b0 \ube44\ud6a8\uc728\uc801\uc778 \uad6c\uc870\ub97c \uac00\uc9c0\uace0 \uc788\uc2b5\ub2c8\ub2e4. \uc774\ub85c \uc778\ud574 \uae34 \ubb38\uc11c\uc5d0 \ub300\ud55c \uc9c8\uc758\uc751\ub2f5'(Long Document Question Answering)\uc744 \ucc98\ub9ac\ud558\ub294 \ub370\uc5d0 \ud55c\uacc4\uac00 \uc788\ub294\ub370\uc694. \uc774 \ub17c\ubb38\uc5d0\uc11c\ub294 \uc774\ub7ec\ud55c \ubb38\uc81c\ub97c \uadf9\ubcf5\ud558\uae30 \uc704\ud574 \uce74\uce74\uc624\uc5d4\ud130\ud504\ub77c\uc774\uc988\uac00 […]<\/p>\n","protected":false},"featured_media":4338,"template":"","tags":[85,76,57],"acf":[],"_links":{"self":[{"href":"https:\/\/kakaoenterprise.com\/wp-json\/wp\/v2\/about\/4292"}],"collection":[{"href":"https:\/\/kakaoenterprise.com\/wp-json\/wp\/v2\/about"}],"about":[{"href":"https:\/\/kakaoenterprise.com\/wp-json\/wp\/v2\/types\/about"}],"version-history":[{"count":4,"href":"https:\/\/kakaoenterprise.com\/wp-json\/wp\/v2\/about\/4292\/revisions"}],"predecessor-version":[{"id":4298,"href":"https:\/\/kakaoenterprise.com\/wp-json\/wp\/v2\/about\/4292\/revisions\/4298"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/kakaoenterprise.com\/wp-json\/wp\/v2\/media\/4338"}],"wp:attachment":[{"href":"https:\/\/kakaoenterprise.com\/wp-json\/wp\/v2\/media?parent=4292"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kakaoenterprise.com\/wp-json\/wp\/v2\/tags?post=4292"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}