{"id":3247,"date":"2024-07-18T22:24:52","date_gmt":"2024-07-18T14:24:52","guid":{"rendered":"https:\/\/infernews.com\/?page_id=3247"},"modified":"2024-08-30T17:12:52","modified_gmt":"2024-08-30T09:12:52","slug":"%e4%b8%ad%e6%96%87-text-embedding-%e7%9a%84%e5%85%bc%e5%ae%b9%e6%80%a7","status":"publish","type":"page","link":"https:\/\/infernews.com\/blog\/%e4%b8%ad%e6%96%87-text-embedding-%e7%9a%84%e5%85%bc%e5%ae%b9%e6%80%a7\/","title":{"rendered":"\u5009\u9821\u78bc\u4f5c\u70ba text embedding \u589e\u6f64\u57fa\u790e\u7684\u53ef\u884c\u6027\u63a2\u8a0e"},"content":{"rendered":"\n

\u4e2d\u6587 Text Embedding \u7684\u517c\u5bb9\u6027<\/strong><\/p>\n\n\n\n

Qwen-72B-Chat (https:\/\/modelscope.cn\/studios\/qwen\/Qwen-72B-Chat-Demo\/summary<\/a>)<\/p>\n\n\n\n

\u4e2d\u6587\u6587\u672c\u5d4c\u5165\uff08Text Embedding\uff09\u7684\u517c\u5bb9\u6027\u4e3b\u8981\u6d89\u53ca\u5230\u4ee5\u4e0b\u5e7e\u500b\u65b9\u9762\uff1a<\/p>\n\n\n\n

    \n
  1. \u6a21\u578b\u517c\u5bb9\u6027<\/strong>\uff1a\u4e0d\u540c\u7684\u4e2d\u6587\u6587\u672c\u5d4c\u5165\u6a21\u578b\uff0c\u5982Word2Vec\u3001GloVe\u3001FastText\u3001BERT\u3001RoBERTa\u3001ALBERT\u7b49\uff0c\u5b83\u5011\u7684\u8f38\u51fa\u7dad\u5ea6\u3001\u8a13\u7df4\u6578\u64da\u96c6\u3001\u8a13\u7df4\u76ee\u6a19\u7b49\u53ef\u80fd\u6703\u6709\u6240\u4e0d\u540c\uff0c\u6240\u4ee5\u5728\u4f7f\u7528\u6642\u9700\u8981\u78ba\u4fdd\u6240\u9078\u64c7\u7684\u6a21\u578b\u8207\u61c9\u7528\u5834\u666f\u6216\u4e0b\u6e38\u4efb\u52d9\u76f8\u517c\u5bb9\u3002<\/li>\n\n\n\n
  2. \u5b57\u7b26\u7de8\u78bc\u517c\u5bb9\u6027<\/strong>\uff1a\u4e2d\u6587\u6587\u672c\u8655\u7406\u9700\u8981\u8003\u616e\u5b57\u7b26\u7de8\u78bc\u554f\u984c\uff0c\u5982UTF-8\u3001GBK\u7b49\u3002\u5728\u9032\u884c\u6587\u672c\u9810\u8655\u7406\u548c\u6a21\u578b\u8f38\u5165\u6642\uff0c\u8981\u78ba\u4fdd\u7de8\u78bc\u7684\u4e00\u81f4\u6027\u548c\u6b63\u78ba\u6027\uff0c\u5426\u5247\u53ef\u80fd\u6703\u5f71\u97ff\u6a21\u578b\u7684\u6548\u679c\u548c\u7a69\u5b9a\u6027\u3002<\/li>\n\n\n\n
  3. \u8edf\u4ef6\u6846\u67b6\u517c\u5bb9\u6027<\/strong>\uff1a\u4e0d\u540c\u6df1\u5ea6\u5b78\u7fd2\u6846\u67b6\u5982TensorFlow\u3001PyTorch\u3001Keras\u7b49\u5c0d\u4e2d\u6587\u6587\u672c\u5d4c\u5165\u6a21\u578b\u7684\u652f\u6301\u7a0b\u5ea6\u53ef\u80fd\u5b58\u5728\u5dee\u7570\uff0c\u9700\u78ba\u4fdd\u6240\u4f7f\u7528\u7684\u6a21\u578b\u8207\u958b\u767c\u74b0\u5883\u4e2d\u7684\u8edf\u4ef6\u6846\u67b6\u517c\u5bb9\u3002<\/li>\n\n\n\n
  4. \u7b2c\u4e09\u65b9\u5eab\u517c\u5bb9\u6027<\/strong>\uff1a\u4e00\u4e9b\u5c08\u9580\u7528\u65bc\u4e2d\u6587\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u7684\u7b2c\u4e09\u65b9\u5eab\uff08\u5982jieba\u3001THULAC\u3001PKU ANC\u3001HanLP\u7b49\uff09\uff0c\u5b83\u5011\u53ef\u80fd\u63d0\u4f9b\u4e86\u7279\u5b9a\u7684\u5206\u8a5e\u3001\u8a5e\u6027\u6a19\u6ce8\u7b49\u529f\u80fd\uff0c\u5982\u679c\u8981\u5728\u9019\u4e9b\u5de5\u5177\u7684\u57fa\u790e\u4e0a\u4f7f\u7528\u6587\u672c\u5d4c\u5165\u6280\u8853\uff0c\u5c31\u9700\u8981\u4fdd\u8b49\u5169\u8005\u4e4b\u9593\u7684\u517c\u5bb9\u6027\u3002<\/li>\n<\/ol>\n\n\n\n


    \u4ee5\u5009\u9821\u78bc\u4f5c\u70ba text embedding \u589e\u6f64\u57fa\u790e\u53ef\u884c\u6027<\/strong><\/p>\n\n\n\n

    \u5009\u9821\u78bc<\/strong> \u4f5c\u70ba\u4e00\u7a2e\u4e2d\u6587\u8f38\u5165\u6cd5\uff0c\u5c07\u6f22\u5b57\u62c6\u89e3\u70ba\u90e8\u4ef6\uff0c\u4e26\u4ee5\u7279\u5b9a\u7684\u7d44\u5408\u4f86\u8868\u793a\u3002\u82e5\u8981\u5c07\u5176\u4f5c\u70ba text embedding<\/strong> \u7684\u589e\u6f64\u57fa\u790e\uff0c\u78ba\u5be6\u662f\u4e00\u500b\u5f88\u6709\u8da3\u7684\u60f3\u6cd5\u3002<\/p>\n\n\n\n

    \u53ef\u884c\u6027\u7684\u512a\u9ede\uff1a<\/h3>\n\n\n\n
      \n
    • \u8a9e\u610f\u95dc\u806f\u6027:<\/strong> \u5009\u9821\u78bc\u7684\u62c6\u89e3\u65b9\u5f0f\u6709\u4e00\u5b9a\u7684\u8a9e\u610f\u95dc\u806f\u6027\u3002\u4f8b\u5982\uff0c\u300c\u4eba\u300d\u5b57\u76f8\u95dc\u7684\u5b57\uff0c\u5176\u5009\u9821\u78bc\u7684\u958b\u982d\u90e8\u5206\u53ef\u80fd\u76f8\u4f3c\u3002\u9019\u610f\u5473\u8457\uff0c\u82e5\u80fd\u6709\u6548\u5730\u5c07\u5009\u9821\u78bc\u8f49\u63db\u70ba\u5411\u91cf\u8868\u793a\uff0c\u5247\u53ef\u4ee5\u6355\u6349\u5230\u6f22\u5b57\u4e4b\u9593\u7684\u8a9e\u610f\u95dc\u4fc2\u3002<\/li>\n\n\n\n
    • \u7d30\u7c92\u5ea6\u8868\u793a:<\/strong> \u76f8\u8f03\u65bc\u55ae\u7d14\u7684\u5b57\u8a5e\uff0c\u5009\u9821\u78bc\u5c0d\u6f22\u5b57\u7684\u62c6\u89e3\u66f4\u7d30\u7dfb\uff0c\u80fd\u63d0\u4f9b\u66f4\u7d30\u7c92\u5ea6\u7684\u8cc7\u8a0a\u3002\u9019\u5c0d\u65bc\u67d0\u4e9b\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u4efb\u52d9\uff0c\u5982\u547d\u540d\u5be6\u9ad4\u8b58\u5225\u3001\u95dc\u4fc2\u62bd\u53d6\u7b49\uff0c\u53ef\u80fd\u6703\u6709\u5e6b\u52a9\u3002<\/li>\n\n\n\n
    • \u4e2d\u6587\u7279\u6027:<\/strong> \u5009\u9821\u78bc\u662f\u91dd\u5c0d\u4e2d\u6587\u8a2d\u8a08\u7684\u8f38\u5165\u6cd5\uff0c\u80fd\u66f4\u597d\u5730\u6355\u6349\u4e2d\u6587\u7684\u8a9e\u8a00\u7279\u5fb5\u3002<\/li>\n<\/ul>\n\n\n\n

      \u53ef\u884c\u6027\u7684\u6311\u6230\uff1a<\/h3>\n\n\n\n
        \n
      • \u591a\u5c0d\u4e00\u554f\u984c:<\/strong> \u591a\u500b\u6f22\u5b57\u53ef\u80fd\u5c0d\u61c9\u540c\u4e00\u500b\u5009\u9821\u78bc\uff0c\u9019\u6703\u5c0e\u81f4\u8cc7\u8a0a\u7684\u4e1f\u5931\u3002<\/li>\n\n\n\n
      • \u7d44\u5408\u7206\u70b8:<\/strong> \u5009\u9821\u78bc\u7684\u7d44\u5408\u65b9\u5f0f\u5f88\u591a\uff0c\u82e5\u8981\u7aae\u76e1\u6240\u6709\u53ef\u80fd\u7684\u7d44\u5408\uff0c\u8a08\u7b97\u91cf\u6703\u975e\u5e38\u5927\u3002<\/li>\n\n\n\n
      • \u5411\u91cf\u8868\u793a:<\/strong> \u5982\u4f55\u5c07\u5009\u9821\u78bc\u8f49\u63db\u70ba\u6709\u6548\u7684\u5411\u91cf\u8868\u793a\uff0c\u662f\u4e00\u500b\u9700\u8981\u6df1\u5165\u7814\u7a76\u7684\u554f\u984c\u3002\u5e38\u898b\u7684\u5411\u91cf\u8868\u793a\u65b9\u6cd5\u5982 Word2Vec\u3001BERT \u7b49\uff0c\u53ef\u80fd\u4e26\u4e0d\u76f4\u63a5\u9069\u7528\u65bc\u5009\u9821\u78bc\u3002<\/li>\n\n\n\n
      • \u4efb\u52d9\u76f8\u95dc\u6027:<\/strong> \u662f\u5426\u80fd\u6709\u6548\u589e\u6f64\uff0c\u9084\u53d6\u6c7a\u65bc\u5177\u9ad4\u7684\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u4efb\u52d9\u3002\u5c0d\u65bc\u67d0\u4e9b\u4efb\u52d9\uff0c\u5009\u9821\u78bc\u7684\u589e\u6f64\u6548\u679c\u53ef\u80fd\u4e0d\u986f\u8457\u3002<\/li>\n<\/ul>\n\n\n\n

        \u5be6\u73fe\u65b9\u6cd5\u8207\u5efa\u8b70\uff1a<\/h3>\n\n\n\n
          \n
        • \u5009\u9821\u78bc\u5411\u91cf\u5316:<\/strong>\n
            \n
          • One-hot encoding:<\/strong> \u76f4\u63a5\u5c07\u6bcf\u500b\u5009\u9821\u78bc\u8868\u793a\u70ba\u4e00\u500b\u7368\u7279\u7684\u5411\u91cf\u3002\u4f46\u9019\u7121\u6cd5\u6355\u6349\u5230\u5009\u9821\u78bc\u4e4b\u9593\u7684\u76f8\u4f3c\u6027\u3002<\/li>\n\n\n\n
          • Distributed representation:<\/strong> \u5229\u7528\u795e\u7d93\u7db2\u8def\u6a21\u578b\uff0c\u5982 Word2Vec \u6216 Skip-Gram\uff0c\u5b78\u7fd2\u5009\u9821\u78bc\u7684\u5411\u91cf\u8868\u793a\u3002<\/li>\n\n\n\n
          • Graph-based method:<\/strong> \u5c07\u5009\u9821\u78bc\u69cb\u5efa\u70ba\u5716\uff0c\u4e26\u5229\u7528\u5716\u795e\u7d93\u7db2\u8def\u5b78\u7fd2\u5411\u91cf\u8868\u793a\u3002<\/li>\n<\/ul>\n<\/li>\n\n\n\n
          • \u7d50\u5408\u5176\u4ed6 embedding:<\/strong>\n
              \n
            • \u5c07\u5009\u9821\u78bc\u7684\u5411\u91cf\u8868\u793a\u8207\u5176\u4ed6\u73fe\u6709\u7684 text embedding\uff08\u5982 Word2Vec\u3001BERT\uff09\u9032\u884c\u7d50\u5408\uff0c\u4ee5\u7372\u53d6\u66f4\u8c50\u5bcc\u7684\u8cc7\u8a0a\u3002<\/li>\n<\/ul>\n<\/li>\n\n\n\n
            • \u5be6\u9a57\u9a57\u8b49:<\/strong>\n
                \n
              • \u5728\u4e0d\u540c\u7684\u81ea\u7136\u8a9e\u8a00\u8655\u7406\u4efb\u52d9\u4e0a\u9032\u884c\u5be6\u9a57\uff0c\u6bd4\u8f03\u52a0\u5165\u5009\u9821\u78bc\u589e\u6f64\u524d\u5f8c\u7684\u6a21\u578b\u6548\u679c\u3002<\/li>\n<\/ul>\n<\/li>\n\n\n\n
              • \u4efb\u52d9\u5b9a\u5236:<\/strong>\n
                  \n
                • \u91dd\u5c0d\u4e0d\u540c\u7684\u4efb\u52d9\uff0c\u8a2d\u8a08\u4e0d\u540c\u7684\u589e\u6f64\u7b56\u7565\u3002<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n

                  \u7e3d\u7d50<\/h3>\n\n\n\n

                  \u5c07\u5009\u9821\u78bc\u4f5c\u70ba text embedding \u589e\u6f64\u57fa\u790e\uff0c\u662f\u4e00\u500b\u6709\u6f5b\u529b\u7684\u7814\u7a76\u65b9\u5411\u3002\u4f46\u8981\u4f7f\u5176\u771f\u6b63\u843d\u5730\uff0c\u9084\u9700\u8981\u514b\u670d\u8a31\u591a\u6311\u6230\uff0c\u4e26\u9032\u884c\u6df1\u5165\u7684\u7814\u7a76\u3002<\/p>\n\n\n\n

                  \u5efa\u8b70\u60a8\u5f9e\u4ee5\u4e0b\u5e7e\u500b\u65b9\u9762\u9032\u884c\u66f4\u6df1\u5165\u7684\u63a2\u7d22\uff1a<\/strong><\/p>\n\n\n\n

                  \u5be6\u9a57\u8a2d\u8a08:<\/strong> \u8a2d\u8a08\u56b4\u8b39\u7684\u5be6\u9a57\uff0c\u8a55\u4f30\u6a21\u578b\u7684\u6027\u80fd\u3002<\/p>\n\n\n\n

                  \u6587\u737b\u7d9c\u8ff0:<\/strong> \u67e5\u627e\u76f8\u95dc\u6587\u737b\uff0c\u4e86\u89e3\u5b78\u754c\u5728\u9019\u500b\u65b9\u5411\u7684\u7814\u7a76\u9032\u5c55\u3002<\/p>\n\n\n\n

                  \u6578\u64da\u6e96\u5099:<\/strong> \u69cb\u5efa\u4e00\u500b\u5305\u542b\u5009\u9821\u78bc\u8207\u5c0d\u61c9\u6f22\u5b57\u7684\u9f90\u5927\u6578\u64da\u96c6\u3002<\/p>\n\n\n\n

                  \u6a21\u578b\u9078\u64c7:<\/strong> \u9078\u64c7\u9069\u5408\u7684\u5411\u91cf\u8868\u793a\u6a21\u578b\u548c\u795e\u7d93\u7db2\u8def\u67b6\u69cb\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"

                  \u4e2d\u6587 Text Embedding \u7684\u517c\u5bb9\u6027 Qwen-72B-Chat (https:\/\/modelscope.cn\/studios\/qwen\/Qwen-72B-Chat-Demo\/summary) \u4e2d\u6587\u6587\u672c\u5d4c\u5165\uff08Text Embedding\uff09\u7684\u517c\u5bb9\u6027\u4e3b\u8981\u6d89\u53ca\u5230\u4ee5\u4e0b\u5e7e\u500b\u65b9\u9762\uff1a \u4ee5\u5009\u9821\u78bc\u4f5c\u70ba text embedding \u589e\u6f64\u57fa\u790e\u53ef\u884c\u6027 \u5009\u9821\u78bc \u4f5c\u70ba\u4e00\u7a2e\u4e2d\u6587\u8f38\u5165\u6cd5\uff0c\u5c07\u6f22\u5b57\u62c6\u89e3\u70ba\u90e8\u4ef6\uff0c\u4e26\u4ee5\u7279\u5b9a\u7684\u7d44\u5408\u4f86\u8868\u793a\u3002\u82e5\u8981\u5c07\u5176\u4f5c\u70ba text embedding \u7684\u589e\u6f64\u57fa\u790e\uff0c\u78ba\u5be6\u662f\u4e00\u500b\u5f88\u6709\u8da3\u7684\u60f3\u6cd5\u3002 \u53ef\u884c\u6027\u7684\u512a\u9ede\uff1a \u53ef\u884c\u6027\u7684\u6311\u6230\uff1a \u5be6\u73fe\u65b9\u6cd5\u8207\u5efa\u8b70\uff1a \u7e3d\u7d50 \u5c07\u5009\u9821\u78bc\u4f5c\u70ba text embedding \u589e\u6f64\u57fa\u790e\uff0c\u662f\u4e00\u500b\u6709\u6f5b\u529b\u7684\u7814\u7a76\u65b9\u5411\u3002\u4f46\u8981\u4f7f\u5176\u771f\u6b63\u843d\u5730\uff0c\u9084\u9700\u8981\u514b\u670d\u8a31\u591a\u6311\u6230\uff0c\u4e26\u9032\u884c\u6df1\u5165\u7684\u7814\u7a76\u3002 \u5efa\u8b70\u60a8\u5f9e\u4ee5\u4e0b\u5e7e\u500b\u65b9\u9762\u9032\u884c\u66f4\u6df1\u5165\u7684\u63a2\u7d22\uff1a \u5be6\u9a57\u8a2d\u8a08: \u8a2d\u8a08\u56b4\u8b39\u7684\u5be6\u9a57\uff0c\u8a55\u4f30\u6a21\u578b\u7684\u6027\u80fd\u3002 \u6587\u737b\u7d9c\u8ff0: \u67e5\u627e\u76f8\u95dc\u6587\u737b\uff0c\u4e86\u89e3\u5b78\u754c\u5728\u9019\u500b\u65b9\u5411\u7684\u7814\u7a76\u9032\u5c55\u3002 \u6578\u64da\u6e96\u5099: \u69cb\u5efa\u4e00\u500b\u5305\u542b\u5009\u9821\u78bc\u8207\u5c0d\u61c9\u6f22\u5b57\u7684\u9f90\u5927\u6578\u64da\u96c6\u3002 \u6a21\u578b\u9078\u64c7: \u9078\u64c7\u9069\u5408\u7684\u5411\u91cf\u8868\u793a\u6a21\u578b\u548c\u795e\u7d93\u7db2\u8def\u67b6\u69cb\u3002<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"googlesitekit_rrm_CAowvqSiDA:productID":"","footnotes":""},"class_list":["post-3247","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/pages\/3247","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/comments?post=3247"}],"version-history":[{"count":0,"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/pages\/3247\/revisions"}],"wp:attachment":[{"href":"https:\/\/infernews.com\/blog\/wp-json\/wp\/v2\/media?parent=3247"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}