← 總覽← Catalogue 从句子到词语:佛典多语对勘 From Sentences to Words
1 / 10
Title

From Sentences to Words: LLM-Assisted Multilingual Alignment of Buddhist Texts

从句子到词语:大语言模型辅助的佛典多语对勘

李周源 Zhouyuan Li
南京大学文学院,南京 School of Liberal Arts, Nanjing University, Nanjing, China
1

要解决的问题 Our Questions

  1. 一部汉文佛典具有哪些平行文本:异译、梵/巴/藏对应、引文、注疏。 When we open a Chinese Buddhist text, what else should we look at alongside it—another Chinese translation, a Sanskrit, Pali, or Tibetan counterpart, a quotation, or a commentary?
  2. 已确认的平行如何落实到句、再到词,并回放到出处。 Once we know that two texts belong together, how do we match them sentence by sentence, then word by word, while still being able to trace each match back to its source?
2.1

人工/机构对勘库 Alignments already made by people and institutions

类Kind 简称Abbr. 全称Source 数据量Scale 覆盖经典Works
多译本Several tr.BCBS香港教育大学梵汉对勘双语语料库EdUHK Sanskrit–Chinese Parallel Corpus2,013 主单元2,013 main units法华 T262/T263;维摩 T474/475/476;俱舍 T1558/1559Lotus T262/263; Vimalakīrti T474–476; Kośa T1558/1559
DEDU法鼓文理学院佛典多译本对勘资料库DILA multilingual parallel corpusTLB 93,141;Public 129,706俱舍、法华、楞伽、摄大乘、辩中边、阿弥陀等Kośa, Lotus, Laṅkāvatāra, Mahāyānasaṃgraha, Madhyāntavibhāga, Amitābha, etc.
YBh法鼓文理学院瑜伽师地论资料库DILA Yogācārabhūmi database73,693 段73,693 segmentsT1579 瑜伽师地论等Yogācārabhūmi, etc.
VMTD法鼓文理学院唯识典籍数位资料库DILA Vijñaptimātra digital database22,388 cell三十颂、二十论、摄大乘、集论、解深密经等Triṃśikā, Viṃśikā, Mahāyānasaṃgraha, Abhidharmasamuccaya, Saṃdhinirmocana, etc.
SDP中华佛学研究所法华经数位资料库Lotus Sutra digital archive (CHIBS)18 部/128 段18 works / 128 segmentsT262/T263/T264
Mahayana CT大乘经论汇校本Collated Mahāyāna sūtras and śāstras652 组/4,714 长行652 groups / 4,714 prose units十地、无量寿、阿弥陀、法华Daśabhūmika, Sukhāvatīvyūha, Amitābha, Lotus
ARPCN《俱舍论》梵藏汉对照及引经表Skt–Tib–Zh Abhidharmakośa with sūtra citations1,477 单元;引经 610 条1,477 units; 610 citationsT1558/T1559 及所引阿含T1558/1559 and cited Āgamas
阿含/法句Āgama / DhpBuddhason庄春江南北传阿含对读Zhuang Chunjiang, North–South Āgama reader20,440 节20,440 sectionsT99/T26/T1/T125
BZA别译杂阿含Bieyi za ahan (alternative Saṃyuktāgama)364 组364 groupsT100
YIFER苏锦坤《法句经》偈颂对照表Ken Su, Dharmapada verse alignment偈颂对照verse alignmentT210/T212/T213;巴利、梵文法句T210/212/213; Pali and Sanskrit Dharmapada
Comp. DhpĀnandajoti Comparative Dhammapada338 页338 pages巴利法句、Patna、犍陀罗、UdānavargaPali Dhammapada, Patna, Gāndhārī, Udānavarga
词书Dictionaries辛嶋/DILAKarashima / DILA辛嶋静志多语佛典词典Karashima Seishi multilingual Buddhist dictionaries21,315 条目组21,315 entry groupsT262/T263、道行般若 T224、长阿含 T1T262/263; Aṣṭasāhasrikā T224; Dīrghāgama T1
待接入Not yet in—佛光本生;DILA Agama Research;BuddhaNexusFo Guang Jātaka; DILA Agama Research; BuddhaNexus本生 547 条等547 jātaka items, etc.故事、专题、互文线索,尚未作句对stories and themes; sentence pairs still to come
2.2

全文来源 Where the full texts come from

下列来源提供全文与目录,并不构成句级对勘。 These are the texts themselves, and the catalogues. They do not tell us which sentence goes with which.

语文Lang. 简称Abbr. 全称Source 数据量Scale 覆盖Coverage
汉ZhCBETA中华电子佛典协会 xml-p5Chinese Buddhist Electronic Text Association, xml-p55,005 XML大正藏及各藏汉文全文Taishō and other Chinese canons, full text
巴PaliSuttaCentralBilara + sc-data43,112 JSON尼柯耶、阿含平行元数据与巴利全文Nikāyas, Āgama parallel metadata, Pali full text
VRI内观研究所巴利三藏 XMLVipassana Research Institute, Pali Tipiṭaka XML6,834 XML巴利三藏Pali Tipiṭaka
梵SktGRETIL哥廷根大学印度文本库Göttingen Register of Electronic Texts in Indian Languages5,415 文本档5,415 text files梵文及其他印度语文本Sanskrit and other Indic texts
DSBCDigital Sanskrit Buddhist Canon961 书/2,893 页961 books / 2,893 pages梵文佛教文献Sanskrit Buddhist literature
藏TibEsukhia德格甘珠尔、丹珠尔Derge Kangyur and Tengyur105 + 214 txt德格版甘丹纯文本Derge Kangyur/Tengyur, plain text
rKTs甘珠尔丹珠尔目录Kangyur and Tengyur catalogueskernel 6,945 条records藏文大藏经版本与结构定位witnesses and structure of the Tibetan canon
2.3

Dharmamitra 材料:实际取得与采用 What we actually took from Dharmamitra

本表仅列其发布渠道中的平行句对、DharmaNexus 切分文本、向量模型与词典。本工作另行完成的检索与切句不列入。 Only what they publish: sentence pairs, DharmaNexus segmented texts, their embedding models, and a dictionary. What we later retrieved or split ourselves is not on this list.

资料Resource 下载Download 采用Use 规模/说明Scale / notes
已取得Obtained平行句对 V1(mitra-parallel TSV)Sentence pairs V1 (mitra-parallel TSV)已下载Yes正式采用In use1,742,786 句对,其中含汉文 1,100,530。用于经文挂接与词级对勘1,742,786 pairs; 1,100,530 have Chinese. We place them on the texts and then go down to the word
平行句对 V2(NDJSON)Sentence pairs V2 (NDJSON)已下载Yes仅作候选Candidates1,693,730 条。仅作桥接底层,不计入正式覆盖;不含巴利1,693,730 records. Used only to bridge; we do not count them as settled; no Pali
DharmaNexus 巴利切分DharmaNexus Pali segmentation已下载Yes正式采用In use4,258 文件。已切分巴利文句4,258 files. Pali already cut into sentences
DharmaNexus 梵文切分DharmaNexus Sanskrit segmentation后补取得Later正式采用In use1,947 文件。初次整包未成,后依冻结版本补全1,947 files. The first download failed; we later took a frozen copy
MITRA-E 向量模型MITRA-E encoder已下载Yes正式采用In use其所发布的编码器,用于汉文近邻检索;无现成全库向量Their encoder, used to find nearby Chinese sentences. They do not give a ready-made vector for every text
未采用UnusedDharmaNexus 汉文切分DharmaNexus Chinese segmentation未取得No未用Unused传输失败Transfer failed
DharmaNexus 藏文切分DharmaNexus Tibetan segmentation当时无库N/A未用Unused当时仓库不可用The repository was not there then
其最新发布的向量模型Their latest embedding model仅核验Inspected未用Unused已核验模型说明与抽样;正式检索未改用We read the model card and a few samples; we did not switch the live search
官方词典Official dictionary未下载No未用Unused抽查后部分条目与本工作词级对勘不能对应A sample of entries did not line up with our word-level work
3

本工作的两项辅助判断 Two aids we built first

  1. 综合大正藏/CBETA 编目、SuttaCentral 平行与 CBC@ 确认关系,建立汉文平行关系层。 We put together the Taishō / CBETA catalogues, SuttaCentral’s parallels, and the links confirmed by CBC@, and made a map of how Chinese texts sit next to one another.
  2. 自 XML 抽取翻译归属,区分汉译佛经与中国撰述。 From the XML we asked who translated what, so a Chinese translation of an Indian work is not mixed up with a text written in China.
4 · 方法一4 · Method 1

既有对勘的接入:投影、直连、重组 Using alignments we already have: project, link, recombine

此法不另行发现平行,仅将既有对勘映射至 CBETA 句号。 Here we are not looking for new parallels. We simply place alignments that already exist onto CBETA’s sentence numbers.

  1. 1 投影:将 BCBS、DEDU、法句及人工锚点映射至 CBETA 句号,作为金标准层。 Project. Take BCBS, DEDU, the Dharmapada tables, and a few hand-made anchors, and put them on CBETA sentence numbers. This is our gold standard.
  2. 2 MITRA 直连:将已下载的梵汉/藏汉句对挂接经文。属机器句对,可回放至原 TSV。 Link. Place the downloaded Sanskrit–Chinese and Tibetan–Chinese pairs on the texts. These are machine pairs; we can always go back to the original TSV.
  3. 3 重组:同梵异汉、同藏异汉、梵藏桥接(Bridge),由跨语句对推导汉—汉关系。V2 默认不计入正式覆盖。 Recombine. If two Chinese texts share the same Sanskrit, or the same Tibetan, or if Sanskrit and Tibetan can be bridged (Bridge), we infer a Chinese–Chinese link. Version 2 stays a candidate; we do not treat it as settled.

证据强度自上而下递减:人工投影最强,MITRA 直连次之,Bridge 为推导候选。 The evidence gets thinner as we go down: a human projection is the strongest, a MITRA link comes next, and Bridge is only an inference.

4 · 方法二4 · Method 2

向量发现 Looking with vectors

本工作用以发现尚未登记、或尚未落实到句的平行候选。实施上分为三条路径。 This is how we look for parallels that no one has listed yet, or that have not yet been broken into sentences. We do it in three ways.

  1. 1 对应经典向量匹配:在既有汉文关系范围内,以 MITRA-E 检索相似句。 Within a pair of Chinese texts we already know are related, we search for similar sentences with MITRA-E.
  2. 2 全部汉文向量匹配:一部经对 CBETA 全库检索一次并缓存,编码器仍为 MITRA-E。 We also search one text against the whole of CBETA, once, and keep the result. Still MITRA-E.
  3. 3 全部经典向量匹配:梵、巴、藏、汉逐句以千问 3.7 编码并建全库索引;逐句检索近邻,再聚合为可能平行的部与段落。 For a wider net we encode Sanskrit, Pali, Tibetan, and Chinese sentence by sentence with Qwen 3.7, put them in one index, look up near neighbours, and gather them into possible works and passages.
  4. 4 指定两部之后,改以该两部句向量作一对一细对。汉—汉按翻译/其他大正藏/其他汉文/梵藏巴分层认经,以免注疏淹没异译。 When we have named two works, we compare those two on their own sentence vectors. On the Chinese side we sort works into layers—translations, the rest of the Taishō, other Chinese texts, then Sanskrit, Tibetan, and Pali—so a commentary does not push another translation off the list.

所得均为候选,尚未作语义审定。相似度分数不等于语义置信度。 None of this is a final judgement. A high score only means the sentences look alike; it does not mean they say the same thing.

4 · 方法三4 · Method 3

模型审定 Asking a model to judge

审定对象并非全库近邻,而是第 3 节关系层中已登记的汉—汉范围。双方保持原序,模型仅返回句号。 We do not send the model everything that looks nearby. We only send Chinese–Chinese ranges already on the map in §3. Both sides stay in their original order; the model may return sentence numbers, and nothing else.

  1. 1 双方按 CBETA v3 切句并编短编号。模型仅见编号与原文,不得改写,不得自造编号。 We split both texts with CBETA v3 and give each sentence a short number. The model sees the numbers and the wording. It must not rewrite the text, and it must not invent numbers.
  2. 2 长经切为滑窗,连续提交大模型判定句级平行,再拼合为全书。 A long work is cut into overlapping windows, sent one after another, then put back together.
  3. 3 先以人工金标准(法句、维摩等)验收,通过后再扩大范围。 We try this first on human gold standards—the Dharmapada, the Vimalakīrti, and a few others—and only then go further.
  4. 4 结构校验已通过:A 侧每句恰好一次,B 编号合法。语义尚未审定。界面称为「AI匹配」。 The skeleton is in place: each sentence on side A appears once, and every number on side B is real. We have not yet read through the meaning. On the site this is called “AI matching”.
5

词级对勘与词典:主要结果 Down to the word: what we have so far

本工作以 DeepSeek 逐条分解 MITRA 含汉文句对,保留未匹配项与置信度;实见梵文与藏汉构拟梵文分层存放,再汇为词典与翻译风格。 We asked DeepSeek to take apart every MITRA pair that has Chinese in it, and to keep what did not match, together with a confidence score. Sanskrit that is actually in the texts is kept apart from Sanskrit we only reconstruct through Tibetan and Chinese. From that we grow a lexicon, and a picture of how different translators work.

结果Result 数量Quantity 说明Notes
进入词级对勘的句对Pairs we broke into words1,100,530 → 去重 926,447 任务1,100,530 → 926,447 unique tasks藏汉 826,983;梵汉 273,547Tibetan–Chinese 826,983; Sanskrit–Chinese 273,547
词级对应Word-to-word links9,425,517平均每句约 8.58 条;含字符偏移与出处about 8.58 per sentence, with a place in the string and a source
实见梵文Sanskrit we can actually see约 213 万(22.6%)ca. 2.13 million (22.6%)可进入主词典候选These can go into the main lexicon
藏汉构拟梵文Sanskrit we reconstruct (Tibetan–Chinese)约 638 万(67.7%)ca. 6.38 million (67.7%)假说层,不作实见梵本A working hypothesis; we do not treat it as a Sanskrit text we have in hand
词典种子A first lexicon梵文入口 5,212;汉文入口 5,543;核心 4,868Skt 5,212; Zh 5,543; core 4,868另经分层复核;展示约 13,194 条Reviewed in layers; about 13,194 shown
翻译风格How translators work译者 155;作品 1,080;朝代 19155 translators; 1,080 works; 19 periods如玄奘约 23 万句对,可按译者观察译法Xuanzang, for instance, has about 230,000 pairs, so we can watch how one translator phrases things