EthanLab Software Development · Product Management · Tech Reviews
Search

Research notes

Notes from an ongoing exploration

Recent articles

Artificial Intelligence

[Conversational AI-7] Comparison of Pre-trained Language Models (ELMO, BERT, GPT-2)

Pre-trained language models can be used for tasks in Natural Language Understanding such as Named Entity Recognition, Extraction-based Question Answering, Sentiment analysis, Document Classification, and Natural Language Inference. As well as tasks in Natural Language Generation such as Machine translation, Automatic summarization,…

Read article: [Conversational AI-7] Comparison of Pre-trained Language Models (ELMO, BERT, GPT-2)
Artificial Intelligence

[Conversational AI-6] Implementation Methods for Modular Task-Oriented Dialogue Systems

# 自然語言理解 (Natural Language Understanding) 問句 = input("請輸入你的問題: ") 使用者動作.意圖 = 意圖識別(問句) 使用者動作.一組槽位 = 槽位填充(問句, 使用者動作.意圖) # 對話狀態追蹤 (Dialogue State Tracking) if (使用者動作.意圖 == Null) 　　對話狀態.意圖 = 得到意圖(對話歷史) 　　對話狀態.一組槽位 = 更新對話狀態(使用者動作.一組槽位, 對話歷史) else 　　對話狀態 = 使用者動作 　　填充個性化槽位(對話狀態.一組槽位, 使用者畫像) 　　意圖所缺的槽位填入預設值(對話狀態) # 對話策略學習 (Dialogue…

Read article: [Conversational AI-6] Implementation Methods for Modular Task-Oriented Dialogue Systems
Artificial Intelligence

[Conversational AI-5] Implementation Methods for Knowledge Base-Based Question Answering Systems

# 問句分析 (Question Analysis) 問句 = input("請輸入你的問題: ") 代表問句的一組資訊詞 = 問句分析(問句) 使用者意圖 = 意圖識別(代表問句的一組資訊詞, 知識圖譜) # 片語映射 (Phrase Mapping) if (使用者意圖 == Null) 　　問句 = input("我不懂你的意思，請換個方式告訴我: ") else if (使用者意圖 == 特定服務) 　　服務所需的一組資訊詞 = 所缺的資訊詞填入預設值(代表問句的一組資訊詞) 　　問句資訊詞的本體 = 自然語言映射到本體(服務所需的一組資訊詞, 知識圖譜) # 查詢建構 (Query…

Read article: [Conversational AI-5] Implementation Methods for Knowledge Base-Based Question Answering Systems
Artificial Intelligence

[Conversational AI-1] Types and Comparison of Chatbots (Question-Answering, Dialogue, and Chit-Chat Systems)

Since I often find myself talking past customers and external engineers, I eventually realized that everyone has a different definition of chatbots. Did you know that Chatbots can be divided into three categories? In the first article of the Conversational AI column,…

Read article: [Conversational AI-1] Types and Comparison of Chatbots (Question-Answering, Dialogue, and Chit-Chat Systems)
Artificial Intelligence

[Conversational AI-8] Introduction to R&D Departments and Development Processes

This article uses the company where the author works as an example; without disclosing company confidential information, it introduces the ‘relevant departments, development processes, and job responsibilities’ involved in AI product R&D, unveiling the mystery behind the AI industry. The company’s main…

Read article: [Conversational AI-8] Introduction to R&D Departments and Development Processes