Evaluating intelligibility in human translation and machine translation

Research in automated translation mostly aims to develop translation systems to further enhance the transfer of knowledge and information. This need of transfer has brought machine translation (MT) to show major steps in translation software development and encourages further research in various M...

Full description

Bibliographic Details
Main Authors:	Norwati Md Yusof, Saadiyah Darus, Mohd Juzaiddin Ab Aziz
Format:	Article
Language:	English
Published:	Penerbit Universiti Kebangsaan Malaysia 2017
Online Access:	http://journalarticle.ukm.my/12869/ http://journalarticle.ukm.my/12869/ http://journalarticle.ukm.my/12869/1/22088-65611-2-PB.pdf

id	ukm-12869
recordtype	eprints
spelling	ukm-128692019-05-06T21:42:29Z http://journalarticle.ukm.my/12869/ Evaluating intelligibility in human translation and machine translation Norwati Md Yusof, Saadiyah Darus, Mohd Juzaiddin Ab Aziz, Research in automated translation mostly aims to develop translation systems to further enhance the transfer of knowledge and information. This need of transfer has brought machine translation (MT) to show major steps in translation software development and encourages further research in various MT related areas. However, there have been no focused investigations of criteria for evaluation particularly evaluation that considers human evaluators and the reconciliation of human translation (HT) and MT. Thus, focusing on two attributes for evaluation, namely Accuracy and Intelligibility, a study was conducted to investigate translation evaluation criteria for content and language transfer through reconciliation of HT and MT evaluation based on human evaluators’ perception. The study focused on human evaluators’ expectation of range of criteria for HT and MT under the two attributes and the evaluation was tested on a machine system to observe the system’s performance in terms of Accuracy and Intelligibility. This paper reports the range of criteria to evaluate translation in terms of Intelligibility as expected by human evaluators in HT and MT in terms of content and language transfer. The study uses a mixed method approach with soft data and hard data collection. The results demonstrate that the range of each criteria identified for content evaluation in HT is expected to be higher than in MT. The implications of the study are described to provide an understanding of evaluation for human and automated translation in terms of Intelligibility. Penerbit Universiti Kebangsaan Malaysia 2017 Article PeerReviewed application/pdf en http://journalarticle.ukm.my/12869/1/22088-65611-2-PB.pdf Norwati Md Yusof, and Saadiyah Darus, and Mohd Juzaiddin Ab Aziz, (2017) Evaluating intelligibility in human translation and machine translation. 3L; Language,Linguistics and Literature,The Southeast Asian Journal of English Language Studies., 23 (4). pp. 251-264. ISSN 0128-5157 http://ejournal.ukm.my/3l/issue/view/1059
repository_type	Digital Repository
institution_category	Local University
institution	Universiti Kebangasaan Malaysia
building	UKM Institutional Repository
collection	Online Access
language	English
description	Research in automated translation mostly aims to develop translation systems to further enhance the transfer of knowledge and information. This need of transfer has brought machine translation (MT) to show major steps in translation software development and encourages further research in various MT related areas. However, there have been no focused investigations of criteria for evaluation particularly evaluation that considers human evaluators and the reconciliation of human translation (HT) and MT. Thus, focusing on two attributes for evaluation, namely Accuracy and Intelligibility, a study was conducted to investigate translation evaluation criteria for content and language transfer through reconciliation of HT and MT evaluation based on human evaluators’ perception. The study focused on human evaluators’ expectation of range of criteria for HT and MT under the two attributes and the evaluation was tested on a machine system to observe the system’s performance in terms of Accuracy and Intelligibility. This paper reports the range of criteria to evaluate translation in terms of Intelligibility as expected by human evaluators in HT and MT in terms of content and language transfer. The study uses a mixed method approach with soft data and hard data collection. The results demonstrate that the range of each criteria identified for content evaluation in HT is expected to be higher than in MT. The implications of the study are described to provide an understanding of evaluation for human and automated translation in terms of Intelligibility.
format	Article
author	Norwati Md Yusof, Saadiyah Darus, Mohd Juzaiddin Ab Aziz,
spellingShingle	Norwati Md Yusof, Saadiyah Darus, Mohd Juzaiddin Ab Aziz, Evaluating intelligibility in human translation and machine translation
author_facet	Norwati Md Yusof, Saadiyah Darus, Mohd Juzaiddin Ab Aziz,
author_sort	Norwati Md Yusof,
title	Evaluating intelligibility in human translation and machine translation
title_short	Evaluating intelligibility in human translation and machine translation
title_full	Evaluating intelligibility in human translation and machine translation
title_fullStr	Evaluating intelligibility in human translation and machine translation
title_full_unstemmed	Evaluating intelligibility in human translation and machine translation
title_sort	evaluating intelligibility in human translation and machine translation
publisher	Penerbit Universiti Kebangsaan Malaysia
publishDate	2017
url	http://journalarticle.ukm.my/12869/ http://journalarticle.ukm.my/12869/ http://journalarticle.ukm.my/12869/1/22088-65611-2-PB.pdf
first_indexed	2023-09-18T20:03:34Z
last_indexed	2023-09-18T20:03:34Z
_version_	1777407009180614656

Evaluating intelligibility in human translation and machine translation

Similar Items