Methods, Challenges, and Ethical Considerations in Data Collection of Corpus Compilation
DOI:
https://doi.org/10.47134/innovative.v3i3.122Keywords:
Corpus Compilation, Data Collection, Linguistics, Natural Language Processing, Representativeness, Copyright, Ethics In Research, Data PreprocessingAbstract
Corpus compilation is a critical process in linguistics that involves gathering and organizing large datasets for language analysis and model training. This article examines key aspects of corpus compilation, with a particular focus on data collection. It explores the sources of data, strategies for ensuring representativeness, and challenges such as copyright constraints and data quality issues. Ethical considerations, such as anonymization and consent, are also discussed. By understanding these factors, researchers can build effective and ethically sound corpora for linguistic research and computational applications.
References
Aston, G., & Burnard, L. (1998). The BNC Handbook: Exploring the British National Corpus with SARA. Edinburgh University Press.
Baisa, V., & Suchomel, V. (2014). Sketch Engine for Noisy Data: Evaluating Word Sketches. Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), 27-31 May 2014, Reykjavik, Iceland.
Biber, D. (1993). Representativeness in Corpus Design. Literary and Linguistic Computing, 8(4), 243-257. DOI: https://doi.org/10.1093/llc/8.4.243
Biber, D., Conrad, S., & Reppen, R. (1998). Corpus Linguistics: Investigating Language Structure and Use. Cambridge University Press. DOI: https://doi.org/10.1017/CBO9780511804489
Biber, D., Johansson, S., Leech, G., Conrad, S., & Finegan, E. (1999). Longman Grammar of Spoken and Written English. Pearson Education Limited.
Bowker, L., & Pearson, J. (2002). Working with Specialized Language: A Practical Guide to Using Corpora. Routledge. DOI: https://doi.org/10.4324/9780203469255
Crowdy, S. (1993). Spoken Corpus Design. Literary and Linguistic Computing, 8(4), 259-265. DOI: https://doi.org/10.1093/llc/8.4.259
Gries, S. T. (2009). Statistics for Linguistics with R: A Practical Introduction. Mouton de Gruyter. DOI: https://doi.org/10.1515/9783110216042
Kennedy, G. (1998). An Introduction to Corpus Linguistics. Longman.
Leech, G. (1992). 100 Million Words of English: The British National Corpus (BNC). Language Research, 28(1), 1-13.
McEnery, T., & Hardie, A. (2012). Corpus Linguistics: Method, Theory and Practice. Cambridge University Press. DOI: https://doi.org/10.1017/CBO9780511981395
Meyer, C. F. (2002). English Corpus Linguistics: An Introduction. Cambridge University Press. DOI: https://doi.org/10.1017/CBO9780511606311
Rissanen, M., Kytö, M., & Heikkonen, K. (1996). The Helsinki Corpus of English Texts: Diachronic and Dialectal. Department of English, University of Helsinki.
Alfraidi, T. (2022). The Saudi Novel Corpus: Design and Compilation. Applied Sciences (Switzerland), 12(13). https://doi.org/10.3390/app12136648 DOI: https://doi.org/10.3390/app12136648
Alfuraih, R. F. (2024). Exploitation and Evaluation of an Arabic-English Composite Learner Translator Corpus. International Journal of Arabic-English Studies, 24(1), 155–172. https://doi.org/10.33806/ijaes.v24i1.552 DOI: https://doi.org/10.33806/ijaes.v24i1.552
Chen, L. (2023). The Knowledge Tools of Ancient China and the Construction of Classical Knowledge Repositories. Journal of Library Science in China, 49(3), 19–40. https://doi.org/10.13530/j.cnki.jlis.2023019
Goncharova, O. V. (2024). Data Mining Efficiency in the ESG Indexes Verbalization Analysis (on the Example of the MSCI Site). Advances in Science, Technology and Innovation, 13–16. https://doi.org/10.1007/978-3-031-49711-7_3 DOI: https://doi.org/10.1007/978-3-031-49711-7_3
Jablotschkin, S. (2024). DE-Lite – a New Corpus of Easy German: Compilation, Exploration, Analysis. LT-EDI 2024 - 4th Workshop on Language Technology for Equality, Diversity, Inclusion, Proceedings of the Workshop, 106–117.
Lanza, D. F. (2023). THE SPOKEN CORPORA OF CENTRAL AMERICAN SPANISH: COMPILATION AND EVALUATIVE OVERVIEW. Normas, 13(1), 83–111. https://doi.org/10.7203/Normas.v13i1.27658 DOI: https://doi.org/10.7203/Normas.v13i1.27658
Maffei, D. P. (2023). The Database of Hellenistic Inscribed Epigrams from Doric-speaking Areas. Journal of Open Humanities Data, 9. https://doi.org/10.5334/johd.134 DOI: https://doi.org/10.5334/johd.134
Masua, B. (2024). In the heart of Swahili: An exploration of data collection methods and corpus curation for natural language processing. Data in Brief, 55. https://doi.org/10.1016/j.dib.2024.110751 DOI: https://doi.org/10.1016/j.dib.2024.110751
Oushiro, L. (2023). Computational resources for handling sociolinguistic corpora. The Handbook of Usage-Based Linguistics, 417–434. https://doi.org/10.1002/9781119839859.ch23 DOI: https://doi.org/10.1002/9781119839859.ch23
Paquot, M. (2024). The Core Metadata Schema for Learner Corpora (LC-meta). International Journal of Learner Corpus Research. https://doi.org/10.1075/ijlcr.24010.paq DOI: https://doi.org/10.1075/ijlcr.24010.paq
Rackevičienė, S. (2023). LITHUANIAN-ENGLISH CYBERSECURITYTERMBASE: PRINCIPLES OF DATA COLLECTION AND STRUCTURING. Rasprave Instituta Za Hrvatski Jezik i Jezikoslovlje, 49(2), 439–461. https://doi.org/10.31724/rihjj.49.2.12 DOI: https://doi.org/10.31724/rihjj.49.2.12
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Madina Dalieva
This work is licensed under a Creative Commons Attribution 4.0 International License.
