Methods, Challenges, and Ethical Considerations in Data Collection of Corpus Compilation
DOI:
https://doi.org/10.47134/innovative.v3i3.122Keywords:
Corpus Compilation, Data Collection, Linguistics, Natural Language Processing, Representativeness, Copyright, Ethics In Research, Data PreprocessingAbstract
Corpus compilation is a critical process in linguistics that involves gathering and organizing large datasets for language analysis and model training. This article examines key aspects of corpus compilation, with a particular focus on data collection. It explores the sources of data, strategies for ensuring representativeness, and challenges such as copyright constraints and data quality issues. Ethical considerations, such as anonymization and consent, are also discussed. By understanding these factors, researchers can build effective and ethically sound corpora for linguistic research and computational applications.
References
Aston, G., & Burnard, L. (1998). The BNC Handbook: Exploring the British National Corpus with SARA. Edinburgh University Press.
Baisa, V., & Suchomel, V. (2014). Sketch Engine for Noisy Data: Evaluating Word Sketches. Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), 27-31 May 2014, Reykjavik, Iceland.
Biber, D. (1993). Representativeness in Corpus Design. Literary and Linguistic Computing, 8(4), 243-257.
Biber, D., Conrad, S., & Reppen, R. (1998). Corpus Linguistics: Investigating Language Structure and Use. Cambridge University Press.
Biber, D., Johansson, S., Leech, G., Conrad, S., & Finegan, E. (1999). Longman Grammar of Spoken and Written English. Pearson Education Limited.
Bowker, L., & Pearson, J. (2002). Working with Specialized Language: A Practical Guide to Using Corpora. Routledge.
Crowdy, S. (1993). Spoken Corpus Design. Literary and Linguistic Computing, 8(4), 259-265.
Gries, S. T. (2009). Statistics for Linguistics with R: A Practical Introduction. Mouton de Gruyter.
Kennedy, G. (1998). An Introduction to Corpus Linguistics. Longman.
Leech, G. (1992). 100 Million Words of English: The British National Corpus (BNC). Language Research, 28(1), 1-13.
McEnery, T., & Hardie, A. (2012). Corpus Linguistics: Method, Theory and Practice. Cambridge University Press.
Meyer, C. F. (2002). English Corpus Linguistics: An Introduction. Cambridge University Press.
Rissanen, M., Kytö, M., & Heikkonen, K. (1996). The Helsinki Corpus of English Texts: Diachronic and Dialectal. Department of English, University of Helsinki.
Alfraidi, T. (2022). The Saudi Novel Corpus: Design and Compilation. Applied Sciences (Switzerland), 12(13). https://doi.org/10.3390/app12136648
Alfuraih, R. F. (2024). Exploitation and Evaluation of an Arabic-English Composite Learner Translator Corpus. International Journal of Arabic-English Studies, 24(1), 155–172. https://doi.org/10.33806/ijaes.v24i1.552
Chen, L. (2023). The Knowledge Tools of Ancient China and the Construction of Classical Knowledge Repositories. Journal of Library Science in China, 49(3), 19–40. https://doi.org/10.13530/j.cnki.jlis.2023019
Goncharova, O. V. (2024). Data Mining Efficiency in the ESG Indexes Verbalization Analysis (on the Example of the MSCI Site). Advances in Science, Technology and Innovation, 13–16. https://doi.org/10.1007/978-3-031-49711-7_3
Jablotschkin, S. (2024). DE-Lite – a New Corpus of Easy German: Compilation, Exploration, Analysis. LT-EDI 2024 - 4th Workshop on Language Technology for Equality, Diversity, Inclusion, Proceedings of the Workshop, 106–117.
Lanza, D. F. (2023). THE SPOKEN CORPORA OF CENTRAL AMERICAN SPANISH: COMPILATION AND EVALUATIVE OVERVIEW. Normas, 13(1), 83–111. https://doi.org/10.7203/Normas.v13i1.27658
Maffei, D. P. (2023). The Database of Hellenistic Inscribed Epigrams from Doric-speaking Areas. Journal of Open Humanities Data, 9. https://doi.org/10.5334/johd.134
Masua, B. (2024). In the heart of Swahili: An exploration of data collection methods and corpus curation for natural language processing. Data in Brief, 55. https://doi.org/10.1016/j.dib.2024.110751
Oushiro, L. (2023). Computational resources for handling sociolinguistic corpora. The Handbook of Usage-Based Linguistics, 417–434. https://doi.org/10.1002/9781119839859.ch23
Paquot, M. (2024). The Core Metadata Schema for Learner Corpora (LC-meta). International Journal of Learner Corpus Research. https://doi.org/10.1075/ijlcr.24010.paq
Rackevičienė, S. (2023). LITHUANIAN-ENGLISH CYBERSECURITYTERMBASE: PRINCIPLES OF DATA COLLECTION AND STRUCTURING. Rasprave Instituta Za Hrvatski Jezik i Jezikoslovlje, 49(2), 439–461. https://doi.org/10.31724/rihjj.49.2.12
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Madina Dalieva
This work is licensed under a Creative Commons Attribution 4.0 International License.
