PDFReva O. M. — Doctor of Science in Engineering, Professor, Head of department, National Aviation University, 1, Kosmonavtа Komarova Av., Kyiv, 03058, Ukraine; ran54@meta.ua
Kamyshyn V. V. — Doctor of Science in Pedagogy, Corresponding member of the NAES of Ukraine, director of Ukrainian Institute of Scientific and Technical Expertise and Information, 180, Antonovуchа Str., Kyiv, Ukraine, 03680; +38 (044) 521-00-10
DETERMINATION METHOD FOR INTEGRATIVE INDICATOR OF EXPERT COMPETENCE
Abstract. A special universal role of expert procedures in a decision-making process and functioning of humanistic systems has been obtained. By methods of fuzzy mathematics, a qualitative scale for assessing the competence of experts has been developed and proposed. The scale is a term-set of the linguistic variable “Expert competence level” and covers five terms: “very high”, “high”, “average (normal)”, “low”, “very low”. Using mathematical method of prioritization, which is also called as “the task of the leader”, defuzzification of linguistic assessments of expert competence levels was carried out. This happens through providing them with appropriate, non-linearly changing “weighted” coefficients of desirability. A comparative analysis of the general methodology of aggregation of particular indicators of competency levels into an integrative (integral) assessment, which alone is inherent in the system property of emergence, is carried out. The choice of the multiplicative approach to the aggregation of private competency assessments is justified, which, unlike the additive one, allows only partial compensation of small values of some indicators of competence levels by large values for others. An example of the effectiveness of the multiplicative approach is given. It is proved that the implementation of the proposed procedures makes it possible to avoid statistical errors of the І–ІІ kind when the evaluation of real competence is either underestimated (error of the first kind) or overestimated (error of the second kind).
Keywords: expert procedures, expert competence, qualitative measurement scale, linguistic variable, defuzzification, desirability coefficients, multiplicative aggregation.
REFERENCES
1. Zade L. (1976) Ponyatie lingvisticheskoy peremennoy i ego primenenie k prinyatiyu priblizhennykh
resheniy [The concept of a linguistic variable and its application to the adoption of approximate solutions]. Ed. N. N. Moiseeva, S. A. Orlovskogo. Transl. from English N. I. Ringo. Moscow (in Russ.): Mir Publ., 165 p.
2. Nadezhnost i effektivnost v tekhnike: Effektivnost tekhnicheskikh sistem [Reliability and efficiency in technology: a guidebook of 10 volumes. Vol. 3: Efficiency of technical systems] Ed. V. F. Utkina, Yu. V. Kryuchkova. Moscow (in Russ.): Mashinostroenie Publ., 1988, 328 p.
3. Mirkin B. G. (1974) Problema gruppovogo vybora [The problem of group choice]. Moscow (in Russ.): Nauka Publ., 256 p.
4. Kitaev N. N. (1975) Gruppovye ekspertnye otsenki [Group expert assessments]. Moscow (in Russ.): Znanie Publ., 64 p.
5. Beshelev S. D., Gurvich F. G. (1980) Matematikostatisticheskie metody ekspertnykh otsenok [Mathematical and statistical methods of expert evaluation]. Moscow (in Russ.): Statistika Publ., 263 p.
6. Blyumberg V. A., Glushchenko V. F. (1982) Kakoe reshenie luchshe? Metod rasstanovki prioritetov [What is the best solution? Method of arrangement of priorities]. Leningrad (in Russ.): Lenizdat Publ., 160 p.
7. Pankova L. A., Petrovskiy A. M., Shneyderman M. V. (1984) Organizatsiya ekspertizy i analiz ekspertnoy
informatsii [Organization of examination and analysis of expert information]. Moscow (in Russ.): Nauka Publ., 117 p.
8. Vapakin Ye. N., Zheludov V. A., Bgantsov V. N., Ibneev S. S. Prinyatie resheniy na osnove ekspertnogo otsenivaniya [Decision-making on the basis of expert evaluation]. Toolkit. Leningrad (in Russ.): VIKI im. A. F. Mozhayskogo Publ., 1988. — 88 p.
9. Litvak B. G. (1996) Ekspertnye otsenki i prinyatie resheniy [Expert assessments and decision-making]. Moscow (in Russ.): Patent Publ., 272 p.
10. Samokhvalov Yu. Ya., Naumenko Ye. M. (2007) Ekspertnoe otsenivanie: metodicheskiy aspekt [Expert evaluation: the methodological aspect]. — Kyiv (in Ukr.): DUIKT Publ., 362 p.
11. Hnatiienko H. M., Snytiuk V. Ye. (2008) Ekspertni tekhnolohii pryiniattia rishen [Expert Decision-Making Technologies]. Monograph. Kyiv (in Ukr.): TOV “Maklaut” Publ., 444 p.
12. Orlov A. I. (2011) Organizatsionno-ekonomicheskoe modelirovanie. Ekspertnye otsenki [Organizationaleconomic modeling. Expert assessments]. A textbook in 3 volumes. Moscow (in Russ.): Izd-vo MTU im. N. E. Baumana Publ., 486 p.
13. Nasirov Sh. Sh. (2012) Bahatokrokova protsedura vyiavlennia statystychno-uzghodzhenoi systemy perevah aviadyspetcheriv na mnozhyni kharakternykh pomylok yikh diialnosti [Multi-year procedure for the identification of the statistically harmonized system of advantages of air traffic controllers on a set of characteristic errors of their activities]. Komunalne hospodarstvo mist: naukovo-tekhnichnyi zbirnyk [Municipal economy of cities: scientific and technical collection]. Iss. 105, Series of Engineering Sciences and Architecture. Khmelnytskyi (in Ukr.): KhNAMH Publ., pp. 461–475.
14. Arkhipov A. Ye., Arkhipova S. A. (2015) Otsenivanie urovnya kompetentnosti ekspertov po rezultatam mnogoobektnoy ekspertizy [Evaluation of the level of competence of experts based on the results of
multi-subject expertise]. Yekonomika ta derzhava [Economy and state]. Vol. 6, pp. 29–33.
15. Peregudov F. I., Tarasenko F. P. (1989) Vvedenie v sistemnyy analiz [Introduction to system analysis]. Tutorial. Moscow (in Russ.): Vysshaya shkola Publ., 367 p.
16. Anfilatov V. S., Yemelyanov A. A., Kukushkin A. A. (2002) Sistemnyy analiz v upravlenii [System analysis in management]. Tutorial. Moscow (in Russ.): Finansy i statistika Publ., 368 p.
17. Kofman A. (1982) Vvedenie v teoriyu nechetkikh mnozhestv [Introduction to the theory of fuzzy sets].
Ed. S. I. Travkina. Transl. from French. V. B. Kuzmina. Moscow (in Russ.): Radio i svyaz Publ., 432 p.
18. Kamyshyn V. V., Reva O. M., Makarenko L. M., Medvedenko O. M. (2012) Protsedura fazyfikatsii/defazyfikatsii baliv shkal otsiniuvannia [The procedure of phasification / dephasing of scoring scoring points]. Elektronika ta systemy upravlinnia [Electronics and control systems]. Kyiv (in Ukr.): NAU
Publ., Vol. 3, pp. 53–62.
19. Cherchmen U., Akoff R., Arnof L. (1968) Vvedenie v issledovanie operatsiy [Introduction to the study of operations]. Transl. from English. Moscow (in Russ.): Nauka Publ., 486 p.
20. Yevlanov L. G., Kutuzov V. A. (1978) Ekspertnye otsenki v upravlenii [Expert assessments in management]. Moscow (in Russ.): Ekonomika Publ., 133 p.
21. Denisov A. A., Kolesnikov D. N. (1981) Teoriya bolshikh sistem upravleniya [The Theory of Large Control Systems]. Tutorial. Leningrad (in Russ.): Energoizdat Publ., 238 p.
22. Batishchev D. I. (1984) Metody optimalnogo proektirovaniya [Methods of Optimal Design]. Tutorial.
Moscow (in Russ.): Radio i svyaz Publ., 248 p.
23. Lakin G. F. (1990) Biometriya [Biometrics]. Moscow (in Russ.): Vysshaya shkola Publ., 352 p.
24. Saati T. (1993) Prinyatie resheniy. Metod analiza ierarkhiy [Decision-making. The method of analyzing hierarchies]. Moscow (in Russ.): Radio i svyaz Publ., 314 p.
25. Gerasimov B. M., Divizinyuk M. M., Subach I. Yu. (2004) Sistemy podderzhki prinyatiya resheniy: proektirovanie, primenenie, otsenka effektivnosti [Decision Support Systems: Projecting, Application, Evaluation of Efficiency]. Sevastopol (in Ukr.), 320 p.
26. Reva O. M., Dobrianskyi I. A., Chabak A. A. (2004) Kompleksne vyznachennia kilkisnykh kharakterystyk nedystsyplinovanoi povedinky studentiv [Complex definition of quantitative characteristics of non-disciplined student behavior] Ridna shkola: shchomisiach. nauk.-ped. zhurn. Kyiv (in Ukr.): Demiur Publ., Vol. 12, pp. 63–66.
27. Kozeletskyi Yu. (1979) Psykholohycheskaia teoryia reshenyi [Psychological Theory of Solutions]. Ed. B. V. Byriukova. Transl. from Poland: H. E. Myntsa, V. N. Porusa. Moscow (in Russ.): Prohress Publ., 504 p.
28. Skott P. (1998) Psikhologicheskie otsenki i prinyatie resheniy [Psychological evaluation and decision- making]. Moscow (in Russ.): IID “Filin” Publ., 368 p.
29. Berzh K. (1962) Teoriya grafov i ee primenenie [The theory of graphs and its application]. Transl. from French. Moscow (in Russ.): IL Publ., 320 p.
30. Kamyshyn V. V. (2012) Metody systemnoho analizu u kvalimetrii navchalno-vykhovnoho protsesu [Methods of system analysis in the qualimetry of the educational process]. Monohrafiia. Kyiv (in Ukr.): TOV “Informatsiini systemy” Publ., 270 p.
31. Bronshteyn I. N., Semendyaev K. A. (1981) Spravochnik po matematike (dlya inzhenerov i uchashchikhsya vuzov) [Handbook on mathematics (for engineers and students of universities)]. Transl.
from German. Ed. G. Groshe, V. Tsiglera. — Leyptsig: Toybner; Moscow (in Russ.): Nauka Publ., 719 p.
32. Reva A. N., Shulgin V. A., Borsuk S. P. et al. Borsuk Multiplikativnyy podkhod k integralnoy otsenke
urovnya professionalnoy podgotovki aviatsionnykh operatorov [A multiplicative approach to the integrated assessment of the level of training of aviation operators] Elmi m cmu l r : Jurnal Milli Aviasiya Akademiyasinin, Baki, Iyul — Sentyabr 2014. — Child. 16. pp. 42–53.
33. Harrington E. C. (1965) Industr. Qualitu control. Vol. 21, no. 10.
34. Adler Yu. P., Markova Ye. V., Granovskiy Yu. V. (1976) Planirovanie eksperimenta pri poiske optimalnykh
usloviy [Planning an experiment in search of optimal conditions]. Moscow (in Russ.): Nauka Publ., 278 p.
35. Kamyshуn V. V., Reva A. N. (2013) Sovershenstvovanie shkaly Kharringtona dlya integralnoy otsenki
akademicheskoy odarennosti [Improving the Harrington Scale for Integral Assessment of Academic Giftedness] Obdarovani dity — intelektualnyi potentsial derzhavy [Gifted Children is Intellectual Potential of the State] materials of the International Scientific and Practical Conference, September 26–30, Gaspra, Crimea, Kyiv (in Ukr.): Gifted Child Institute of National Academy of Sciences of Ukraine, pp. 23–33.
