Review Article

Selection of Crowd in Crowdsourcing for Smart Intelligent Applications: A Systematic Mapping Study

Table 5

Quality score results of selected studies.

Cite no.TitleQ1Q2Q3Score

[34]A hybrid simulation model for crowdsourced software development1012
[35]A vision of crowd development1102
[36]Affinity-aware online selection mechanisms in mobile crowdsourcing sensing1113
[37]An exploratory study on perception of Indian crowd toward crowdsourcing software development1102
[16]Analyzing crowd labor and designing incentives for humans in the loop1102
[38]Barriers faced by newcomers to software crowdsourcing projects1102
[39]Competence, collaboration, and time management: Barriers and recommendations for crowd workers1113
[19]Competition-based crowdsourcing software development: A multi-method study from a customer perspective1102
[15]Crowd development1102
[40]CrowdService: Serving the individuals through mobile crowdsourcing and service composition0112
[41]Crowdsourced software development: Exploring the motivational and inhibiting factors of the South African crowd1102
[42]Efficient worker selection through history-based learning in crowdsourcing1113
[24]Estimating software task effort in crowds1012
[43]Guiding the crowds for android testing1102
[44]Leveraging crowdsourcing for team elasticity: An empirical evaluation at TopCoder1012
[45]Leveraging the power of the crowd for software testing0112
[22]Supporting coordination in crowdsourced software testing services1113
[13]Task allocation for crowdsourcing using AI planning1113
[4]Toward microtask crowdsourcing software design work0112
[28]Toward adopting alternative workforce for software engineering1012
[17]Virtual team performance in crowdsourcing contest: A social network perspective1102
[46]Who should be selected to perform a task in crowdsourced testing?1012
[47]Worker ranking determination in crowdsourcing platforms using aggregation functions1113
[48]A fuzzy expert system to trust-based access control in crowdsourcing environments1113
[49]A survey of the use of crowdsourcing in software engineering1113
[3]A systematic literature review on crowdsourcing in software engineering1113
[50]An incentive mechanism with privacy protection in mobile crowdsourcing systems1113
[51]A system for scalable and reliable technical-skill testing in online labor markets1012
[52]Auction-based crowdsourcing supporting skill management1113
[18]Best of both worlds: Mitigating imbalance of crowd worker strategic choices without a budget1102
[31]Catering to the crowd: An HRM perspective on crowd worker engagement0112
[53]CloudTeams: Bridging the gap between developers and customers during software development processes1113
[54]Competition matters! self-efficacy, effort, and performance in crowdsourcing teams1102
[12]Cooperation or competition—When do people contribute more? A field experiment on gamification of crowdsourcing1102
[11]Crowdsourcing: A taxonomy and systematic mapping study1102
[55]Crowdsourcing contests1102
[21]Crowdsourcing not all sourced by the crowd: An observation on the behavior of Wikipedia participants1102
[56]Efficient crowdsourcing of unknown experts using bounded multiarmed bandits1113
[57]Hybrid crowd-based decision support in business processes1113
[58]Improving accuracy and lowering cost in crowdsourcing through an unsupervised expertise estimation approach1012
[59]Incentivizing social media users for mobile crowdsourcing1113
[60]Information technology (IT)-enabled crowdsourcing: A conceptual framework1113
[61]Inspiring crowdsourcing communities to create novel solutions: Competition design and the mediating role of trust1102
[62]Mobile crowd sensing—Taxonomy, applications, challenges, and solutions0112
[63]Modeling cognitive bias in crowdsourcing systems1102
[64]Open or proprietary? Choosing the right crowdsourcing platform for innovation1102
[23]Privacy-preserving QoI-aware participant coordination for mobile crowdsourcing0112
[2]Real-time crowdsourcing with payment of idle workers in the retainer model1102
[65]SenseChain: A blockchain-based crowdsensing framework for multiple requesters and multiple workers0112
[14]The wisdom of crowds: The potential of online communities as a tool for data analysis1102
[30]Toward collaborative software engineering leveraging the crowd1102
[8]Trait motivations of crowdsourcing and task choice: A distal-proximal perspective1102
[9]Trust-based privacy-aware participant selection in social participatory sensing0112
[6]Understanding crowdsourcing projects: A systematic review of tendencies, workflow, and quality management1113
[66]Weaving risk identification into crowdsourcing lifecycle0112
[67]Winners, losers, and deniers: Self-selection in crowd innovation contests and the roles of motivation, creativity, and skills1102
[29]A context-aware approach for trustworthy worker selection in a social crowd1113
[68]A survey of task-oriented crowdsourcing1113
[27]An investigation of factors affecting the visits of online crowdsourcing and labor platforms1102
[69]Improving reliability of crowdsourced results by detecting crowd workers with multiple identities1102
[10]Volunteer selection based on crowdsourcing approach1113
[70]Why incorporating a platform-intermediary can increase crowdsourcees’ engagement1102
[71]A conceptual framework for increasing innovation through improved selection of specialized professionals1113
[72]Facilitating collocated crowdsourcing on situated displays1102
[73]Framework and literature analysis for crowdsourcing’s answer aggregation1102
[74]Practical POMDP-based test mechanism for quality assurance in volunteer crowdsourcing1102
[75]Rules of crowdsourcing: Models, issues, and systems of control1102
[76]Skills and wills: The keys to identify the right team in collaborative innovation platforms1012
[77]Task design, motivation, and participation in crowdsourcing contests1113
[5]Toward an understanding of participants’ sustained participation in crowdsourcing contests1102
[20]Crowdsourcing: A review and suggestions for future research1102
[7]Of crowds and talents: Discursive constructions of global online labor1113
[78]The ethical use of crowdsourcing1102
[79]A transfer learning-based framework of crowd-selection on twitter1012
[25]Crowd build: A methodology for enterprise software development using crowdsourcing1113
[80]CrowdEval: A cost-efficient strategy to evaluate crowdsourced worker’s reliability1113
[26]CrowdSelect: Increasing accuracy of crowdsourcing tasks through behavior prediction and user selection1012
[81]December: A declarative tool for crowd member selection1012
[82]Declarative user selection with soft constraints1012
[1]Optimal task partition with delay requirement in mobile crowdsourcing1113
[83]TDSRC: A task-distributing system of crowdsourcing based on social relation cognition1113