Research and Evaluation Essay #1 1

Research and Evaluation Essay #1

Spring 2024

Billy Barnacle Buckleboot

Professor: Dr. Fred Flint Bedrock

Amridge University

Submitted: 31st of February 2024 (Extra Leapyear Days this year…)

ABSTRACT:

This paper is about surveys, their design, creation, and so forth, and includes some info on

survey saturation. It includes 2-4 sources: 1) Two Peer-Reviewed Sources from the Amridge

University Library resource library; and, 2) a citation from the IoT (Internet of Things)…with a

reference for further study…and a citation from the textbook for this course… [more as you

write for your paper]

Cover Page: 20 Pts (it’s format)

Abstract: 20 Pts (it’s included and written to provide an

overview of the paper that follows…)

Methodologies or a Specific Methodology: 20 Pts (This

example below discusses the data collection process

of Surveys)

Research and Evaluation Essay #1 2

Using a limited number of sources for this exercise, what are some methods of data collection?

Address the issue(s) of ‘survey saturation’, in particular.”

While there are several methods of data collection used in the process of conducting

research, such as interviews, surveys, observations, focus groups, etc., this paper will deal with

surveys. Surveys are a methodology of preparing a questionnaire or other collection instrument,

to survey respondents (those who voluntarily participate in the study) for their responses,

opinions, and perceptions about the topic being studied. While a survey may seem as if it can

simply be a series of questions of rated answers, for the research to exhibit validity and

reliability, the survey must be designed with integrity and elements of statistical significance

built into its design. Why are surveys important? According to Cummings and Janicki (2021,

“abstract quote”), surveys are important in their applications knowledge: “A new addition to this

year’s study includes open-ended questions to go beyond the specific technologies covered in the

survey by asking participants what they feel are the most important technologies moving

forward.” Thus, if the vast industry of Information Systems is interested in valid responses from

those in this field, this is a strong indication that surveys have significant impact in the collection

data process relative to DDIDM (Data-Driven Informed Decision-Making).

Another source that speaks ‘volumes’ of the importance of the survey methodology is

found in the textbook of this course (Johnson & Christensen, 2020). Chapter 9, it titled, “How to

Construct a Questionnaire” and deals with its design, purpose, participants, language of the

questions, validity, reliability, and many other features of designing a survey that has been well

designed. In other words, if these highly-experienced authors consider the design of surveys to

be immaterial and unimportant, might they specifically have omitted or not included an entire

chapter dedicated to the topic of “How to Construct a Questionnaire?” I opine a yea!

Research and Evaluation Essay #1 3

And lastly, what is survey saturation? And how does it impact the quality of the

responses associated with a questionnaire? Or survey, if you prefer? Sometimes survey

saturation is considered to be the overuse of surveys to obtain data. In other words, it simply

means using surveys constantly to get employee data to make decisions, and that ‘survey

saturation’ increases the value and volume of the data collected. Or as Bettslley (2014, p. 4,

Holbeche, as quoted by Bettslley) noted: “Employers that conduct frequent staff surveys and fail

to analyse and act on their findings can lead to cynical employees who feel left without a voice.”

In other words, too many surveys can cause employees, participants, and others, to not take

seriously surveys when the volume and outcomes applied to the organization are not realized or

applied to issues the survey addressed. This means that survey saturation can have many

negative connotations if overused and applied incorrectly or not at all. In short, survey saturation

is an unwelcome overuse or misused application of surveys when done incorrectly or too

frequently. The survey designer must be cognizant of the overuse of surveys.

For additional insight into survey saturation or the overuse of surveys, please refer to the

following online article: “Survey Saturation: When is too much of a good thing too much?” This

valuable and insightful article can be found at, https://talentmap.com/survey-saturation-when-is-

too-much-of-a-good-thing-too-much/. This article points out specific issues with the overuse of

surveys and the elements that detract from a viable, reliable, and ethical collection of data via

surveys and their related processes, methods, and outcomes.

Methodologies or a Specific Methodology: 20

Pts (This example paper used Surveys and

addressed Survey Saturation as part of the

requirement of this assignment—among many

other methods of data collection)

Research and Evaluation Essay #1 4

Sources/Citations

Bettslley, C. (2014). Overuse of Staff Surveys Can Lead to Staff Cynicism. Employee Benefits,

9/25/2014, p. 4.

Cummings, J., & Sanicki, T. (2021). Survey of Technology and Skills in Demand: 2020 Update.

Journal of Information Systems Education, 32(2), 150-159.

Johnson, R., & Christensen, L. (2020). Educational Research: Quantitative, Qualitative, and

Mixed Methods, 7e. Sage.

TalentMap (2023). “Survey Saturation: When is too much of a good thing too much?”

https://talentmap.com/survey-saturation-when-is-too-much-of-a-good-thing-too-much/.

This example paper provided 4

sources, although only 2-4 are

required: 20 Pts