632:
of what they wanted to accomplish: for example, selling more products, increasing movie ticket sales, and achieving a higher fee per commercial slot. Often, a client would show different versions to different audiences, e.g. different movie endings, to gauge their relative effectiveness. ASI would give out free tickets on the street to bring people into the theater, called the "Preview House" for particular showings. In these showings, each attendee would fill out a questionnaire and then be placed in a seat with a "dial" handset outfitted with a single knob that the attendee would turn to indicate their level of interest. Turning the knob all the way left meant "dull" while turning it to the right meant "great." In 1976, ASI upgraded their system to become fully digital, have Yes/No buttons and, in some cases, numeric keys for entering in numbers, choices and monetary amounts.
425:
and then ask the students a question that tests their understanding of a key concept. Students indicate their answer to the instructor using an
Audience Response system and then they discuss with their fellow students why they chose a particular answer and explain to one another their underlying thinking. The instructor then asks the question again to see the new student's results. The study authors used scanned forms and hand-raising for Audience Response in the initial year of the study and then switched to a computer-based Audience Response system in the following years. The "clicker" use was only part of a multi-pronged attempt to introduce peer instruction, but overall they found that "the students taught with P I (Spring 2000,
692:
maverick). Their senior-executive bosses tended to see the
Consensor as "a blatant attempt to impose democratic procedures into a corporate hierarchy that is anything but democratic." Simmons observed that "A majority of corporations are run as fiefdoms, with the CEO playing the role of Supreme Power; he may be a benevolent dictator, but nonetheless still a dictator." He described this type of senior executives with ironic tone, stating they were "secure in the knowledge of their own infallibility." Nonetheless, Applied Futures sold plenty of units to business firms and government agencies. In October 1984, it became a subsidiary of Brooks International Corporation, a management consulting firm.
417:), faculty members and students in courses using clickers were given a survey that assessed their attitudes about clicker use in Fall 2005 and its effect on teaching and learning. Of the 27 faculty members who responded to the survey, 94% either agreed or strongly agreed with the claim, "Clickers increased student engagement in the classroom." The remaining 6% responded that they were neutral about that claim (none of the faculty respondents disagreed or strongly disagreed with the claim). Similarly, 69% of the 2,684 students respondents agreed or strongly agreed with the claim, "Clickers led me to become engaged in class," with only 13% disagreeing or strongly disagreeing with the claim.
842:, as well as classroom desktop computers. If the facilitator's computer is also Wi-Fi-enabled, they can even create their own IP network, allowing a closed system that doesn't depend on a separate base station. The web server resides on or is accessible to the facilitator's computer, letting them control a set of web pages presenting questions. Participants log into the server using web browsers and see the questions with forms to input their responses. The summarized responses are available on a different set of pages, which can be displayed through the projector and also on each participant's device.
468:
with the claim, "Clickers allowed me to assess student knowledge on a particular concept." Students also recognized this benefit for their own self-assessment. Seventy-five percent of student respondents agreed or strongly agreed with the claim, "Clickers helped me get instant feedback on what I knew and didn't know." In a published article, a member of the
University of Massachusetts Amherst Physics Education Research Group (UMPERG) articulated this advantage in more detail, using the term "Classroom Communication System (CCS)" for what this article has been calling an Audience Response system.
433: = 178)" on two standard tests, the "Force Concept Inventory and the Mechanics Baseline Test" and on traditional course exams as well. A Johns Hopkins study on the use of Audience Response systems in Continuing Medical Education (CME) for physicians and other health personnel found no significant difference in knowledge scores between ARS and non-ARS participants in a clinical round table trial involving 42 programs across the United States.
439:
really see what response their fellow audience members are giving. The software that summarizes the results aggregates the responses, listing what percent of respondents chose a particular answer, but not what individual respondents said. With some
Audience Response systems, the software allows you to ask questions in truly anonymous mode, so that the database (or "gradebook") is not even associating answers with individual respondents.
464:
opinion, students are genuinely interested in seeing the results. They want to learn if they answered the question correctly, and they want to see how their response compares to the responses of their fellow audience members. The increased student engagement cited in the
University of Wisconsin study (see footnote 1 below) attests to the ability of Audience Response systems to improve the learning environment.
132:
36:
723:). The app then communicates with the Audience Response system (which is itself just software running on someone's device, whether desktop, laptop, tablet, or phone) via the local wireless network, the cellular telephone network, or both. In this model, the entire audience response system is a software product; all of the hardware is what the users brought with them.
880:
SMS affords additional educational features like MCQ-Reasoning– a feature developed in a SMSRS system in
Singapore that allows respondents to tag a reason to their choice of options in an MCQ. This eliminates the potential of "guessing-the-correct-answer" syndrome and text mining of SMS responses (to provide the gist of the messages collectively in a visual map).
77:
488:. Database entries are linked to a particular user, based on an ID number entered into the handheld remote device or based on a registration between the user and the company that manufactures the handheld device. Answers can be analyzed over time and the data can be used for educational research or other forms of analysis.
683:
The
Consensor was a system of dials, wires, and three lights: red, yellow, and green. A question was asked verbally and people would turn their dials anywhere from 0 to 10. If the majority agreed, the green lamp would light. If not, either the yellow or red lamp would light, depending on the level of
667:
Simmons retired from IBM in
January 1972, and soon after he formed a startup company with Gordon, called Applied Futures, Inc., to develop and market the system, which they called the Consensor . Applied Futures was one of the first Audience Response companies. In 1972, while Gordon and his assistant
938:
Audience
Response software enables the presenter to collect participant data, display graphical polling results, and export the data to be used in reporting and analysis. Usually, the presenter can create and deliver her entire presentation with the ARS software, either as a stand-alone presentation
796:
in a lecture or other classroom-type setting, for example by quizzing students, taking a quick survey, or taking attendance. They can be used effectively by students as young as 9 or 10, depending on their maturity level. An educator is able to generate worksheets and let students enter their answer
783:
The oldest of these technologies, IR Audience
Response systems are better suited for smaller groups. IR uses the same technology as a TV remote, and is therefore the only one of the four technologies that requires line-of-sight between the keypad and receiver. This works well for a single keypad but
463:
Creates an interactive and fun learning environment: Clickers are in many ways novel devices, so the novelty itself can add interest to the learning environment. More important, though, is the interactive nature of Audience Response systems. Having been asked a particular question about a concept or
424:
In a related study, Catherine Crouch and Eric Mazur more directly measured the results of Peer Instruction and "ConcepTests" on student learning and retention of information at the end of a semester. Faculty members using this "Peer Instruction" pedagogical technique present information to students,
364:
Depending on the presenter's requirements, the data can be collected anonymously, or it can be traced to individual participants who have created accounts in advance of the poll. This method is commonly used on corporate training where attendance must be verified and in classrooms, where grades must
279:
More recent entrants into the market do not require specialized hardware. There are commercial, open-source, cloud-based tools that allow responses from the audience using a range of personal computing devices such as cell phones, smartphones, and laptops. These types of systems have added new types
879:
The advantage of using such SMS type of response system is not limited to the logistical advantage of the presenter keeping no device inventory, it comes with an associated range of pedagogical advantages, such as agile learning and peer instruction (as possible with all types of response systems).
817:
Ideal for large group environments, RF systems can accommodate hundreds of voters on a single base station. Using some systems, multiple base stations can be linked together in order to handle audiences that number in thousands. Other systems allow over a thousand on just one base. Because the data
631:
developed a proprietary analog ARS system for evaluating the response of a theater audience to unreleased motion pictures, television shows, and commercials. This early ARS was used by ASI's clients– major motion picture and television studios and advertising agencies– to evaluate the effectiveness
317:
Depending on the presenter's requirements, the data can either be collected anonymously (e.g., in the case of voting) or it can be traced to individual participants in circumstances where tracking is required (e.g., classroom quizzes, homework, or questions that ultimately count towards a student's
854:
debates and displayed as a live "worm" graph on the broadcast screen. For advertising and media research, online "dial testing" using an onscreen scale slider that is controlled by a mouse (or finger swipe on a touchscreen) is being used in conjunction with surveys and online communities to gather
695:
One of the early educational uses of an Audience Response system occurred at Rice University. Students in a computer-equipped classroom were able to rate how well they understood portions of a lecture, answer multiple choice questions, and answer short essay questions. Results could be tallied and
691:
management style of the day proved a formidable opponent to this new tool, which promoted consensus building. In his memoir, Simmons describes how junior-executive sales prospects tended to like the idea, imagining themselves heroically speaking truth to power (but not paying any price for being a
590:
connector. In a software solution, each device communicates with the question via SMS or the internet. After a set time–or after all participants have answered–the system ends the polling for that particular question and tabulates the results. Typically, the results are instantly made available to
467:
Confirms audience understanding of key points immediately: In the University of Wisconsin study previously cited, faculty members were unanimous in their recognition of this key advantage of Audience Response systems. In other words, 100% of the faculty respondents either agreed or strongly agreed
459:
indicating what percent of audience members chose the various possible responses. For questions with right/wrong answers, audience members can get immediate feedback about whether they chose the correct answer, since it can be indicated on the bar chart. For survey-type polling questions, audience
659:
answer value for a question would remain secret, but the group's average, weighted with weighting factors, would be instantly displayed. Thus (something approximating) the group's true consensus would be known, even though individual middle managers or aspiring junior executives would not have to
475:
By providing feedback to an instructor about students' background knowledge and preconceptions, CCS-based pedagogy can help the instructor design learning and experiences appropriate to student's state of knowledge and explicitly confront and resolve misconceptions. By providing frequent feedback
849:
during the 2013 State of The Union (US) address by President Barack Obama. The system allowed registered users to input their responses (positive, negative, neutral) to the address and visualized the results as a trending graph in real time. Bing Pulse has since been used to cast over 35 million
585:
An Audience Response system (ARS), or Personal Response System (PRS), allows large groups of people to vote on a topic or answer a question. Depending on the solution chosen, each person has a device with which selections can be made or a mobile device that they can use to respond. In a hardware
442:
Tracks individual responses: The "clickers" that audience members use to send their responses to the receiver (and thus to the presenter's computer) are often registered to a particular user, with some kind of identifying number. When a user sends his/her response, the information is stored in a
438:
Polls anonymously: Unlike a show of hands or a raising of cards with letters on them, sending responses by hand-held remotes is much more anonymous. Except perhaps for a student (our audience member) who watches what the person next to them submits, the other students (or audience members) can't
393:
is reduced because unlike hand raising, it is difficult to see which selection others are making. The ARS also allows for faster tabulation of answers for large groups than manual methods. Additionally, many college professors use ARS systems to take attendance or grade answers in large lecture
867:
responses and display them through a web page. These solutions don't require specialized voting hardware, but they do require telecom hardware (such as a mobile phone) and software along with a web server and tend to be operated by dedicated vendors selling usage. They are typically favored by
420:
Increases knowledge retention: In the same University of Wisconsin study, 74% of the faculty respondents agreed or strongly agreed with the claim, "Clickers have been beneficial to my students' learning," with the remaining 26% choosing a "neutral" response (no faculty respondent disagreed or
875:
Cell phone enabled response systems, such as SMS Response System, are able to take text inputs from the audience and receive multiple responses to questions per SMS. This allows a new pedagogical approach to teaching and learning, such as the work by Derek Bruff and an initiative on SMSRS.
454:
Displays polling results immediately: The Audience Response system includes software that runs on the presenter's computer that records and tabulates the responses by audience members. Generally, once a question has ended (polling from the audience has ceased), the software displays a
655:). Gordon had conceived and partially developed what would today be called an Audience Response system. Simmons immediately saw practical applications for it in large corporate meetings to allow people to air their true opinions in anonymous fashion. So, each individual's
808:
Audience Response systems can also be used in classroom settings to simulate randomized controlled trials (RCT) such as "Live the Trial," a mock RCT used to teach the concepts of clinical research. The mock trial answered the question "Do red smarties make you happier?".
447:(sometimes called the "Gradebook" in academic models of Audience Response systems) associated with each particular number, and presenters have access to that information after the end of the interactive session. Audience Response systems can often be linked to a
895:. SMS is still a solid solution because of its penetration and stability, but won't easily allow multi-voting support and might cause problem with multi-country audiences. The issue with SMS not supporting multi-country audiences is projected to be solved with
818:
travels via radio frequency, the participant merely needs to be within range of the base station (300 – 500 feet). Some advanced models can accommodate additional features, such as short word answers, user log-in capabilities, and even multi-site polling.
272:. Various names are used for this technology, including real-time response, the worm, dial testing, and Audience Response meters. In educational settings, such systems are often called "student response systems" or "personal response systems". The hand-held
300:
to project a presentation for the audience to see. In the most common use of such Audience Response systems, presentation slides (built with the Audience Response software) display questions with several possible answers, more commonly referred to as
313:
is graphically displayed within the presentation for all to see. Some clickers also have additional keys, allowing the presenter to ask (and audience members to answer) true/false questions or even questions calling for particular numerical answers.
921:
With a standard mobile browser solution, these are click and go solutions without additional installations. Therefore, live audiences can be reached, and smartphone voting can be used–as with SMS–in any number of different locations. With the
421:
strongly disagreed with the claim.) Similarly, 53% of the student respondents agreed or strongly agreed with the claim, "Clickers have been beneficial to my learning," with only 19% disagreeing or strongly disagreeing with that claim.
483:
Gather data for reporting and analysis: Unlike other forms of audience participation (such as a show of hands or holding up of response cards), Audience Response systems use software to record Audience Responses that are stored in a
699:
Audience Response technology has evolved over time, moving away from hardware that required extensive wiring towards hand held wireless devices and small, portable receivers. In the 1980s, the Consensor product line evolved toward
917:
With mobile apps and browser enabled voting, there aren't any setup costs for hardware since the audience uses their own phones as voting devices and the result is often presented in any browser controlled by the lecturer.
804:
The fact that students can send responses anonymously means that sensitive topics can be included more readily than would otherwise be the case. An example of this is in helping students to learn about plagiarism.
784:
can fail due to interference when signals from multiple keypads arrive simultaneously at the receiver. IR systems are typically more affordable than RF systems, but do not provide information back to the keypad.
868:
traveling speaking professionals and large conference halls that don't want to distribute, rent, or purchase proprietary ARS hardware. Computing devices with web browsers can also use these serviceLLs through
284:, as well as the more traditional true/false and multiple choice style questions. This type of system also mitigates some of the concerns articulated below in the "Challenges of Audience Response" section.
1354:
883:
Interactive SMS Forum is another feature that is proprietary to SMS-type response systems where audiences not only post their questions, but can also answer the questions posted by others via SMS.
1384:
460:
members can see from the summary how many other audience members chose the same response, along with how many audience members (or what percent of the audience) chose different responses.
850:
votes during national news broadcasts and other live meetings. Over 10,000 viewers powered the iPowow Viewer Vote which tracked live viewer emotional response for Channel 7 during the
309:
keypad. Their answer is then sent to a base station–or receiver–that is also attached to the presenter's computer. The Audience Response software collects the results and the aggregate
602:
of each remote control or the students identity number is entered beforehand in the control computer's database. In this way, the answer of each individual can later be identified.
357:. Results are instantly tabulated via the internet and presented on screen in real-time, including grading the "correct" answer if desired. Some services offer presenters real time
731:
There are two books that have been written specifically about Audience Response systems by people who are considered experts in the use of Audience Response technology. In 2009,
1350:
Lane, David, and Atlas, Robert. "The Networked Classroom," Paper presented at the 1996 meeting of Computers and Psychology, York, UK, March 1996. Abstract available at: "
1617:"'Bring your own device' catching on in schools (Ed-tech access is an issue, but students' personal devices are an attractive option to a growing number of districts)"
651:
in the private sector, that is, future studies applied to corporate planning. Through this work he had met Theodore J. (Ted) Gordon of The Futures Group (now part of
1693:
1115:. Vol. 2007, Issue 10, May 8, 2007, pp. 6–7. A public version of the information, in the form of a PowerPoint presentation about the findings, is available at:
845:
Internet has also made it possible to gather audience responses in massive scale. Various implementations of the concept exist. For example, Microsoft featured
759:
The majority of current Audience Response systems use wireless hardware. Two primary technologies exist to transmit data from the keypads to the base stations:
586:
solution, each remote communicates with a computer via receivers located around the room or via a single receiver connected to the presenter's computer using a
704:
that could be plugged into a PC, and a software application to run thereon. Wireless LANs allow today's peripherals to be cordless. Another example of this is
1417:
Newton, Philip (2 April 2016). "Academic integrity: a quantitative study of confidence and understanding in students at the start of their higher education".
1351:
1535:
1191:
Miller, Redonda G., Ashar, Bimal H. and Getz, Kelly J. "Evaluation of an audience response system for the continuing education of health professionals."
910:
coverage, software systems can be used for live audience feedback, mood measurement, or live polling. These systems frequently support voting with both
476:
about students' ongoing learning and confusions, it can help an instructor dynamically adjust her teaching to students' real, immediate, changing needs.
381:
Only software or cloud-based Audience Response systems can accommodate distributed audiences due to the inconveniences and costs of hardware devices.
944:
914:
as well as mobile browsers. These apps invoke available local area networks (LAN) and provide a charge-free and cuts the needs to devoted hardware.
1396:
414:
406:
402:
305:
questions. The audience participates by selecting the answer they believe to be correct and pushing the corresponding key on their individual
1180:
712:
add-in, which has made it easier for teachers, professors, and office professionals to integrate Audience Response into their presentations.
797:
choices at their own pace. After each question, the educator is able to instantly show the results of any quiz, for example in the form of
410:
891:
With increasing penetration of smartphones with permanent internet connections, live Audience Response/voting can be achieved over the
624:
Since the 1960s, a number of companies have offered Response Systems, several of whom are now defunct or changed their business model.
1642:
507:
The configuration, troubleshooting, and support of the related presentation software (which may or may not work well with ARS devices)
249:
is a type of interaction associated with the use of Audience Response systems to facilitate interaction between a presenter and their
149:
95:
49:
1555:"(2010) Educating the Mobile Generation – using personal cell phones as audience response systems in post-secondary science teaching"
1196:
233:
215:
113:
63:
513:
For hardware only applications: a lack of open ended questions, dial testing capabilities, and other non standard question formats
851:
196:
553:
1085:
Kaleta, Robert; Joosten, Tanya (May 8, 2007). "Student Response Systems: A University of Wisconsin System Study of Clickers".
168:
1661:
1628:
636:
153:
1649:
The memoir of a senior IBM executive, giving his recollections of his and IBM's experience from World War II into the 1970s.
87:
1352:
http://scholarship.rice.edu/bitstream/handle/1911/78034/networked_classroom_%28Audience_Response_System%29-1.pdf?sequence=1
1678:
1504:
926:
solution the audience does not necessary need to be in the same area as the lecturer as with radio frequency, infrared or
605:
In addition to the presenter's computer and projector, the typical Audience Response system has the following components:
175:
565:
1616:
1111:
Kaleta, Robert, and Joosten, Tanya. "Student Response Systems: A University of Wisconsin System Study of Clickers,"
370:
674:), which was granted in 1973 with Gordon and Becker as inventors. Another patent, filed in 1974 and granted in 1976 (
510:
The reliability and performance of the devices under non-optimal conditions of the room in which the devices are used
1095:
A public version of the information, in the form of a PowerPoint presentation about the findings, is available at:
1022:
835:
448:
345:
of choice. During the presentation, the questions automatically display within the presentation program, or from a
182:
142:
1688:
1027:
863:
The familiarity and widespread use of cell phones and text messaging has now given rise to systems that collect
775:(sometimes in a unified system with IR and RF equipment). Cell phone-based systems are also becoming available.
164:
1454:"A Mock Randomized Controlled Trial With Audience Response Technology for Teaching and Learning Epidemiology"
1566:
1017:
652:
522:
Audience Response is utilized across a broad range of industries and organizations. A few examples include:
1683:
826:
Web-based Audience Response systems work with the participants' existing computing devices. These include
661:
643:
executive, reflected on how unproductive most meetings were. Simmons had become essentially a nonacademic
365:
be assigned. Data from both methods can be saved and analyzed by the presenter and loaded manually or via
55:
389:
There are many benefits with the use of Audience Response systems (ARS). The tendency to answer based on
736:
628:
261:
1142:
940:
715:
The advent of smartphones has made it possible for audience members to download an app (or run it as
587:
451:, which increases the ability to keep track of individual student performance in an academic setting.
342:
322:
that resides on the host computer and data reports can be created after the presentation for further
1012:
688:
501:
The per-unit purchase price of ARS devices, typically 10 times the cost of a software only solution
337:. In this case, however, those questions can be open-ended, dial testing, voteable, open ended, or
1049:
1484:
1434:
1175:
Crouch, Catherine H., and Mazur, Eric. "Peer Instruction: Ten years of experience and results."
1158:
957:
744:
732:
635:
Another of the industry's earliest systems was the Consensor. In the late 1960s and early 1970s,
612:
wireless keypads (one for each participant), or mobile devices for software/cloud based solutions
189:
1655:
1638:
1476:
827:
668:
Harold S. (Hal) Becker were still working on development, Applied Futures filed for a patent (
264:. Systems for remote audiences may use telephones or web polls for audiences watching through
429: = 155) significantly outperformed the students taught traditionally (Spring 1999,
1468:
1426:
1150:
987:
390:
647:
in building up IBM's long-range planning operations. He was one of the pioneers of applied
1508:
1358:
793:
764:
648:
544:
497:
Audience Response systems may present some difficulties in both their deployment and use.
350:
338:
302:
297:
1146:
751:. This book focused on using Audience Response technology in non-academic environments.
397:
Audience Response offers many potential benefits to those who use it in group settings.
280:
of functionality as well, such as free text responses that are aggregated into sortable
17:
1130:
768:
705:
273:
1116:
1096:
276:
that students use to convey their responses to questions is often called a "clicker".
1672:
1438:
1214:
992:
892:
599:
1632:
1488:
1209:
Beatty, Ian. "Transforming Student Learning with Classroom Communication Systems,"
1162:
1007:
982:
656:
334:
1430:
1067:
504:
The maintenance and repair of devices when owned by a central unit or organization
401:
Improves attentiveness: In a study done at four University of Wisconsin campuses (
1453:
1501:
962:
911:
896:
869:
720:
664:
was famous for its valuing of conformity; this was common at other firms, too).
346:
131:
741:
Teaching with Classroom Response Systems: Creating Active Learning Environments
997:
846:
831:
709:
701:
676:
670:
358:
354:
281:
265:
1472:
972:
927:
798:
592:
456:
323:
1480:
1536:"Crowdsourcing the worm: the Aussie start-up tracking the election debate"
361:
for open-ended responses or questions prior to displaying them on screen.
1002:
772:
760:
644:
485:
444:
330:
319:
306:
293:
269:
257:
250:
595:
displayed on the projector or viewed in a web browser for some systems.
749:
Read the Room for Real: How a Simple Technology Creates Better Meetings
1452:
Baker, Philip R. A.; Francis, Daniel P.; Cathcart, Abby (2017-04-22).
1154:
977:
967:
1213:
Volume 2004, Issue 3 (February 3, 2004), p. 5. Available online at
349:, and can in some cases even be displayed only on the participant's
801:, creating rapid 2-way feedback about how well learners are doing.
903:
839:
747:, a meeting strategist and civic engagement consultant, released
923:
907:
792:
Audience Response systems can be used as a way of incorporating
716:
394:
halls, which would be highly time-consuming without the system.
310:
1319:
1317:
1315:
1313:
1300:
1298:
864:
640:
366:
125:
70:
29:
1554:
687:
Although business was strong for this fledgling company, the
329:
Software/Cloud Based Audience Response: The presenter uses a
680:), lists Simmons and James A. Marquis. Sales began in 1974.
1587:
541:
Public participation in municipal or environmental planning
341:. Those questions are then downloaded into the presenter's
1334:
1332:
1237:
1235:
1179:
Vol. 69, No. 9, September 2001. pp. 971–72. Available at
660:
jeopardize their conformity to effect this result. (IBM's
1521:
1193:
Journal of Continuing Education in the Health Professions
609:
base station (receiver) for hardware based solutions only
1621:
ESchool News (Technology News for Today's K-20 Educator)
1559:
Journal of Computers in Mathematics and Science Teaching
1385:"Clickers in the Classroom: An Active Learning Approach"
1205:
1203:
1211:
Educause Center for Applied Research Research Bulletin.
1131:"Peer Instruction: Ten years of experience and results"
292:
Hardware Based Audience Response: The presenter uses a
1113:
Educause Center for Applied Research Research Bulletin
1087:
Educause Center for Applied Research Research Bulletin
1050:"CNN to track debate viewers' responses in real time"
318:
course grade). Incoming data may also be stored in a
1129:
Crouch, Catherine H.; Mazur, Eric (September 2001).
838:, which are typically connected to the internet via
1117:
http://www.educause.edu/ir/library/pdf/EDU06283.pdf
1097:
http://www.educause.edu/ir/library/pdf/EDU06283.pdf
156:. Unsourced material may be challenged and removed.
1215:http://www.educause.edu/ir/library/pdf/ERB0403.pdf
1634:Inside IBM: the Watson years (a personal memoir)
1195:. Vol. 23, No. 2, 2003. pp.109–115. Abstract at
1419:Assessment & Evaluation in Higher Education
1338:
1323:
1304:
1289:
1277:
1265:
1253:
1241:
1226:
1107:
1105:
872:, if a separate web interface isn't provided.
771:-based software that routes the data over the
598:In situations where tracking is required, the
855:continuous feedback on video or audio files.
8:
64:Learn how and when to remove these messages
627:Circa 1966, Audience Studies Institute of
333:to create the questions, sometimes called
256:Systems for co-located audiences combine
234:Learn how and when to remove this message
216:Learn how and when to remove this message
114:Learn how and when to remove this message
1370:
1040:
1694:Promotion and marketing communications
1653:
1461:Asia-Pacific Journal of Public Health
7:
1569:from the original on 31 October 2010
154:adding citations to reliable sources
902:In classrooms and conferences with
1502:State of the Union – Bing Politics
415:University of Wisconsin–Whitewater
407:University of Wisconsin–Eau Claire
25:
1615:Devaney, Laura (April 29, 2011),
767:(RF). A few companies also offer
615:Audience Response system software
556:on Who Wants to be a Millionaire?
403:University of Wisconsin–Milwaukee
45:This article has multiple issues.
1522:"Microsoft - Official Home Page"
852:2013 Australian Federal Election
130:
75:
34:
1637:, Pennsylvania, USA: Dorrance,
1631:; Elsberry, Richard B. (1988),
493:Challenges of Audience Response
411:University of Wisconsin–Oshkosh
377:Distributed, virtual, or hybrid
141:needs additional citations for
53:or discuss these issues on the
570:ROI measurement and assessment
1:
1553:Tremblay, Eric (April 2010).
1431:10.1080/02602938.2015.1024199
576:Hospital patient exit surveys
1511:, Retrieved on 27 April 2013
939:platform or as a plug-in to
573:Sales Effectiveness Training
566:Continuing medical education
1339:Simmons & Elsberry 1988
1324:Simmons & Elsberry 1988
1305:Simmons & Elsberry 1988
1290:Simmons & Elsberry 1988
1278:Simmons & Elsberry 1988
1266:Simmons & Elsberry 1988
1254:Simmons & Elsberry 1988
1242:Simmons & Elsberry 1988
1227:Simmons & Elsberry 1988
788:Use in educational settings
371:learning management systems
1710:
1660:: CS1 maint: postscript (
1588:"Audience response system"
1023:Toastmasters International
449:Learning management system
1028:Category:Speeches by type
930:-based response systems.
906:support or anywhere with
637:William W. (Bill) Simmons
581:Audience Response systems
562:Executive decision making
1540:businessspectator.com.au
1473:10.1177/1010539517700473
887:Smartphone / HTTP voting
696:displayed to the class.
18:Audience Response System
1507:April 29, 2013, at the
1389:EDUCAUSE Quarterly (EQ)
1383:Martyn, Margie (2007).
1018:Thematic interpretation
653:Palladium International
591:the participants via a
535:Control self-assessment
1068:"What is a Worm Poll?"
1048:Zilberstein, Shirley.
662:organizational culture
559:Conferences and events
90:for tone and structure
737:Vanderbilt University
677:U.S. patent 3,947,669
671:U.S. patent 3,766,541
629:Hollywood, California
529:Political news events
262:presentation software
1679:Audience measurement
813:Radio frequency (RF)
343:presentation program
288:Co-located audiences
150:improve this article
1629:Simmons, William W.
1395:(2). Archived from
1326:, pp. 190–191.
1307:, pp. 191–193.
1280:, pp. 188–193.
1256:, pp. 188–189.
1229:, pp. 138–187.
1147:2001AmJPh..69..970C
1074:. 30 November 2023.
689:command-and-control
526:Political campaigns
165:"Audience response"
27:Type of interaction
1357:2014-12-23 at the
958:Crowd manipulation
828:notebook computers
708:Mouse Mischief, a
532:Corporate training
94:You can assist by
1542:. 12 August 2013.
1155:10.1119/1.1374249
735:, a professor at
247:Audience Response
244:
243:
236:
226:
225:
218:
200:
124:
123:
116:
68:
16:(Redirected from
1701:
1689:Learning methods
1665:
1659:
1651:
1624:
1602:
1601:
1599:
1598:
1584:
1578:
1577:
1575:
1574:
1550:
1544:
1543:
1532:
1526:
1525:
1518:
1512:
1499:
1493:
1492:
1458:
1449:
1443:
1442:
1414:
1408:
1407:
1405:
1404:
1380:
1374:
1368:
1362:
1348:
1342:
1336:
1327:
1321:
1308:
1302:
1293:
1287:
1281:
1275:
1269:
1263:
1257:
1251:
1245:
1239:
1230:
1224:
1218:
1207:
1198:
1189:
1183:
1173:
1167:
1166:
1126:
1120:
1109:
1100:
1094:
1082:
1076:
1075:
1064:
1058:
1057:
1045:
1013:Speakers' bureau
988:List of speeches
679:
673:
554:Ask the audience
552:Game shows e.g.
549:Decision support
391:crowd psychology
239:
232:
221:
214:
210:
207:
201:
199:
158:
134:
126:
119:
112:
108:
105:
99:
79:
78:
71:
60:
38:
37:
30:
21:
1709:
1708:
1704:
1703:
1702:
1700:
1699:
1698:
1669:
1668:
1652:
1645:
1627:
1614:
1611:
1606:
1605:
1596:
1594:
1586:
1585:
1581:
1572:
1570:
1552:
1551:
1547:
1534:
1533:
1529:
1520:
1519:
1515:
1509:Wayback Machine
1500:
1496:
1456:
1451:
1450:
1446:
1416:
1415:
1411:
1402:
1400:
1382:
1381:
1377:
1369:
1365:
1359:Wayback Machine
1349:
1345:
1337:
1330:
1322:
1311:
1303:
1296:
1288:
1284:
1276:
1272:
1264:
1260:
1252:
1248:
1240:
1233:
1225:
1221:
1208:
1201:
1190:
1186:
1174:
1170:
1128:
1127:
1123:
1110:
1103:
1084:
1083:
1079:
1066:
1065:
1061:
1054:edition.cnn.com
1047:
1046:
1042:
1037:
1032:
953:
936:
889:
861:
824:
815:
794:active learning
790:
781:
765:radio frequency
757:
729:
675:
669:
649:futures studies
622:
583:
545:Market research
538:Delegate voting
520:
495:
387:
379:
351:tablet computer
339:multiple choice
303:multiple choice
298:video projector
290:
240:
229:
228:
227:
222:
211:
205:
202:
159:
157:
147:
135:
120:
109:
103:
100:
93:
80:
76:
39:
35:
28:
23:
22:
15:
12:
11:
5:
1707:
1705:
1697:
1696:
1691:
1686:
1681:
1671:
1670:
1667:
1666:
1644:978-0805931167
1643:
1625:
1610:
1607:
1604:
1603:
1579:
1565:(2): 217–227.
1545:
1527:
1513:
1494:
1467:(3): 229–240.
1444:
1425:(3): 482–497.
1409:
1375:
1363:
1343:
1341:, p. 193.
1328:
1309:
1294:
1292:, p. 190.
1282:
1270:
1268:, p. 187.
1258:
1246:
1244:, p. 188.
1231:
1219:
1199:
1184:
1168:
1121:
1101:
1077:
1059:
1039:
1038:
1036:
1033:
1031:
1030:
1025:
1020:
1015:
1010:
1005:
1000:
995:
990:
985:
980:
975:
970:
965:
960:
954:
952:
949:
935:
932:
888:
885:
860:
857:
823:
820:
814:
811:
789:
786:
780:
777:
756:
753:
728:
725:
684:disagreement.
621:
618:
617:
616:
613:
610:
582:
579:
578:
577:
574:
571:
568:
563:
560:
557:
550:
547:
542:
539:
536:
533:
530:
527:
519:
516:
515:
514:
511:
508:
505:
502:
494:
491:
490:
489:
480:
479:
478:
477:
470:
469:
465:
461:
452:
440:
436:
435:
434:
418:
386:
383:
378:
375:
289:
286:
274:remote control
260:hardware with
242:
241:
224:
223:
138:
136:
129:
122:
121:
83:
81:
74:
69:
43:
42:
40:
33:
26:
24:
14:
13:
10:
9:
6:
4:
3:
2:
1706:
1695:
1692:
1690:
1687:
1685:
1684:Polling terms
1682:
1680:
1677:
1676:
1674:
1663:
1657:
1650:
1646:
1640:
1636:
1635:
1630:
1626:
1622:
1618:
1613:
1612:
1608:
1593:
1592:youconnect.ir
1589:
1583:
1580:
1568:
1564:
1560:
1556:
1549:
1546:
1541:
1537:
1531:
1528:
1523:
1517:
1514:
1510:
1506:
1503:
1498:
1495:
1490:
1486:
1482:
1478:
1474:
1470:
1466:
1462:
1455:
1448:
1445:
1440:
1436:
1432:
1428:
1424:
1420:
1413:
1410:
1399:on 2009-10-28
1398:
1394:
1390:
1386:
1379:
1376:
1372:
1367:
1364:
1360:
1356:
1353:
1347:
1344:
1340:
1335:
1333:
1329:
1325:
1320:
1318:
1316:
1314:
1310:
1306:
1301:
1299:
1295:
1291:
1286:
1283:
1279:
1274:
1271:
1267:
1262:
1259:
1255:
1250:
1247:
1243:
1238:
1236:
1232:
1228:
1223:
1220:
1216:
1212:
1206:
1204:
1200:
1197:
1194:
1188:
1185:
1181:
1178:
1172:
1169:
1164:
1160:
1156:
1152:
1148:
1144:
1140:
1136:
1132:
1125:
1122:
1118:
1114:
1108:
1106:
1102:
1098:
1092:
1088:
1081:
1078:
1073:
1069:
1063:
1060:
1055:
1051:
1044:
1041:
1034:
1029:
1026:
1024:
1021:
1019:
1016:
1014:
1011:
1009:
1006:
1004:
1001:
999:
996:
994:
993:Public orator
991:
989:
986:
984:
981:
979:
976:
974:
971:
969:
966:
964:
961:
959:
956:
955:
950:
948:
946:
942:
933:
931:
929:
925:
919:
915:
913:
909:
905:
900:
898:
894:
893:HTTP protocol
886:
884:
881:
877:
873:
871:
866:
858:
856:
853:
848:
843:
841:
837:
833:
829:
821:
819:
812:
810:
806:
802:
800:
795:
787:
785:
778:
776:
774:
770:
766:
762:
754:
752:
750:
746:
742:
738:
734:
726:
724:
722:
718:
713:
711:
707:
703:
697:
693:
690:
685:
681:
678:
672:
665:
663:
658:
654:
650:
646:
642:
638:
633:
630:
625:
619:
614:
611:
608:
607:
606:
603:
601:
600:serial number
596:
594:
589:
580:
575:
572:
569:
567:
564:
561:
558:
555:
551:
548:
546:
543:
540:
537:
534:
531:
528:
525:
524:
523:
517:
512:
509:
506:
503:
500:
499:
498:
492:
487:
482:
481:
474:
473:
472:
471:
466:
462:
458:
453:
450:
446:
441:
437:
432:
428:
423:
422:
419:
416:
412:
408:
404:
400:
399:
398:
395:
392:
384:
382:
376:
374:
372:
368:
362:
360:
356:
352:
348:
344:
340:
336:
332:
327:
325:
321:
315:
312:
308:
304:
299:
295:
287:
285:
283:
277:
275:
271:
267:
263:
259:
254:
252:
248:
238:
235:
220:
217:
209:
198:
195:
191:
188:
184:
181:
177:
174:
170:
167: –
166:
162:
161:Find sources:
155:
151:
145:
144:
139:This article
137:
133:
128:
127:
118:
115:
107:
97:
91:
89:
84:This article
82:
73:
72:
67:
65:
58:
57:
52:
51:
46:
41:
32:
31:
19:
1648:
1633:
1620:
1609:Bibliography
1595:. Retrieved
1591:
1582:
1571:. Retrieved
1562:
1558:
1548:
1539:
1530:
1516:
1497:
1464:
1460:
1447:
1422:
1418:
1412:
1401:. Retrieved
1397:the original
1392:
1388:
1378:
1371:Devaney 2011
1366:
1346:
1285:
1273:
1261:
1249:
1222:
1210:
1192:
1187:
1177:Am. J. Phys.
1176:
1171:
1138:
1134:
1124:
1112:
1090:
1086:
1080:
1072:wisegeek.com
1071:
1062:
1053:
1043:
1008:Speechwriter
983:Glossophobia
937:
920:
916:
901:
890:
882:
878:
874:
870:SMS gateways
862:
844:
825:
816:
807:
803:
791:
782:
758:
748:
740:
739:, published
730:
714:
698:
694:
686:
682:
666:
657:Likert scale
634:
626:
623:
604:
597:
584:
521:
518:Applications
496:
430:
426:
396:
388:
380:
363:
328:
316:
291:
278:
255:
246:
245:
230:
212:
206:January 2024
203:
193:
186:
179:
172:
160:
148:Please help
143:verification
140:
110:
104:January 2024
101:
88:copy editing
86:may require
85:
61:
54:
48:
47:Please help
44:
1135:Am. J. Phys
963:Declamation
912:mobile apps
897:SMS hubbing
859:Cell phones
832:smartphones
745:David Campt
743:. In 2015,
733:Derek Bruff
721:web browser
706:Microsoft's
702:peripherals
347:web browser
282:word clouds
1673:Categories
1597:2015-10-30
1573:2010-11-05
1403:2009-10-30
1141:(9): 970.
1093:(10): 4–6.
1035:References
998:Persuasion
941:PowerPoint
847:Bing Pulse
710:PowerPoint
359:moderation
355:smartphone
266:television
176:newspapers
96:editing it
50:improve it
1439:144164927
973:Eloquence
928:Bluetooth
799:histogram
763:(IR) and
719:in their
593:bar graph
457:bar chart
56:talk page
1656:citation
1567:Archived
1505:Archived
1489:24488124
1481:28434251
1355:Archived
1003:Rhetoric
951:See also
934:Software
822:Internet
779:Infrared
773:internet
761:infrared
755:Hardware
645:futurist
486:database
445:database
385:Benefits
331:computer
324:analysis
320:database
307:wireless
294:computer
270:internet
258:wireless
251:audience
1163:1893994
1143:Bibcode
945:Keynote
727:Experts
620:History
268:or the
190:scholar
1641:
1487:
1479:
1437:
1161:
978:Eulogy
968:Debate
413:, and
296:and a
192:
185:
178:
171:
163:
1485:S2CID
1457:(PDF)
1435:S2CID
1159:S2CID
904:Wi-Fi
840:Wi-Fi
639:, an
369:into
335:polls
197:JSTOR
183:books
1662:link
1639:ISBN
1477:PMID
1091:2007
924:GPRS
908:GPRS
836:PDAs
834:and
717:SaaS
311:data
169:news
1469:doi
1427:doi
1151:doi
943:or
865:SMS
769:Web
641:IBM
588:USB
367:API
353:or
152:by
1675::
1658:}}
1654:{{
1647:.
1619:,
1590:.
1563:29
1561:.
1557:.
1538:.
1483:.
1475:.
1465:29
1463:.
1459:.
1433:.
1423:41
1421:.
1393:30
1391:.
1387:.
1331:^
1312:^
1297:^
1234:^
1202:^
1157:.
1149:.
1139:69
1137:.
1133:.
1104:^
1089:.
1070:.
1052:.
947:.
899:.
830:,
409:,
405:,
373:.
326:.
253:.
59:.
1664:)
1623:.
1600:.
1576:.
1524:.
1491:.
1471::
1441:.
1429::
1406:.
1373:.
1361:"
1217:.
1182:.
1165:.
1153::
1145::
1119:.
1099:.
1056:.
431:N
427:N
237:)
231:(
219:)
213:(
208:)
204:(
194:·
187:·
180:·
173:·
146:.
117:)
111:(
106:)
102:(
98:.
92:.
66:)
62:(
20:)
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.