Web Survey Bibliography
Title Analysing and visualising logfiles: the Individualised SiteMap tool ISM
Author Kralisch, A., Berendt, B.
Year 2005
Access date 21.04.2005
Abstract User behaviour in interactive software environments can be analysed conveniently with the help of logfile data that are recorded non-reactively and non-obtrusively. Various tools exist that provide powerful statistical analyses of these data, aiding in a wide range of usability studies and online experiments. However, statistics are often insufficient for understanding the data. Exploratory analyses and hypothesis generation are best supported by visualizations that capture essential features of content and structure of data and behaviour, and that allow the analyst to make abstractions that are useful for the domain and question at hand. The Individualised SiteMap tool (http://vasarely.wiwi.hu-berlin.de/ISM) is suited for all domains in which user behaviour can be modelled as a graph –{:} a prominent example is navigation in Web sites. ISM shows the names of Web pages (or other information units) that a user has visited and the order of visits, providing for a content analysis of user paths. To provide for a complementary structural analysis, ISM uses a specialized layout algorithm that transforms typical features of these paths into prominent visual patterns, e.g., linear vs. nonlinear and hub-and-spoke navigation, and the emergence of landmarks. Colour is employed to emphasize structuring by content, user features, or task features. An ISM thus depicts a user’{:}s individual view of the site, as expressed by her/his exploration behaviour. Structural abstraction is offered by graph abstractions that translate into visualizations of selected behavioural aspects. Content abstraction is provided by support for aggregating logfiles using concept hierarchies. The advantages of the approach are demonstrated using data from a field study that investigated the impact of culture, language, and domain knowledge on navigation in an international E-Health portal, and from a laboratory study that investigated the impact of cognitive styles and abilities on information search in an education portal. The combination of ISM with data mining analyses is discussed. The Individualised SiteMap tool is a development based on STRATDYN first presented in Berendt & Brenstein (Beh. Res. Meth., Instr., & Comp. 2001){:} it supports more analysis options and interactivity, it is platform-independent, and it can be used freely for academic purposes.
Abstract - optional Das Nutzerverhalten in interaktiven Software-Umgebungen kann mit Hilfe von Logfile-Daten, die nicht-reaktiv und ohne Nutzungsbeeinträchtigung aufgezeichnet werden, bequem analysiert werden. Verschiedene Werkzeuge bieten mächtige statistische Analysemöglichkeiten für diese Daten und bilden somit einen wesentliche Hilfe für Usability-Studien und Online-Experimente. Jedoch genügen Statistiken oft nicht, um die Daten zu verstehen. Explorative Analysen und Hypothesengenerierung werden am besten von Visualisierungen unterstützt, die inhaltliche und strukturelle Kerneigenschaften von Daten und Verhalten einfangen, und die dem Untersuchenden Abstraktionen erlauben, die für die Domäne und Fragestellung nützlich sind. Das Individualised SiteMap-Werkzeug (http://vasarely.wiwi.hu-berlin.de/ISM) eignet sich für alle Domänen, in denen Nutzerverhalten als Graph modelliert werden kann –{:} ein prominentes Beispiel ist die Navigation in Websites. ISM zeigt die Namen der Webseiten (oder anderer Informationseinheiten), die ein Nutzer besucht hat, und die Reihenfolge dieser Besuche und erlaubt somit eine Inhaltsanalyse der Nutzerpfade. Eine hierzu komplementäre Strukturanalyse wird durch einen spezialisierten Layout-Algorithmus unterstützt, der typische Charakteristika dieser Pfade in spezifische visuelle Muster übersetzt, wie z.B. lineare vs. nichtlineare Navigation, hub-and-spoke-Navigation, und die Entstehung von Landmarken. Farbe zeigt die Strukturierung nach Inhalt, Nutzer- oder Aufgabeneigenschaften. Eine ISM zeigt somit die individuelle Sicht eines Nutzers auf die Site, wie sie sich in seinem Explorationsverhalten ausdrückt. Strukturelle Abstraktion wird durch Graph-Abstraktionen unterstützt, die sich in Visualisierungen ausgewählter Verhaltensaspekte umsetzen. Inhaltsabstraktion wird durch die Aggregation von Logfiles mittels Konzepthierarchien unterstützt. Die Vorteile des Ansatzes werden anhand von zwei Untersuchungen demonstriert: einer Feldstudie zum Einfluss von Kultur, Sprache und medizinischem Wissen auf die Navigation in einem internationalen E-Health-Portal, und einer Laborstudie zum Einfluss kognitiver Stile und Fähigkeiten auf die Informationssuche in einem Bildungsportal. Mögliche Verbindungen von ISM mit Data-Mining-Analysen werden beschrieben. Das Individualised SiteMap-Werkzeug ist eine Weiterentwicklung von STRATDYN, welches in Berendt & Brenstein (Beh. Res. Meth., Instr., & Comp. 2001) vorgestellt wurde{:} es unterstützt eine breitere Palette von Analyse- und Interaktivitätsoptionen, ist plattform-unabhängig und steht für Forschungszwecke frei zur Verfügung.
Access/Direct link Homepage - conference (abstract)
Year of publication2005
Bibliographic typeConferences, workshops, tutorials, presentations
Web Survey Bibliography - Online measurement (799)
- E-Census 2011 Portugal: implementation and results of the Pilot Survey; 2011; Vicente, P., Rosa, A., Reis, E.
- Sampling v. Scale: An investigation the tension between convenience sampling, response rates, probability...; 2011; Garland, P.
- Using Amazon's Mechanical Turk for the recruitment of participants in Internet-based research; 2011; Reips, U. -D., Buffardi, L., Kuhlmann, T.
- Should we use the progress bar in online surveys? A meta-analysis of experiments manipulating progress...; 2011; Callegaro, M., Yang, Y., Villar, A.
- In the market for an online panel? What clients need to know; 2011; Hartmann, S.
- How Procter & Gamble worked to develop online data quality guidelines; 2011; Gloeckler, D.
- Web/Cloud Based CATI Using queXS; 2011; Zammit, A.
- Developing Paradata Tools to Maximize Call Center Conversion Rates; 2011; Heinrich, T., Pittman, J., Abu, K.
- e-Collection at Statistics Canada; 2011; Faid, M.
- Developing and Implementing Adaptive Total Design (ATD); 2011; Carley-Baxter, L. R., Mitchell, S., Peytchev, A., Day, O.
- Partnership-Driven Resources to Improve and Enhance Research (PRIMER): A Survey of Community-Engaged...; 2011; Dolor, R. J., Greene, S. M., Thompson, E., Baldwin, L.-M., Neale, A. V.
- Examination of a ’Web Mode Effect’. An Experimental Comparison of Web and Paper Based Surveys...; 2011; Shamshiri-Petersen, D., Clement, S. L.
- The Changing Face of Trust in Health Websites; 2011; Sillence, L., Mo, P., Briggs, P., Harris, P. R.
- Internet & Learning: A Decade of Transformation in Learning Practices; 2011; Haythornthwaite, C., Andrews, R., Jones, C., de Castell, S., Goodfellow, R., Jewitt, C., Barton, D.
- Quantifying Open-Ended Responses: Results from an Online Advertising Tracking Survey; 2011; Jacobe, A., Brewer, L., Vakalia, F., Turner, S., Marsh, S. M.
- Statistical methods for reducing bias in web surveys; 2011; Lee, M. H.
- Agree-Disagree Response Format versus Importance Judgment; 2011; Krebs, D.
- Errors within web-based surveys: a comparison between two different tools for the analysis of tourist...; 2011; Polizzi, G., Oliveri, A. M.
- Benefits of Structured DDI Metadata across the Data Lifecycle: The STARDAT Project at the GESIS Data...; 2011; Linne, M., Brislinger, E., Zenk-Moeltgen, W.
- Microdata Information System MISSY; 2011; Bohr, J.,
- The Use of Structured Survey Instrument Metadata throughout the Data Lifecycle; 2011; Hansen, S. E.
- DDI and the Lifecycle of Longitudinal Surveys; 2011; Hoyle, L., Wackerow, J.
- Dissemination of survey (meta)data in the LISS data archive; 2011; Streefkerk, M., Elshout, S.
- Does the direction of Likert-type scales influence response behavior in web surveys?; 2011; Keusch, F.
- Cross-country Comparisons: Effects of Scale Type and Response Style Differences; 2011; Thomas, R. K.
- Explaining more variance with visual analogue scales: A Web experiment; 2011; Funke, F.
- Cognitive process in answering questions: Are verbal labels in rating scales attended to?; 2011; Menold, N., Kaczmirek, L., Lenzner, T.
- Cognitive interviewing in web surveys: the use of probing questions in cross-national web surveys; 2011; Behr, D., Braun, M., Kaczmirek, L., Bandilla, W.
- The impact of monetary incentives on completion and data quality in online surveys; 2011; van Veen, F., Goeritz, A., Sattler, S.
- The role of visual and aural stimuli in producing mode effects on answers to survey questions; 2011; Lynn, P., Hope, S., Campanelli, P., Nandi, A., Nicolaas, G., Jaeckle, A.
- Causes of Mode Effects on Survey Measurement ; 2011; Lynn, P., Campanelli, P., Nicolaas, G., Hope, S., Nandi, A., Jaeckle, A.
- Exploring use of information in paradata through calibration method to detect and adjust non-response...; 2011; Billiet, J. Matsuo, H.
- Assessment of propensity score methods on nonresponse bias adjustment; 2011; Alanya, A., Billiet, J., Matsuo, H.
- Ethical Dilemmas in Dealing with Web Paradata; 2011; Couper, M. P., Singer, E.
- A Web Survey Program Based on Computer Technology and Its Application to Evaluation Model about Youth...; 2011; Song, M., Song, Y-G., Yang, T.
- Conceptualizing the value of Web content in marketing research; 2011; Chang, J.
- Image effects on online survey respondents; 2011; Marinica, B.
- Measuring User Satisfaction in the Lab: Questionnaire Mode, Physical Location, and Social Presence Concerns...; 2011; Jans, M., Romano, J. C., Ashenfelter, K. T., Krosnick, J. A.
- Race-of-Virtual-Interviewer Effects; 2011; Conrad, F. G., Schober, M. F., Nielsen, D.
- Analyzing Paradata as a Form of Post-hoc "Remote" Usability Testing: Initial Results From...; 2011; Ashenfelter, K. T., Jans, M.
- Sensitive Questions in Online Surveys: Experimental Results for the Randomized Response Technique (RRT...; 2011; Coutts, E., Jann, B.
- Comparing the Accuracy of RDD Telephone Surveys and Internet Surveys Conducted with Probability and...; 2011; Yeager, D. S., Krosnick, J. A., Chang, L. C., Javitz, H. S., Levindusky, M. S., Simpser, A.; Wang, R...
- What it takes to be a top 100 website; 2010
- There is an app for that! A review of smartphone apps for marketing research; 2010; Michelson, M.
- The weirdest people in the world?; 2010; Heine, S. J., Henrich, J., Norenzayan, A.
- Surveying cultures: Discovering shared conceptions and sentiments; 2010; Heise, D. R.
- Research synthesis. AAPOR report on online panels; 2010; Brick, J. M. et al.
- Real ID. State of The Art Representative and Repeatable Online Samples. Behaviorally Profiled Respondents...; 2010; Gittelman, S. H., Trimarchi, E.
- Paradata: a new data source from web-administered measures; 2010; Sowan, A. K., Jenkins, L. S.
- Overview of data collection methodology; 2010