Contact

Joost Broekens
Delft University of Technology
Mekelweg 4
2628 CD Delft
The Netherlands
Office 12.050, Electrotechniek, Wiskunde en Informatie Building
Phone +31 (0)6-24657367
Email
Scholar profile
Group homepage Interactive Intelligence
Last edited: 26-sept-2016.

Media

Jul 2016. Podcast podcast-opname in de serie 'Leven met robots'.
Okt 2013. Volkskrant, National Newspaper EVA als een van de successvolste crowdfunding voor wetenschap projecten genoemdLink.
Jan 2013. BNR digitaal, National radio Live interview BNR digitaal over EVA de thuiszorgrobot en crowdfunding Link.
Nov 2012: ZappLive, National TV Performance of TU Delft robots Link.
Aug 2012: Interview Quest Magazine, about emotions in Robots. Link.
Jan 2012. BNR, National radio Interview Joost Broekens op BNR radio over EVA de thuiszorgrobot Link.
Jan 2012. Volkskrant, National newspaper, Wetenschap Zorgrobot eva haalt de drankjes Link.
Jan 2012. Powned, National TV, Pownews Interview Studenten EVA Pownews Link.
Jan 2012. Omroep MAX, National TV, KoffieMax Interview met Joost Broekens en Bram van der VeenLink.
Jan 2012. Delta, Tu newspaper Interview voor TU Delta Link.
Dec 2011. VPRO, National TV, Labyrint De ontknoping van het Groot Nationaal Onderzoek Link.
Dec 2011. http://www.psycholoog.net, National Web Emotieherkenning onderzocht Link.
Dec 2011. Wetenschap24, National Web. De ontknoping van het Groot Nationaal Onderzoek Link.
Nov 2011. NWO, National Science Foundation, Article. Eindelijk ook Vrouwen Link.
Okt 2011. Wetenschap24, National Web. Wat heeft het Groot Nationaal Onderzoek van jou geleerd? Link.
April 2011. VPRO, National Web. VPRO en NTR lanceren unieke vorm van wetenschappelijk onderzoek Link.
April 2011. Wetenschap24, National Web, Interview. De psychologie van de proefpersoon Link.
April 2011. Wetenschap24, National Web, Groot Nationaal Onderzoek. De Wetenschappers Link.
Jan 2011. Wetenschap24, National Web: Doe de test: gezichtsuitdrukkingen herkennen: Link.
Jan 2011. Labyrint, National TV, Labyrint Joost Broekens in VPRO TV documentary on emotion and machines: Link.
2007. Trotsboekje, Leiden Science Faculty, Interview GESIMULEERDE MUIZEN PROBLEMEN LATEN OPLOSSEN Link.
2007. Mare, Leiden University Journal, Interview Blije robots Link.

Bio

Joost Broekens received a MSc degree in Computer Science at the University of Delft, The Netherlands, in 2001. In 2007 he received his PhD in computer science at the University of Leiden, The Netherlands, in the area of computational modeling of emotion in relation to learning processes. He has published in the area of computational models of emotion (ranging from theoretical approaches to more applied ones), developed master-level courses and course material on the topic, and has given several invited lectures as well as less formal talks for the larger public related to Affective Computing. His most recent interests include reinforcement learning, affective computing, human-robot and human-computer interaction, and gaming research.

If you are interested in this research, please contact Joost Broekens (email above).
If you want to do a student project (Bachelor or Master) and want to know more, do not hesitate to mail or give a call.

Contact information / Top

Interactive Robotics

Joost Broekens is CTO and co-founder of Interactive Robotics, a company that develops human-robot interaction technology focussing on robot audience interaction, for example at schools and business events. For more info, please consult the website.

Research Interests

Computational models of emotion.
Cognitive modelling
Gaming research and affective gaming
Human Computer/Robot Interaction
Emotion in adaptive behaviour
Reinforcement Learning

Contact information / Top

Teaching and Lectures

Course: Affective Computing, TU Delft 2010, 2011, 2012, 2013, 2014, 2015
Course Computational Intelligence, TU Delft, 2012, 2013, 2014, 2015
Various lectures on Serious Gaming, Affective Computing, Reinforcement Learning, and Robotics.

Contact information / Top

Publications (refereed)

2016
Fear and Hope Emerge from Anticipation in Model-Based Reinforcement Learning.
Moerland, T., Broekens, J., & Jonker, C. M. (2016). Proc. of IJCAI-16 (pp. 848-854): AAAI Press.
The Effect of Gravity on Perceived Affective Quality of Robot Movement.
Weller, S., Broekens, J., & Lopes, G. A. D. (2016). In Dance Notations and Robot Motion (pp. 377-390). Springer International Publishing.

2015
Mood contagion of robot body language in human robot interaction.
Xu, J., Broekens, J., Hindriks, K., & Neerincx, M. A. (2015). Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS), 29(6), 1216-1248
A reinforcement learning model of joy, distress, hope and fear.
Broekens, J., Jacobs, E., & Jonker, C. M (2015). Connection Science, 27(3), 215-233
The Affective Storyteller: Using Character Emotion to Influence Narrative Generation
Kaptein, F., Broekens, J. (2015). Intelligent Virtual Agents (IVA2015), Springer LNCS 9234, 331-334
Emotion Engines for Games in Practice: Two Case Studies using Gamygdala
Broekens, J. (2015). Affective Computing and Intelligent Interaction (ACII2015), 791-792
The Influence of Subliminal Visual Primes on Player Affect in a Horror Computer Game
Marcello A. Gomez Maureira, Lisa E. Rombout, Livia Teernstra, Imara C. T. M. Speek and Joost Broekens (2015). Affective Computing and Intelligent Interaction (ACII2015), pp 705-711
Effects of a Robotic Storyteller's Moody Gestures on Storytelling Perception
Junchao Xu, Joost Broekens, Koen Hindriks and Mark Neerincx (2015). Affective Computing and Intelligent Interaction (ACII2015), pp 449-455
Growing emotions: Using affect to help children understand a plant's needs
Daan Oldenhof, Jules W. Verdijk, Daan E. Krijnen and Joost Broekens (2015). Affective Computing and Intelligent Interaction (ACII2015), 160-165

2014
GAMYGDALA: an Emotion Engine for Games
Alexandru Popescu, Joost Broekens, and Maarten van Someren (2014). IEEE Transactions on Affective Computing, 5(1), 32-44
The Effect of Dominance Manipulation on the Perception and Believability of an Emotional Expression
WFJ van der Ham, J Broekens, PHMP Roelofsma (2014). Emotion Modeling, Springer, 101-114
COMPUTATIONAL APPROACHES FOR CONFLICT RESOLUTION IN DECISION MAKING: NEW ADVANCES AND DEVELOPMENTS
Reyhan Aydogan, Victor Sanche, Vicente Julian, Joost Broekens & Catholijn Jonker (2014). Cybernetics and Systems, 43(3), 217-221
Robot mood is contagious: effects of robot body language in the imitation game
Xu, J., Broekens, J., Hindriks, K., & Neerincx, M. A. (2014). Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems: International Foundation for Autonomous Agents and Multiagent Systems, 973-980.
Virtual Reflexes
Jonker, C., Broekens, J., & Plaat, A. (2014). Intelligent Virtual Agents 2014, Springer LNCS 8637, 222-231.
Joy, Distress, Hope and Fear in Reinforcement Learning
Jacobs, E., Broekens, J., & Jonker, C. (2014). Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems, 1615-1616.
Emergent Dynamics of Joy, Distress, Hope and Fear in Reinforcement Learning Agents
Jacobs, E., Broekens, J., & Jonker, C. (2014). Adaptive Learning Agents workshop at AAMAS2014.
Optimistic Risk Perception in the Temporal Difference error Explains the Relation between Risk-taking, Gambling, Sensation-seeking and Low Fear.
Broekens, J., & Baarslag, T. (2014). arXiv preprint arXiv:1404.2078.
The AffectButton: a Digital Self-report Tool for Emotion
Broekens, J. (2014). Proceedings of ChiSparks 2014 (pp. 158-159).

2013
Challenges in Computational Modeling of Affective Processes
Broekens, J., Bosse, T., & Marsella, S. C. (2013). IEEE Transactions on Affective Computing, 4(3), 242-245.
Mood Expression through Parameterized Functional Behavior of Robots
Xu, J., Broekens, J., Hindriks, K., & Neerincx, M. A. (2013). ROMAN 2013 (Best integration of technical and user research award).
The Relative Importance and Interrelations between Behavior Parameters for Robots' Mood Expression
Xu, J., Broekens, J., Hindriks, K., & Neerincx, M. A. (2013). ACII 2013. Geneva.
Bodily Mood Expression: Recognize Moods from Functional Behaviors of Humanoid Robots
Xu, J., Broekens, J., Hindriks, K., & Neerincx, M. A. (2013). ICSR 2013.
Abstract Expressions of Affect
de Rooij, A., Broekens, J., & Lamers, M. H. (2013). International Journal of Synthetic Emotions (IJSE), 4(1), 1-31.
AffectButton: a method for reliable and valid affective self-report
Broekens, J., & Brinkman, W.-P. (2013). International Journal of Human-Computer Studies, 71(6), 641-667.

2012
Goal-Based Explainable Security Certificate Requests
Maaike Harbers, Joost Broekens, Thomas Quillinan, M. Birna van Riemsdijk, Niek Wijngaards (2012). Proceedings of the 8th International Conference on Geo-information for Disaster Management, 3-10.
Negotiating Agents
Catholijn M. Jonker, Koen V. Hindriks, Pascal Wiggers, Joost Broekens (2012). AI Magazine, 33 (3), 79-91.
Dynamic Facial Expression of Emotion Made Easy
Joost Broekens, Chao Qu, Willem-Paul Brinkman (2012). Technical report. Interactive Intelligence, Delft University of Technology.
In Defense of Dominance: PAD Usage in Computational Representations of Affect
Joost Broekens (2012). International Journal on Synthetic Emotions (IJSE) 3(1), 33-42.Link
Designing Interfaces for Explicit Preference Elicitation: a user-centered investigation of preference representation and elicitation process
Alina Pommeranz, Joost Broekens, Pascal Wiggers, Willem-Paul Brinkman, Catholijn Jonker (2012). User Modeling and User-adapted Interaction (UMUAI) 22 (3-4), 357-379. Link
Virtual Reality Negotiation Training Increases Negotiation Knowledge and Skill
Joost Broekens, Maaike Harbers, Willem-Paul Brinkman, Karel van den Bosch, Catholijn M. Jonker, John-Jules Meyer (2012). Intelligent Virtual Agents (IVA 2012), 218-230 Link
Modeling emotional contagion based on experimental evidence for moderating factors. Rene Coenen and Joost Broekens. (2012). AAMAS Workshop on Emotional and Empathic Agents (EAS), 26-31.Link
Robot Learning from Feedback
Joost Broekens (2012). Encyclopedia of the Sciences of Learning. Springer. Link

2011
Comparing Formal Cognitive Emotion Theories
Koen Hindriks and Joost Broekens (2011). Workshop Proceedings on Standards in Emotion Modelling 2011 (SEM2011). Link
The Effect of Dominance Manipulation on the Perception and Believability of an Emotional Expression
Wim van der Ham and Joost Broekens (2011). Workshop Proceedings on Standards in Emotion Modelling 2011 (SEM2011). Link
Validity of a Virtual Negotiation Training
Joost Broekens, Maaike Harbers, Willem-Paul Brinkman, Catholijn Jonker, Karel van den Bosch and John-Jules Meyer (2011). IVA 2011, Springer LNCS 6895, 435-436. Link
Computational Affective Science
Joost Broekens (2011). International Journal of Synthetic Emotions, 2(2), 73-75. link
Empathic virtual buddy: setting up informed empathic responses.
JM van der Zwaan, Virgina Dignum, Joost Broekens, CM Jonker (2011). In: Proceedings of the 15th Portuguese Conference on Artificial Intelligence (EPIA 2011), 1 - 15.

2010
Assistive Social Robots for Elderly Care
Joost Broekens, Koen Hindriks and Martijn Wisse (2010). Cybertherapy and Rehabilitation, 13(3), p34
Real Time Labeling of Affect in Music Using the AffectButton
Joost Broekens, Anne Pronker, Marian Neuteboom (2010). 3rd International Workshop on Affective Interaction in Natural Environments (AFFINE'10) at ACM Multimedia 2010.
Factors Influencing User Motivation for Giving Online Preference Feedback
Joost Broekens, Alina Pommeranz, Pascal Wiggers and Catholijn M. Jonker (2010). MPREF workshop at ECAI 2010.
Do you get it? User-evaluated explainable BDI agents
Joost Broekens, Maaike Harbers, Koen Hindriks, Karel van den Bosch, Catholijn Jonker and John-Jules Meyer (2010). MATES 2010.
Reinforcement Learning as Heuristic for Action-Rule Preferences
Joost Broekens, Koen Hindriks, Pascal Wiggers (2010). PROMAS Workshop at AAMAS 2010, pp. 85-100.
Affective Negotiation Support Systems
Joost Broekens, Catholijn Jonker, John-Jules Meyer (2010). Journal of Ambient Intelligence and Smart Environments, 2(2), 121-144.
Robots that Care
Rosemarijn Looije, Jeroen Arendsen, Jelle Saldien, Bram Vanderborght, Joost Broekens and Mark Neerincx (2010). Proceedings of the 28th Annual European Conference on Cognitive Ergonomics, ACM, 301-302.
Modeling the Experience of Emotion
Joost Broekens (2010). International Journal of Synthetic Emotions, 1(1), 1-17.
Virtual Team Performance Depends on Distributed Leadership
Nico van Dijk and Joost Broekens (2010). ICEC 2010.
DUO meta-model for knowledge elicitation and bidding support in NSS
Alina Pommeranz, Wietske Visser, Joost Broekens, Pascal Wiggers, Koen Hindriks, and Catholijn M. Jonker (2010). HuCom 2010.
Guidelines for Developing Explainable Cognitive Models
Maaike Harbers, Joost Broekens, Karel van den Bosch and John-Jules Meyer (2010). ICCM 2010.

2009
Eye Movements Disclose Decisions in Set
Joost Broekens, Walter Kosters and Timo de Vries (2009). BNAIC 2009.
Assistive social robots in elderly care: a review
Joost Broekens, Marcel Heerink and Henk Rosendal (2009). Gerontechnology, 8(2), 94-103. See also here for pre-print version
Design Guidelines for Negotiation Support Systems: An Expert Perspective Using Scenarios
Alina Pommeranz , Willem-Paul Brinkman, Pascal Wiggers, Joost Broekens, Catholijn M. Jonker (2009). ECCE 2009.
Foundations for Modelling Emotions in Game Characters: Modelling Emotion Effects on Cognition
Eva Hudlicka, Joost Broekens (2009). Affective Computing and Intelligent Interaction (ACII) 2009.
Getting a Grip on Emotions in Negotiations: the Possibilities of ICT
Willem-Paul Brinkman, Joost Broekens,Catholijn M. Jonker, John-Jules Ch. Meyer (2009). IAT Conference, HAI Workshop 2009.
AffectButton: Towards a Standard for Dynamic Affective User Feedback
Joost Broekens, Willem-Paul Brinkman (2009). Affective Computing and Intelligent Interaction (ACII) 2009.
Trust in Online Technology: Towards Practical Guidelines Based on Experimentally Verified Theory
Christian Detweiler, Joost Broekens (2009). HCI International 2009.
Interactive TV Together: An Open Service Infrastructure for Enhancing Interactive TV Experiences
C. Hesselman, J. Broekens, M. Guelbahar, F. Winkler, D. Goergen, F. de Jong, J. Vester, W. Derks, R. de Groote, A. Tokmakoff, D. Abbadessa, J. da Silva, D.-J. van Dijk, X. Zhou, R. Poortinga, S. Smit, H. ter Doest, M. Snijders, and R. van Laar. (2009) Chapter in Social Interactive Television: Immersive Shared Experiences and Perspectives.

2008
Multi-angle view on preference elicitation for negotiation support systems
Pommeranz, A., Broekens, J., Visser, W., Brinkman, W.-P., Wiggers, P., and Jonker, C.M. (2008). Proceedings of first international working conference on human factors and computational models in negotiation (HuCom08), ISBN 978-90-813811-1-6, pp. 19-26.
An Open Service Infrastructure for Enriching Networked Interactive Multimedia Experiences in a Converged World
S. Smit, J. Broekens, M. Guelbahar, K. Shepherd, A. Visser, J. Vester, A. Tokmakoff, O. Friedrich, A. Domene, F. Winkler, M. Martin, J. Zoric, F.-X. Kowalski, D. Goergen, R. de Groote, R. Poortinga - van Wijnen, C. Hesselman. (2008). NEM Summit 2008, Saint-Malo, France.
Want a Recommendation? Ask my Digital Personality!
Joost Broekens (2008). Workshop on Interactive Television Commerce and Advertising, co-located with the European Interactive TV Conference (EuroITV2008), Salzburg, Austria, July 2008.
An Open Service Infrastructure for Enhancing Interactive TV Experiences EuroITV 2008 Workshop on Sharing Content and Experiences with Social iTV.
Cristian Hesselman, Wijnand Derks, Joost Broekens, Henk Eertink, Mark Gülbahar, Remco Poortinga (2008). Workshop on Sharing Content and Experiences with Social Interactive Television, co-located with the European Interactive TV Conference (EuroITV2008), Salzburg, Austria, July 2008
Physical Emotion Induction and Its Use in Entertainment: Lessons Learned.
Ralph Kok, Joost Broekens (2008). 1st IFIP Entertainment Computing Symposium. Springer
Formal Models of Appraisal: Theory, Specification, and Computational Model
Joost Broekens, Doug DeGroot and Walter A. Kosters (2008). Cognitive Systems Research, 9(3), 173-197.

2007
Affect and Learning: A Computational Analysis
Joost Broekens (2007). PhD Thesis, Leiden University.
Affect, Anticipation and Adaptation: Affect-Controlled Selection of Anticipatory Simulation in Artificial Adaptive Agents
Joost Broekens, Walter A. Kosters and Fons J. Verbeek (2007). Adaptive Behavior, 15(4), 397-422
Strategies for Affect-Controlled Action-Selection in Soar-RL
Eric Hogewoning, Joost Broekens, Jeroen Eggermont and Ernst G.P. Bovenkamp. Proceedings of the 2nd. International Work-Conference on the Interplay between Natural and Artificial Computation (IWINAC 2007, Murcia, Spain), LNCS 4528 (pp. 501-510), Springer
On Affect and Self-Adaptation: Potential Benefits of Valence-Controlled Action-Selection
Joost Broekens, Walter A. Kosters and Fons J. Verbeek. Proceedings of the 2nd. International Work-Conference on the Interplay between Natural and Artificial Computation (IWINAC 2007, Murcia, Spain), LNCS 4527 (pp. 357-366), Springer
Emotion and Reinforcement: Affective Facial Expressions Facilitate Robot Learning
Joost Broekens (2007). LNAI Spec. Vol. on AI for Human Computing, LNAI 4451 (pp. 113-132), Springer.
Emotion and Reinforcement: Affective Facial Expressions Facilitate Robot Learning
Joost Broekens and Pascal Haazebroek (2007). Proceedings of the IJCAI Workshop on AI for Human Computing (AI4HC'07, Hyderabad, India) (pp.47-54).

2006
OBJECT-CENTERED INTERACTIVE MULTI-DIMENSIONAL SCALING: ASK THE EXPERT
Joost Broekens, Tim Cocx and Walter A. Kosters (2006). Proceedings of the 18th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2006, Namur, Belgium) (pp. 59-66), ISSN 1568-7805.
Formalizing Cognitive Appraisal: From Theory to Computation
Joost Broekens and Doug DeGroot (2006). Proceedings of the 18th European Meeting on Cybernetics and Systems Research (EMCSR 2006, Vienna, Austria) (pp. 595-600), ASCS: Vienna.

2005
Simulation, Emotion and Information Processing: Computational Investigations of the Regulative Role of Pleasure in Adaptive Behavior
Joost Broekens and Fons J. Verbeek (2005). Proceedings of the IJCAI Workshop on Modeling Natural Action Selection (Edinburgh, UK) (pp. 166-173), AISB Press, ISBN 1-902956-40-9
Internal Simulation of Behavior has an Adaptive Advantage
Joost Broekens (2005). Proceedings of the Conginitive Science Conference (CogSci'05, Stresa, Italy) (pp. 342-347). Mahwah, NJ: Lawrence Erlbaum Associates. ISBN 0-9768318-1-3

2004
Scalable and Flexible Appraisal Models for Virtual Agents (Nominated for best paper award.)
Joost Broekens & Doug DeGroot (2004). 5th Game-On International Conference: Computer Games: Artificial Intelligence, Design and Education (CGAIDE 2004, Reading, UK) (pp. 208-215), ISBN 0-9549016-0-6.
Emergent Representations and Reasoning in Adaptive Agents
Joost Broekens and Doug DeGroot (2004). Third International Conference on Machine Learning and Applications (ICMLA 2004, Louisville KY, USA) (pp. 207-214), IEEE press, ISBN 0-7803-8823-2.
Emotional Agents need Formal Models of Emotion
Joost Broekens and Doug DeGroot (2004). Proceedings of the 16th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2004, Groningen, The Netherlands) (pp. 195-202), ISSN 1568-7805.
Consistent Dynamic-Group Emotions for Virtual Agents
Joost Broekens, Niels Netten & Doug DeGroot (2004). Proceedings of the 16th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2004, Groningen, The Netherlands) (pp. 99-106), ISSN 1568-7805.

2003
Using Negative Emotions to Impair Game Play
Doug DeGroot and Joost Broekens (2003). Proceedings of the 15th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2003, Nijmegen, The Netherlands).
VIBRAINT: Bridging The Gap Between Higher-Level Cognitive Functions And System-Level Brain Structures.
Doug DeGroot and Joost Broekens (2003). Ladislav Tauc Conference in Neurobiology. Gif surYvette, France.

Contact information / Top

Publications (non-refereed or under review)

MMOGs as Social Experiments: the Case of Environmental Laws
Joost Broekens (2008). arXiv:0811.0709 (November 2008)

Contact information / Top

Workshops/Invited talks/Tutorials

Conference presentations (not complete)
Emotion and Reinforcement: Affective Facial Expressions Facilitate Robot Learning (TALK)
Object-Centered Interactive Multi-Dimensional Scaling: Ask the Expert (POSTER)
Formalizing Cognitive Appraisal: From Theory to Computation (TALK)
Computational aspects of emotion in adaptivebehavior (TALK)
Internal Simulation of Behavior has an adaptive advantage (POSTER)
Scalable Computational Models of Emotion for Virtual Characters (TALK)
Emergent Representations and Reasoning in Adaptive Agents(TALK)
Computational Investigations of the Regulative Role of Pleasure in Adaptive Behavior (TALK)
Consistent Dynamic-group Emotions for Virtual Agents (POSTER)

Invited talks
Keynote at ERGOIA Conference Biaritz 2010 on affect and human computer interaction.
Lectures on Affective Computing at Institute for Information Engineering in Almere (2005, 2006, 2009)
Invited Speaker at ERGOIA Workshop 2009 on "Affective Computing and interface design"(2009)
Invited Speaker at Workshop on Robotics in health care (Workshop ROBOTICA in de zorg) (2007)

Tutorials

Affective Gaming and Computational Models of Emotion, ACII 2009
Affective Computing in Practice, DIGRA-NL meeting 2009

Contact information / Top

Reviewing and conference organization

Programme committee ECCE 2011
Programme committee ICAART 2010
Programme committee Human Robot Personal Relationships 2010
Programme committee AAMAS 2009, 2010, 2011
Programme Committee BNAIC 2009, 2010
Programme Committee SCACSNET'09
Reviewer MobileHCI 2008, 2009, 2010
Occasional reviewer for: Adaptive Behavior, Cognitive Systems Research, Transactions on Systems, Man, and Cybernetics--Part B, Behaviour & Information Technology, Journal of Autonomous Agents and Multiagent Systems

Poster and demo chair ECCE 2010
Guest Editor International Journal of Cognitive Performance Support
Review Board International Journal of Synthetic Emotions (IJSE)

Contact information / Top

Student projects

Former PhD's.
Junchao Xu (TU Delft, NL, co-promotor), 2015
Steven Fokkinga (TU Delft, NL, thesis committee member), 2015
Pedro Sequeira (INESC-ID, Lisbon, Portugal, thesis committee member), 2013
Muhammad Umair (VU Amsterdam, thesis committee member), 2012

Former MSc.
Emotions in Virtual Training Avatars; Niels Netten (paper).
ConflictCoach: online virtual coach system for interpersonal conflict handling at work; Maaike de Jong.
Converting Impulse Buying into Impulse Giving: The Donating Machine; Bert Rutjens. (paper)
Using Affect to Control Exploration in SOAR-RL; Eric Hogewoning. (paper)
Bodily emotion induction in an entertainment context; Ralph Kok. (paper)
The influence of emotion on trust formation in a virtual-agent human relation; Chris Detweiler. (paper)
Attention Strategies in SET; Timo de Vries (paper).
Emotion expression in 3D virtual environments; Alper Karadoganer (see here)
Cooperation and performance in MMOGs; Nico van Dijk (paper)
An Appraisal Based Model of Affect for a Negotiating Agent; Wim van der Ham (paper)
Abstract Affective Robotics; Alwin de Rooij (paper)
SAGE: A simple affective game engine; Alexandru Popescu (paper)
Representing human emotions using elements of Reinforcement Learning; Elmer Jacobs (paper)
Emotion expression in robots: A study on the effect of a changing virtual gravity vector on the perceived emotional content of robot movement; Suzanne Weller (paper)
Emotions in Automated Narrative; Frank Kaptein (paper)
The role of emotion in negotiation with virtual agents;Eva Delincakova
The Effectiveness of Shared Autonomic Feedback as an Affective Awareness Cue between Non-collocated Couples; Bernd Dudzik
Validating Affective Agent Ecosystems; Magnus Bjarnason
Agents Sharing Secrets: Self-Disclosure for Social Bonding in Long-Term Child-Avatar Interaction; Franziska Burger (paper)

Former BSc and other projects
3D Worlds for Collaborative Work; Bart van der Drift
How do positive and negative affect modulate working memory and attention? A computational review; Kerstin Wurdinger.
Automated Music and Commercials in Stores; Marjolein Braak.
A Perceptual Coding Language for User-Made Graphical Puzzles; Timo de Vries.
HortiDrone: Drone-Based data collection, analysis and visualisation for greenhouse growth analysis; JW Manenschijn and DC Schipper

Current PhD's.
Emotions in Reinforcement Learning robots; Thomas Moerland.
Personalized Pedagogical Style in robot Behavior; Rifca Peters.
Emotional Explainable AI; Frank Kaptein.
Cognitive-Affective Memory modelling; Bernd Dudzik

Open.
Cognitive-Affective NPC modelling for (serious) games (e.g., using Gamygdala, our emotion simulation engine).
Modelling emotions in learning agents.
Cloud robotics.
Many research/programming projects related to computational modelling of emotion, ranging from emotions in games to the effects of emotion on learning.
Please contact me if you are interested in more detail.

Contact information / Top

Gamygdala emotion engine for games

GAMYGDALA is an easy to use emotion engine for games. It enables developers to simulate emotions in NPC's. GAMYGDALA can be used in a black-box game-AI independent manner. We currently distribute a javascript version of the GAMYGDALA engine. Further, we have developed two Phaser Plugins and an example of how to use GAMYGDALA that builds upon level 9 of the Phaser tutorial (so do that one first to get to know Phaser). The GAMYGDALA project website includes info on how to use GAMYGDALA, as well as links to several running example games based on the Phaser game engine. For more info, examples of running code and example games, see the GAMYGDALA project website

GAMYGDALA is based on the following publication (please cite if you use it):
GAMYGDALA: an Emotion Engine for Games Alexandru Popescu, Joost Broekens, and Maarten van Someren (2014). IEEE Transactions on Affective Computing, 5(1), 32-44

Gamygdala is released under the MIT license.
For questions, contact joost.broekens@gmail.com

Contact information / Top

AffectButton

The AffectButton can be used by people to report their emotional state (feeling) in a simple one-click way. It can also be used for emotional tagging of media and other content. Recently the AffectButton, a standard interface component for affect (emotion) self report has been evaluated in a several large studies (800+ subjects of varied demographics). Our research shows that people can indeed use the button, and that the measurements are reliable and valid. You can try out the button yourself here, or download the stand alone Java version for Java, HTML5, Python and Android.
For usage instructions for users and researchers see instructions.


License of use
The AffectButton is distributed under the Creative Commons License CC-BY-NC-SA, unless otherwise agreed in writing. In short this means that you can use the button in your own research or educational project, that you may alter the button but not state that alterations are endorse by me, and that you must always credit the inventors. We prefer you credit us by citing our most recent work:

AffectButton: a method for reliable and valid affective self-report
Broekens, J., & Brinkman, W.-P. (2013). International Journal of Human-Computer Studies, 71(6), 641-667.

For commercial use you can contact me at my email above.

Versions
The AffectButton in the applet and stand alone version is the latest validated version (v3.2) and is controlled with the mouse (or another pointing device). You simply hover over the button, the face changes, and when you feel the face represents your emotion, mood, or your opinion about a particular thing, you click. When using the AffectButton for your research, please always check and download the latest version. The current version is v3.2 (latest validated version and reported upon in the above mentioned publication) or v3.3 (latest experimental version solving the problem of "nonresposiveness of arousal in the low-arousal states). If you need better arousal measures at low levels of arousal, use v3.3. For more info see the paper cited above.

JAVA
The Java code for v3.3 can be downloaded AffectButton v3.3, or here (v3.2): AffectButton v3.2. The code is in the jar file. The jar file itself is an executable one containing a test app. The test app can be used to record affect self-report for experiments. You can run the app (when you have Java installed) by double clicking the downloaded jar file. The application produces an output file in the directory in which you put the jar file. Each comma separated line in the output file contains the timestamp the app was started, the timestamp of the click, and the sequence number of the click, and of course the Pleasure, Arousal and Dominance values for that click. Alternatively you can run the jar with a command line argument. This argument will replace the first timestamp on each line, so that you can include e.g. a subject number.

PYTHON
There is a validated Python implementation (2.7.1) of the AffectButton v3.2 available now. It also contains an executable. To use the python version you need to:
1. Install Python 2.7.1
2. Install pyqt for python 2.7 (python qt library). Here's a download.
3. Download and run or use the affectbutton. You can download it here.

HTML5 / j-query / mobile
There is a validated version in HTML5 for v3.3. no need to install Java or Python. It runs in standard HTML5 browsers, and on mobiles, and is j-query compatible. download the rar below. Therein you will find the standard version of the AffectButton embedded in a demo page. Now the button is configured to react as is common in mouse-based systems, so a click enters the values for P, A and D, while moving around changes the face, just like the Java and Python versions. You can configure it to react on dragging (for touch-based devices), but then you need a button to input the actual values (uncomment the HTML buttons in the HTML file). In addtion you need to change the event handler function by uncommenting the code in _doMouse() in jquery.ui.affectbutton.js Here's a download.

ANDROID
And finally an android version thanks to Erik Kemperman. I have not checked this versio myself for consistency with the others, but you could give it a try. Download it here: Here's a download.


Online affective video tagging tool.
We have developed an online tool for affective video tagging (thanks to Junchao Xu). You can use the tool freely. It is available here (the link below is a demo, you need to configure the link for your own research!!): http://ii.tudelft.nl/~junchao/affectbuttonvideocoding/abvat?v=1h9YVywwutA&vw=1280&vh=720&gf=1l-E72jOfbvRDnzjdMtwybfy0H1fz3xQNEBz5Je09y7E&ea=joost.broekens@gmail.com
To use it for your own research, simply read the (short) manual. It can be found here.

Contact information / Top

Negotiation Support

Recently we have been able to show in the Pocket Negotiator project, a project focussed on negotiation support for novice negotiators, that Virtual Reality training improves negotiation skill and knowledge of participants. For an impression of the training, see the screenshot below. For more info, please contact me.

Contact information / Top

Dynamic facial expression for virtual characters

This tool is intended for those who need virtual characters with valid and reliable facial emotion expression. The model does not use animations, but uses direct bone control to express and blend dynamic expressions. The expressions have been evaluated in (Broekens, Chao Qu, & Brinkman, 2012). The tool contains the following items:

1. The experiment standalone executable for testing and checking out the expressions that can be generated with the software and models. Use num keys 1-6 and keys q-y to control expressions.

2. An example model (FaceGen, 3DS and Vizard format) with executable code instrumented to be able to express emotions on the face, according to the method described in (Broekens, et al., 2012). Use num keys 1-6 and keys q-y to control expressions.

3. The technical report (please refer when you use the tool, or parts of it, its method, data, etc.)

4. The experiment python code (vizard development kit)
a. A class to control facial expressions
b. A class to manage an emotional state.
c. The experiment code used to test the expressions

All code needs Vizard 3D http://www.worldviz.com/products/vizard)

Usage of the emotional state and expression code is pretty straightforward, and setting up an avatar with emotions is a question of a couple of lines of code. Please see the class AffectManager in emotion.py, and the example code in the expressionexperiment2.py in the class Character method _init. There you will find how to control the face with keys, as well as how to setup a character with emotions.

Please note that a new VC model needs to be "rigged", i.e., FACS-based muscle attachment needs to be done manually for every new facial morphology. See the example directory for a FaceGen, 3DS and Vizard model example. An overview of the process of creating a new face with a different morphology can be found in the Facial emotion expression overview.pptx file in the example directory. See the paper for more information. TIP: changing the texture of the head will already create a different look.

If you have any questions on how to rig the 3d model with FACS muscle attachements prior to using it for expression, please contact joost.broekens@gmail.com

Download the full package here

License of use This system is distributed under the Creative Commons License CC-BY-NC-SA, unless otherwise agreed in writing. In short this means that you can use it in your own research or educational project, that you may alter it but not state that alterations are endorse by me, and that you must always credit the inventors. We prefer you credit us by citing our most recent work:

Dynamic Facial Expression of Emotion Made Easy
Joost Broekens, Chao Qu, Willem-Paul Brinkman (2012). Technical report. Interactive Intelligence, Delft University of Technology.

For commercial use you can contact me at my email above.


Contact information / Top

Quotes

"It is as respectable to be modified monkey as modified dirt", Thomas Huxley on species differences.

"It is just as noble a conception of Deity, to believe that He created primal forms capable of self development...as to believe that He required a fresh act of intervention to supply the lacunaswhich He Himself had made.", Charles Kingsley on the origin of species by natrual selection.

"Willpower is just another name for the idea of choosing according to long-term outcomes rather than short-term ones", Antonio Damasio.

Contact information / Top

What's that? Personal section

Disclaimer
This section links to short opinion articles (English and Dutch) or position papers reflecting my personal opinion (and therefore not necessarily the opinion of the department / university). Thesearticles are either written as a reaction to events in society/politics or loose scientific ideas that I have not yet developed enough.
In deze sectie staan artikelen die op persoonlijke titel zijn geschreven, niet af zijn, of nog verder uitgewerkt zouden moeten worden.

CBR: Verdeel en Heers.
An Evolutionary View on Problems with Communication Patterns for Knowledge Workers
The Mobile Phone is a Teleportation Device: just a thought


Supported Internet Initiatives: SomaFM independent internet radio

Contact information / Top

simulation hypothesis, simulation of behaviour, hypothesis, theory, behavior, cognition, cognitive, emergence, emergent, representation, representations, interaction, reasoning, virtual agents,agent, interactivism, interactivist, adaptive, adaptation, reinforcement learning, computational model, modelling, modeling, emotions, emotion, affect, affective computing, appraisal theory,appraisals, formal, formalisms, formalism, consciousness, conscious, action selection, chi, hci, mmi, human machine interaction, affect measurement