Joost Broekens

Media

Jan 2013. BNR digitaal, National radio Live interview BNR digitaal over EVA de thuiszorgrobot en crowdfunding Link.
Nov 2012: ZappLive, National TV Performance of TU Delft robots Link.
Aug 2012: Interview Quest Magazine, about emotions in Robots. Link.
Jan 2012. BNR, National radio Interview Joost Broekens op BNR radio over EVA de thuiszorgrobot Link.
Jan 2012. Volkskrant, National newspaper, Wetenschap Zorgrobot eva haalt de drankjes Link.
Jan 2012. Powned, National TV, Pownews Interview Studenten EVA Pownews Link.
Jan 2012. Omroep MAX, National TV, KoffieMax Interview met Joost Broekens en Bram van der VeenLink.
Jan 2012. Delta, Tu newspaper Interview voor TU Delta Link.
Dec 2011. VPRO, National TV, Labyrint De ontknoping van het Groot Nationaal Onderzoek Link.
Dec 2011. http://www.psycholoog.net, National Web Emotieherkenning onderzocht Link.
Dec 2011. Wetenschap24, National Web. De ontknoping van het Groot Nationaal Onderzoek Link.
Nov 2011. NWO, National Science Foundation, Article. Eindelijk ook Vrouwen Link.
Okt 2011. Wetenschap24, National Web. Wat heeft het Groot Nationaal Onderzoek van jou geleerd? Link.
April 2011. VPRO, National Web. VPRO en NTR lanceren unieke vorm van wetenschappelijk onderzoek Link.
April 2011. Wetenschap24, National Web, Interview. De psychologie van de proefpersoon Link.
April 2011. Wetenschap24, National Web, Groot Nationaal Onderzoek. De Wetenschappers Link.
Jan 2011. Wetenschap24, National Web: Doe de test: gezichtsuitdrukkingen herkennen: Link.
Jan 2011. Labyrint, National TV, Labyrint Joost Broekens in VPRO TV documentary on emotion and machines: Link.
2007. Trotsboekje, Leiden Science Faculty, Interview GESIMULEERDE MUIZEN PROBLEMEN LATEN OPLOSSEN Link.
2007. Mare, Leiden University Journal, Interview Blije robots Link.

Pages last edited, 4-dec-2012.

Bio

Joost Broekens received a MSc degree in Computer Science at the University of Delft, The Netherlands, in 2001. In 2007 he received his PhD in computer science at the University of Leiden, The Netherlands, in the area of computational modeling of emotion in relation to learning processes. He has published in the area of computational models of emotion (ranging from theoretical approaches to more applied ones), developed master-level courses and course material on the topic, and has given several invited lectures as well as less formal talks for the larger public related to Affective Computing. His most recent interests include reinforcement learning, affective computing, human-robot and human-computer interaction, and gaming research.

If you are interested in this research, please contact Joost Broekens (email above).
If you want to do a student project (Bachelor or Master) and want to know more, do not hesitate to mail or give a call.

Contact information / Top

Training and Consultancy (ELXR)

Joost Broekens is owner and founder of ELXR, a knowlegde transfer and consultancy start-up specialized in digital emotion technology. For more info about the services of ELXR, please consult the webiste.

Research Interests

Computational models of emotion.
Theoretical Affective Computing (see below: Modeling the Experience of Emotion)
Computational cognitive modelling
Gaming research and affective gaming
Human Computer Interaction
Emergent aspects of emotion
Adaptive behavior

Contact information / Top

Teaching and Lectures

Course: Affective Computing, TU Delft 2010, 2011, 2012, 2013
Course Computational Intelligence, TU Delft, 2012
Lecture on Serious Gaming, in Educational Software (2009, 2010)
Lecture on Affective Computing, in AI course(2008, 2009)
Lecture on Robotics, in AI course (2008, 2009)
Lecture on Reinforcement Learning, in AI course (2008, 2009)
Developed and taught course Affective Computing, Leiden Univerisity (2006)
Lecture on "Affective Computing" in course ICT in Business (2006, 2007)
Lecture on "Computational Models of Emotions" in course: Multimedia Systems (2005)
Course assistent: Human Computer Interaction (2005-2006)
Course assistent: Speech Recognition (2003-2004-2005)
Course assistent: AI and Gaming (2003-2004)

Contact information / Top

Publications (refereed)

2013
Challenges in Computational Modeling of Affective Processes
Joost Broekens, Tibor Bosse and Stacy Marsella. Editorial in IEEE Transactions on Affective Computing.
GAMYGDALA: an Emotion Engine for Games
Alexandru Popescu, Joost Broekens, and Maarten van Someren (conditionally accepted). IEEE Transactions on Affective Computing.
Abstract Affective Expressions
Alwin de Rooij, Joost Broekens, Maarten Lamers (2013). International Journal on Synthetic Emotions.
AffectButton: a method for reliable and valid affective self-report
Joost Broekens and Willem-Paul Brinkman (2013). International Journal of Human-Computer Studies. http://dx.doi.org/10.1016/j.ijhcs.2013.02.003

2012
Goal-Based Explainable Security Certificate Requests
Maaike Harbers, Joost Broekens, Thomas Quillinan, M. Birna van Riemsdijk, Niek Wijngaards (2012). Proceedings of the 8th International Conference on Geo-information for Disaster Management, 3-10.
Negotiating Agents
Catholijn M. Jonker, Koen V. Hindriks, Pascal Wiggers, Joost Broekens (2012). AI Magazine, 33 (3), 79-91.
Dynamic Facial Expression of Emotion Made Easy
Joost Broekens, Chao Qu, Willem-Paul Brinkman (2012). Technical report. Interactive Intelligence, Delft University of Technology.
In Defense of Dominance: PAD Usage in Computational Representations of Affect
Joost Broekens (2012). International Journal on Synthetic Emotions (IJSE) 3(1), 33-42.Link
Designing Interfaces for Explicit Preference Elicitation: a user-centered investigation of preference representation and elicitation process
Alina Pommeranz, Joost Broekens, Pascal Wiggers, Willem-Paul Brinkman, Catholijn Jonker (2012). User Modeling and User-adapted Interaction (UMUAI) 22 (3-4), 357-379. Link
Virtual Reality Negotiation Training Increases Negotiation Knowledge and Skill
Joost Broekens, Maaike Harbers, Willem-Paul Brinkman, Karel van den Bosch, Catholijn M. Jonker, John-Jules Meyer (2012). Intelligent Virtual Agents (IVA 2012), 218-230 Link
Modeling emotional contagion based on experimental evidence for moderating factors. Rene Coenen and Joost Broekens. (2012). AAMAS Workshop on Emotional and Empathic Agents (EAS), 26-31.Link

2011
Comparing Formal Cognitive Emotion Theories
Koen Hindriks and Joost Broekens (2011). Workshop Proceedings on Standards in Emotion Modelling 2011 (SEM2011). Link
The Effect of Dominance Manipulation on the Perception and Believability of an Emotional Expression
Wim van der Ham and Joost Broekens (2011). Workshop Proceedings on Standards in Emotion Modelling 2011 (SEM2011). Link
Validity of a Virtual Negotiation Training
Joost Broekens, Maaike Harbers, Willem-Paul Brinkman, Catholijn Jonker, Karel van den Bosch and John-Jules Meyer (2011). IVA 2011, Springer LNCS 6895, 435-436. Link
Robot Learning from Feedback
Joost Broekens (2011). Encyclopedia of the Sciences of Learning. Springer. Link
Computational Affective Science
Joost Broekens (2011). International Journal of Synthetic Emotions, 2(2), 73-75. link
Empathic virtual buddy: setting up informed empathic responses.
JM van der Zwaan, Virgina Dignum, Joost Broekens, CM Jonker (2011). In: Proceedings of the 15th Portuguese Conference on Artificial Intelligence (EPIA 2011), 1 - 15.

2010
Assistive Social Robots for Elderly Care
Joost Broekens, Koen Hindriks and Martijn Wisse (2010). Cybertherapy and Rehabilitation, 13(3), p34
Real Time Labeling of Affect in Music Using the AffectButton
Joost Broekens, Anne Pronker, Marian Neuteboom (2010). 3rd International Workshop on Affective Interaction in Natural Environments (AFFINE'10) at ACM Multimedia 2010.
Factors Influencing User Motivation for Giving Online Preference Feedback
Joost Broekens, Alina Pommeranz, Pascal Wiggers and Catholijn M. Jonker (2010). MPREF workshop at ECAI 2010.
Do you get it? User-evaluated explainable BDI agents
Joost Broekens, Maaike Harbers, Koen Hindriks, Karel van den Bosch, Catholijn Jonker and John-Jules Meyer (2010). MATES 2010.
Reinforcement Learning as Heuristic for Action-Rule Preferences
Joost Broekens, Koen Hindriks, Pascal Wiggers (2010). PROMAS Workshop at AAMAS 2010, pp. 85-100.
Affective Negotiation Support Systems
Joost Broekens, Catholijn Jonker, John-Jules Meyer (2010). Journal of Ambient Intelligence and Smart Environments, 2(2), 121-144.
Robots that Care
Rosemarijn Looije, Jeroen Arendsen, Jelle Saldien, Bram Vanderborght, Joost Broekens and Mark Neerincx (2010). Proceedings of the 28th Annual European Conference on Cognitive Ergonomics, ACM, 301-302.
Modeling the Experience of Emotion
Joost Broekens (2010). International Journal of Synthetic Emotions, 1(1), 1-17.
Virtual Team Performance Depends on Distributed Leadership
Nico van Dijk and Joost Broekens (2010). ICEC 2010.
DUO meta-model for knowledge elicitation and bidding support in NSS
Alina Pommeranz, Wietske Visser, Joost Broekens, Pascal Wiggers, Koen Hindriks, and Catholijn M. Jonker (2010). HuCom 2010.
Guidelines for Developing Explainable Cognitive Models
Maaike Harbers, Joost Broekens, Karel van den Bosch and John-Jules Meyer (2010). ICCM 2010.

2009
Eye Movements Disclose Decisions in Set
Joost Broekens, Walter Kosters and Timo de Vries (2009). BNAIC 2009.
Assistive social robots in elderly care: a review
Joost Broekens, Marcel Heerink and Henk Rosendal (2009). Gerontechnology, 8(2), 94-103. See also here for pre-print version
Design Guidelines for Negotiation Support Systems: An Expert Perspective Using Scenarios
Alina Pommeranz , Willem-Paul Brinkman, Pascal Wiggers, Joost Broekens, Catholijn M. Jonker (2009). ECCE 2009.
Foundations for Modelling Emotions in Game Characters: Modelling Emotion Effects on Cognition
Eva Hudlicka, Joost Broekens (2009). Affective Computing and Intelligent Interaction (ACII) 2009.
Getting a Grip on Emotions in Negotiations: the Possibilities of ICT
Willem-Paul Brinkman, Joost Broekens,Catholijn M. Jonker, John-Jules Ch. Meyer (2009). IAT Conference, HAI Workshop 2009.
AffectButton: Towards a Standard for Dynamic Affective User Feedback
Joost Broekens, Willem-Paul Brinkman (2009). Affective Computing and Intelligent Interaction (ACII) 2009.
Trust in Online Technology: Towards Practical Guidelines Based on Experimentally Verified Theory
Christian Detweiler, Joost Broekens (2009). HCI International 2009.
Interactive TV Together: An Open Service Infrastructure for Enhancing Interactive TV Experiences
C. Hesselman, J. Broekens, M. Guelbahar, F. Winkler, D. Goergen, F. de Jong, J. Vester, W. Derks, R. de Groote, A. Tokmakoff, D. Abbadessa, J. da Silva, D.-J. van Dijk, X. Zhou, R. Poortinga, S. Smit, H. ter Doest, M. Snijders, and R. van Laar. (2009) Chapter in Social Interactive Television: Immersive Shared Experiences and Perspectives.

2008
Multi-angle view on preference elicitation for negotiation support systems
Pommeranz, A., Broekens, J., Visser, W., Brinkman, W.-P., Wiggers, P., and Jonker, C.M. (2008). Proceedings of first international working conference on human factors and computational models in negotiation (HuCom08), ISBN 978-90-813811-1-6, pp. 19-26.
An Open Service Infrastructure for Enriching Networked Interactive Multimedia Experiences in a Converged World
S. Smit, J. Broekens, M. Guelbahar, K. Shepherd, A. Visser, J. Vester, A. Tokmakoff, O. Friedrich, A. Domene, F. Winkler, M. Martin, J. Zoric, F.-X. Kowalski, D. Goergen, R. de Groote, R. Poortinga - van Wijnen, C. Hesselman. (2008). NEM Summit 2008, Saint-Malo, France.
Want a Recommendation? Ask my Digital Personality!
Joost Broekens (2008). Workshop on Interactive Television Commerce and Advertising, co-located with the European Interactive TV Conference (EuroITV2008), Salzburg, Austria, July 2008.
An Open Service Infrastructure for Enhancing Interactive TV Experiences EuroITV 2008 Workshop on Sharing Content and Experiences with Social iTV.
Cristian Hesselman, Wijnand Derks, Joost Broekens, Henk Eertink, Mark Gülbahar, Remco Poortinga (2008). Workshop on Sharing Content and Experiences with Social Interactive Television, co-located with the European Interactive TV Conference (EuroITV2008), Salzburg, Austria, July 2008
Physical Emotion Induction and Its Use in Entertainment: Lessons Learned.
Ralph Kok, Joost Broekens (2008). 1st IFIP Entertainment Computing Symposium. Springer
Formal Models of Appraisal: Theory, Specification, and Computational Model
Joost Broekens, Doug DeGroot and Walter A. Kosters (2008). Cognitive Systems Research, 9(3), 173-197.

2007
Affect and Learning: A Computational Analysis
Joost Broekens (2007). PhD Thesis, Leiden University.
Affect, Anticipation and Adaptation: Affect-Controlled Selection of Anticipatory Simulation in Artificial Adaptive Agents
Joost Broekens, Walter A. Kosters and Fons J. Verbeek (2007). Adaptive Behavior, 15(4), 397-422
Strategies for Affect-Controlled Action-Selection in Soar-RL
Eric Hogewoning, Joost Broekens, Jeroen Eggermont and Ernst G.P. Bovenkamp. Proceedings of the 2nd. International Work-Conference on the Interplay between Natural and Artificial Computation (IWINAC 2007, Murcia, Spain), LNCS 4528 (pp. 501-510), Springer
On Affect and Self-Adaptation: Potential Benefits of Valence-Controlled Action-Selection
Joost Broekens, Walter A. Kosters and Fons J. Verbeek. Proceedings of the 2nd. International Work-Conference on the Interplay between Natural and Artificial Computation (IWINAC 2007, Murcia, Spain), LNCS 4527 (pp. 357-366), Springer
Emotion and Reinforcement: Affective Facial Expressions Facilitate Robot Learning
Joost Broekens (2007). LNAI Spec. Vol. on AI for Human Computing, LNAI 4451 (pp. 113-132), Springer.
Emotion and Reinforcement: Affective Facial Expressions Facilitate Robot Learning
Joost Broekens and Pascal Haazebroek (2007). Proceedings of the IJCAI Workshop on AI for Human Computing (AI4HC'07, Hyderabad, India) (pp.47-54).

2006
OBJECT-CENTERED INTERACTIVE MULTI-DIMENSIONAL SCALING: ASK THE EXPERT
Joost Broekens, Tim Cocx and Walter A. Kosters (2006). Proceedings of the 18th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2006, Namur, Belgium) (pp. 59-66), ISSN 1568-7805.
Formalizing Cognitive Appraisal: From Theory to Computation
Joost Broekens and Doug DeGroot (2006). Proceedings of the 18th European Meeting on Cybernetics and Systems Research (EMCSR 2006, Vienna, Austria) (pp. 595-600), ASCS: Vienna.

2005
Simulation, Emotion and Information Processing: Computational Investigations of the Regulative Role of Pleasure in Adaptive Behavior
Joost Broekens and Fons J. Verbeek (2005). Proceedings of the IJCAI Workshop on Modeling Natural Action Selection (Edinburgh, UK) (pp. 166-173), AISB Press, ISBN 1-902956-40-9
Internal Simulation of Behavior has an Adaptive Advantage
Joost Broekens (2005). Proceedings of the Conginitive Science Conference (CogSci'05, Stresa, Italy) (pp. 342-347). Mahwah, NJ: Lawrence Erlbaum Associates. ISBN 0-9768318-1-3

2004
Scalable and Flexible Appraisal Models for Virtual Agents (Nominated for best paper award.)
Joost Broekens & Doug DeGroot (2004). 5th Game-On International Conference: Computer Games: Artificial Intelligence, Design and Education (CGAIDE 2004, Reading, UK) (pp. 208-215), ISBN 0-9549016-0-6.
Emergent Representations and Reasoning in Adaptive Agents
Joost Broekens and Doug DeGroot (2004). Third International Conference on Machine Learning and Applications (ICMLA 2004, Louisville KY, USA) (pp. 207-214), IEEE press, ISBN 0-7803-8823-2.
Emotional Agents need Formal Models of Emotion
Joost Broekens and Doug DeGroot (2004). Proceedings of the 16th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2004, Groningen, The Netherlands) (pp. 195-202), ISSN 1568-7805.
Consistent Dynamic-Group Emotions for Virtual Agents
Joost Broekens, Niels Netten & Doug DeGroot (2004). Proceedings of the 16th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2004, Groningen, The Netherlands) (pp. 99-106), ISSN 1568-7805.

2003
Using Negative Emotions to Impair Game Play
Doug DeGroot and Joost Broekens (2003). Proceedings of the 15th Belgian-Dutch Conference on Artificial Intelligence (BNAIC 2003, Nijmegen, The Netherlands).
VIBRAINT: Bridging The Gap Between Higher-Level Cognitive Functions And System-Level Brain Structures.
Doug DeGroot and Joost Broekens (2003). Ladislav Tauc Conference in Neurobiology. Gif surYvette, France.

Contact information / Top

Publications (non-refereed or under review)

MMOGs as Social Experiments: the Case of Environmental Laws
Joost Broekens (2008). arXiv:0811.0709 (November 2008)

Contact information / Top

Workshops/Invited talks/Tutorials

Conference presentations (not complete)
Emotion and Reinforcement: Affective Facial Expressions Facilitate Robot Learning (TALK)
Object-Centered Interactive Multi-Dimensional Scaling: Ask the Expert (POSTER)
Formalizing Cognitive Appraisal: From Theory to Computation (TALK)
Computational aspects of emotion in adaptivebehavior (TALK)
Internal Simulation of Behavior has an adaptive advantage (POSTER)
Scalable Computational Models of Emotion for Virtual Characters (TALK)
Emergent Representations and Reasoning in Adaptive Agents(TALK)
Computational Investigations of the Regulative Role of Pleasure in Adaptive Behavior (TALK)
Consistent Dynamic-group Emotions for Virtual Agents (POSTER)

Invited talks
Keynote at ERGOIA Conference Biaritz 2010 on affect and human computer interaction.
Lectures on Affective Computing at Institute for Information Engineering in Almere (2005, 2006, 2009)
Invited Speaker at ERGOIA Workshop 2009 on "Affective Computing and interface design"(2009)
Invited Speaker at Workshop on Robotics in health care (Workshop ROBOTICA in de zorg) (2007)

Tutorials
Affective Gaming and Computational Models of Emotion, ACII 2009
Affective Computing in Practice, DIGRA-NL meeting 2009

Contact information / Top

Reviewing and conference organization

Programme committee ECCE 2011
Programme committee ICAART 2010
Programme committee Human Robot Personal Relationships 2010
Programme committee AAMAS 2009, 2010, 2011
Programme Committee BNAIC 2009, 2010
Programme Committee SCACSNET'09
Reviewer MobileHCI 2008, 2009, 2010
Occasional reviewer for: Adaptive Behavior, Cognitive Systems Research, Transactions on Systems, Man, and Cybernetics--Part B, Behaviour & Information Technology, Journal of Autonomous Agents and Multiagent Systems

Poster and demo chair ECCE 2010
Guest Editor International Journal of Cognitive Performance Support
Review Board International Journal of Synthetic Emotions (IJSE)

Contact information / Top

Student projects

Former.
MSc
Emotions in Virtual Training Avatars; Niels Netten (paper).
ConflictCoach: online virtual coach system for interpersonal conflict handling at work; Maaike de Jong.
Converting Impulse Buying into Impulse Giving: The Donating Machine; Bert Rutjens. (paper)
Using Affect to Control Exploration in SOAR-RL; Eric Hogewoning. (paper)
Bodily emotion induction in an entertainment context; Ralph Kok. (paper)
The influence of emotion on trust formation in a virtual-agent human relation; Chris Detweiler. (paper)
Attention Strategies in SET; Timo de Vries (paper).
BSc and other projects
3D Worlds for Collaborative Work; Bart van der Drift
How do positive and negative affect modulate working memory and attention? A computational review; Kerstin Wurdinger.
Automated Music and Commercials in Stores; Marjolein Braak.
A Perceptual Coding Language for User-Made Graphical Puzzles; Timo de Vries.

Current.
Explicit Emotion Measurement tools and HCI; Xiao-Hu Tai
Emotion expression in 3D virtual environments; Alper Karadoganer (see here)
Cooperation and performance in MMOGs; Nivo van Dijk

Open.
Emotional Tagging in Tribler content sharing system (see also Johan Pouwelse)
Formal Modelling of Appraisal Theory for Negotiation Support Systems
Many research/programming projects related to computational modeling of emotion, ranging from emotions in games to the effects of emotion on learning.
Please contact me if you are interested in more detail.

Contact information / Top

AffectButton

Recently the AffectButton, a standard interface component for affect (emotion) self report has been evaluated in a several large studies. The AffectButton can be used for people to report their emotional state in a simple one-click way. It can also be used for emotional tagging. Our research shows that people can indeed use the button, and that the measurments are reliable and valid. You can try out the button yourself in the applet below, or download the stand alone Java version.

If you want to use the button in your own research or educational project, you can. For commercial use email me at email above. When you use the button, cite the following paper:

AffectButton: Towards a Standard for Dynamic Affective User Feedback
Joost Broekens, Willem-Paul Brinkman (2009). Affective Computing and Intelligent Interaction (ACII) 2009.

The AffectButton in the applet and stand alone version is the latest validated version (v3.2) and is controlled with the mouse (or another pointing device). You simply hover over the button, the face changes, and when you feel the face represents your emotion, mood, or your opinion about a particular thing, you click. When using the AffectButton for your research, please always check and download the latest version. The current version is v3.2. For more info see the paper cited above.
Your browser is not Java enabled.
JAVA: The Java code can be downloaded here. The code is in the jar file. The jar file itself is an executable one containing a test app. The test app can be used to record affect self-report for experiments. You can run the app (when you have Java installed) by double clicking the downloaded jar file. The application produces an output file in the directory in which you put the jar file. Each comma separated line in the output file contains the timestamp the app was started, the timestamp of the click, and the sequence number of the click, and of course the Pleasure, Arousal and Dominance values for that click. Alternatively you can run the jar with a command line argument. This argument will replace the first timestamp on each line, so that you can include e.g. a subject number.

PYTHON (NEW): there is a validated Python implementation (2.7.1) of the AffectButton available now. It also contains an executable. To use the python version you need to:
1. Install Python 2.7.1
2. Install pyqt for python 2.7 (python qt library). Here's a download.
3. Download and run or use the affectbutton. You can download it here.

Contact information / Top

Negotiation Support

Recently we have been able to show in the Pocket Negotiator project, a project focussed on negotiation support for novice negotiators, that Virtual Reality training improves negotiation skill and knowledge of participants. For an impression of the training, see the screenshot below. For more info, please contact me.

Contact information / Top

Dynamic facial expression for virtual characters

This tool is intended for those who need virtual characters with valid and reliable facial emotion expression. The model does not use animations, but uses direct bone control to express and blend dynamic expressions. The expressions have been evaluated in (Broekens, Chao Qu, & Brinkman, 2012). The tool contains the following items:

1. The experiment standalone executable for testing and checking out the expressions that can be generated with the software and models. Use num keys 1-6 and keys q-y to control expressions.

2. An example model (FaceGen, 3DS and Vizard format) with executable code instrumented to be able to express emotions on the face, according to the method described in (Broekens, et al., 2012). Use num keys 1-6 and keys q-y to control expressions.

3. The technical report (please refer when you use the tool, or parts of it, its method, data, etc.)

4. The experiment python code (vizard development kit)
a. A class to control facial expressions
b. A class to manage an emotional state.
c. The experiment code used to test the expressions

All code needs Vizard 3D http://www.worldviz.com/products/vizard)

Usage of the emotional state and expression code is pretty straightforward, and setting up an avatar with emotions is a question of a couple of lines of code. Please see the class AffectManager in emotion.py, and the example code in the expressionexperiment2.py in the class Character method _init. There you will find how to control the face with keys, as well as how to setup a character with emotions.

Please note that a new VC model needs to be "rigged", i.e., FACS-based muscle attachment needs to be done manually for every new facial morphology. See the example directory for a FaceGen, 3DS and Vizard model example. An overview of the process of creating a new face with a different morphology can be found in the Facial emotion expression overview.pptx file in the example directory. See the paper for more information. TIP: changing the texture of the head will already create a different look.

If you have any questions on how to rig the 3d model with FACS muscle attachements prior to using it for expression, please contact joost.broekens@gmail.com

Download the full package here

Broekens, J., Qu, C., & Brinkman, W.-P. (2012). Dynamic Facial Expression of Emotion Made Easy. Interactive Intelligence, Delft University of Technology.
Contact information / Top

Quotes

"It is as respectable to be modified monkey as modified dirt", Thomas Huxley on species differences.

"It is just as noble a conception of Deity, to believe that He created primal forms capable of self development...as to believe that He required a fresh act of intervention to supply the lacunaswhich He Himself had made.", Charles Kingsley on the origin of species by natrual selection.

"Willpower is just another name for the idea of choosing according to long-term outcomes rather than short-term ones", Antonio Damasio.

Contact information / Top

What's that? Personal section

Disclaimer
This section links to short opinion articles (English and Dutch) or position papers reflecting my personal opinion (and therefore not necessarily the opinion of the department / university). Thesearticles are either written as a reaction to events in society/politics or loose scientific ideas that I have not yet developed enough.
In deze sectie staan artikelen die op persoonlijke titel zijn geschreven, niet af zijn, of nog verder uitgewerkt zouden moeten worden.

CBR: Verdeel en Heers.
An Evolutionary View on Problems with Communication Patterns for Knowledge Workers
The Mobile Phone is a Teleportation Device: just a thought

Supported Internet Initiatives:

Contact information / Top