cognitive tools lab

reverse engineering the human cognitive toolkit

© 2024 cognitive tools lab Jekyll Themes

our papers

  1. Wang, H., Jedoui, K., Venkatesh, R., Binder, F., Tenenbaum, J., Fan, J., Yamins, D., and Smith, K. (2024). Probabilistic simulation supports generalizable intuitive physics. Proceedings of the 46th Annual Meeting of the Cognitive Science Society. [pdf]
  2. McCarthy, W., Anderson, S., and Fan, J. (2024). How does assembling an object affect memory for it?. Proceedings of the 46th Annual Meeting of the Cognitive Science Society. [pdf]
  3. Verma, A., Mukherjee, K., Potts, C., Kreiss, E., and Fan, J. (2024). Evaluating human and machine understanding of data visualizations. Proceedings of the 46th Annual Meeting of the Cognitive Science Society. [pdf]
  4. Brockbank*, E., Yang*, J., Govil, M., Fan, J., and Gerstenberg, T. (2024). Without his cookies, he’s just a monster: a counterfactual simulation model of social explanation. Proceedings of the 46th Annual Meeting of the Cognitive Science Society. [pdf]
  5. Holt, S., Fan, J., and Barner, D. (2024). Creating ad hoc graphical representations of number. Cognition. [pdf]
  6. Venkatesh, R., Chen, H., Feigelis, K., Jedoui, K., Kotar, K., Binder, F., Lee, W., Liu, S., Smith, K., Fan, J., and Yamins, D. (2024). Counterfactual World Modeling for Physical Dynamics Understanding. European Conference on Computer Vision (ECCV). [pdf]
  7. Long, B., Fan, J., Huey, H., Chai, Z., and Frank, M. (2024). Parallel developmental changes in children’s production and recognition of line drawings of visual concepts. Nature Communications. [pdf]
  8. Huey, H., Leake, M., Aneja, D., Fisher, M., and Fan, J. (2024). How do video content creation goals impact which concepts people prioritize when generating B-roll imagery?. Proceedings of the 2024 ACM SIGCHI Conference on Creativity and Cognition. [pdf]
  9. Allen, K., Brändle, F., Botvinick, M., Fan, J., Gershman, S., Griffiths, T., Hartshorne, J., Hauser, T., Ho, M., Leeuw, J., Ma, W. J., Murayama, K., Nelson, J., Opheusden, B., Pouncy, T., Rafner, J., Rahwan, I., Rutledge, R., Sherson, J., Simsek, O., Spiers, H., Summerfield, C., Thalmann, M., Velez, N., Watrous, A., Tenenbaum, J., and Schulz, E. (2024). Using games to understand the mind. Nature Human Behaviour. [pdf]
  10. Bourouis, A., Fan, J., and Gryaditskaya, Y. (2024). Open vocabulary semantic scene sketch understanding. Computer Vision and Pattern Recognition (CVPR). [pdf]
  11. McCarthy, W., Matejka, J., Willis, K., Fan, J., and Pu, Y. (2024). Communicating design intent using drawing and text. Proceedings of the 2024 ACM SIGCHI Conference on Creativity and Cognition. [pdf]
  12. Mukherjee, K., Huey, H., Lu, X., Vinker, Y., Aguina-Kang, R., Shamir, A., and Fan, J. (2023). SEVA: Leveraging sketches to evaluate alignment between human and machine visual abstraction. Advances in Neural Information Processing Systems (Datasets and Benchmarks Track). [pdf]
  13. McCarthy, W., Kirsh, D., and Fan, J. (2023). Consistency and variation in reasoning about physical assembly. Cognitive Science. [pdf]
  14. Tung, H.-Y., Ding, M., Chen, Z., Bear, D., Gan, C., Tenenbaum, J., Yamins, D., Fan, J., and Smith, K. (2023). Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties. Advances in Neural Information Processing Systems (Datasets and Benchmarks Track). [pdf]
  15. Fan, J., Bainbridge, W., Chamberlain, R., and Wammes, J. (2023). Drawing as a versatile cognitive tool. Nature Reviews Psychology. [pdf]
  16. Long, B., Wang, Y., Christie, S., Frank, M., and Fan, J. (2023). Developmental changes in drawing production under different memory demands in a U.S. and Chinese sample. Developmental Psychology. [pdf]
  17. Lu, X., Wang, X., and Fan, J. (2023). Learning dense correspondences between photos and sketches. International Conference on Machine Learning. [pdf] [code]
  18. Hawkins, R., Sano, M., Goodman, N., and Fan, J. (2023). Visual resemblance and interaction history jointly constrain pictorial meaning. Nature Communications. [pdf] [code]
  19. Huey, H., Lu, X., Walker, C., and Fan, J. (2023). Explanatory drawings prioritize functional properties at the expense of visual fidelity. Cognition. [pdf] [code]
  20. Martinez, J., Binder, F., Wang, H., Haber, N., Fan, J., and Yamins, D. (2023). Measuring and modeling physical intrinsic motivation. Proceedings of the 45th Annual Meeting of the Cognitive Science Society. [pdf]
  21. Binder, F., Mattar, M., Kirsh, D., and Fan, J. (2023). Humans choose visual subgoals to reduce cognitive cost. Proceedings of the 45th Annual Meeting of the Cognitive Science Society. [pdf]
  22. Huey*, H., Oey*, L., Lloyd, H., and Fan, J. (2023). How do communicative goals guide which data visualizations people think are effective?. Proceedings of the 45th Annual Meeting of the Cognitive Science Society. [pdf]
  23. Mukherjee, K., Huey, H., Lu, X., Vinker, Y., Aguina-Kang, R., Shamir, A., and Fan, J. (2023). Evaluating machine comprehension of sketch meaning at different levels of abstraction. Proceedings of the 45th Annual Meeting of the Cognitive Science Society. [pdf]
  24. Gweon, H., Fan, J., and Kim, B. (2023). Socially intelligent machines that learn from humans and help humans learn. Philosophical Transactions of the Royal Society A. [pdf]
  25. Wang, H., Yang, J., Tamari, R., and Fan, J. (2022). Communicating understanding of physical dynamics in natural language. Proceedings of the 44th Annual Meeting of the Cognitive Science Society. [pdf]
  26. Wang, H., Allen, K., Vul, E., and Fan, J. (2022). Generalizing physical prediction by composing forces and objects. Proceedings of the 44th Annual Meeting of the Cognitive Science Society. [pdf]
  27. Brockbank*, E., Wang*, H., Yang, J., Mirchandani, S., Erdem Bıyık, E., Sadigh, D., and Fan, J. (2022). How do people incorporate advice from artificial agents when making physical judgments?. Proceedings of the 44th Annual Meeting of the Cognitive Science Society. [pdf]
  28. Wong*, C., McCarthy*, W., Grand*, G., Friedman, Y., Tenenbaum, J., Andreas, J., Hawkins, R., and Fan, J. (2022). Identifying concept libraries from language about object structure. Proceedings of the 44th Annual Meeting of the Cognitive Science Society. [pdf]
  29. Huey*, H., Long*, B., Yang, J., George, K., and Fan, J. (2022). Developmental changes in the semantic part structure of drawn objects. Proceedings of the 44th Annual Meeting of the Cognitive Science Society. [pdf]
  30. Bear*, D., Wang*, E., Mrowca*, D., Binder*, F., Tung, H.-Y., RT, P, Holdaway, C., Tao, S., Smith, K., Sun, F.-Y., Li, F.-F., Kanwisher, N., Tenenbaum, J., Yamins**, D., and Fan**, J. (2021). Physion: Evaluating physical prediction from vision in humans and machines. Advances in Neural Information Processing Systems (Datasets and Benchmarks Track). [pdf] [code]
  31. Kachergis, G., Radwan, S., Long, B., Fan, J., Lingelbach, M., Bear, D., Yamins, D., and Frank, M. (2021). Predicting children’s and adults’ preferences in physical interactions via physics simulation. Proceedings of the 43rd Annual Meeting of the Cognitive Science Society. [pdf] [code]
  32. Wang, H., Vul, E., Polikarpova, N., and Fan, J. (2021). Theory acquisition as constraint-based program synthesis. Proceedings of the 43rd Annual Meeting of the Cognitive Science Society. [pdf]
  33. Wang, H., Polikarpova, N., and Fan, J. (2021). Learning part-based abstractions for visual object concepts. Proceedings of the 43rd Annual Meeting of the Cognitive Science Society. [pdf] [code]
  34. Holt, S., Barner, D., and Fan, J. (2021). Improvised numerals rely on 1-to-1 correspondence. Proceedings of the 43rd Annual Meeting of the Cognitive Science Society. [pdf] [code]
  35. Huey, H., Walker, C., and Fan, J. (2021). How do the semantic properties of visual explanations guide causal inference?. Proceedings of the 43rd Annual Meeting of the Cognitive Science Society. [pdf] [code]
  36. McCarthy*, W., Hawkins*, R., Wang, H., Holdaway, C., and Fan, J. (2021). Learning to communicate about shared procedural abstractions. Proceedings of the 43rd Annual Meeting of the Cognitive Science Society. [pdf] [code]
  37. McCarthy, W., Mattar, M., Kirsh, D., and Fan, J. (2021). Connecting perceptual and procedural abstractions in physical construction. Proceedings of the 43rd Annual Meeting of the Cognitive Science Society. [pdf] [code]
  38. Holdaway*, C., Bear*, D., Radwan, S., Frank, M., Yamins, D., and Fan, J. (2021). Measuring and predicting variation in the interestingness of physical structures. Proceedings of the 43rd Annual Meeting of the Cognitive Science Society. [pdf] [code]
  39. Binder, F., Mattar, M., Kirsh, D., and Fan, J. (2021). Visual scoping operations for physical assembly. Proceedings of the 43rd Annual Meeting of the Cognitive Science Society. [pdf] [code]
  40. Yang, J., and Fan, J. (2021). Visual communication of object concepts at different levels of abstraction. Proceedings of the 43rd Annual Meeting of the Cognitive Science Society. [pdf] [code]
  41. McCarthy, W., Holdaway, C., Hawkins, R., and Fan, J. (2020). Emergence of compositional abstractions in human collaborative assembly. NeurIPS Workshop on Object Representations for Learning and Reasoning. [pdf] [code]
  42. Xu, X., Fan, J., and Dow, S. (2020). Schema and Metadata Guide the Collective Generation of Relevant and Diverse Work. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. [pdf]
  43. McCarthy, W., and Fan, J. (2020). Rapid policy updating in human physical construction. ICML Workshop on Object-Oriented Learning: Perception, Representation, and Reasoning. [pdf] [code]
  44. Wang, H., and Fan, J. (2020). Library learning for structured object concepts. ICML Workshop on Object-Oriented Learning: Perception, Representation, and Reasoning. [pdf]
  45. McCarthy, W., Kirsh, D., and Fan, J. (2020). Learning to build physical structures better over time. Proceedings of the 42nd Annual Meeting of the Cognitive Science Society. [pdf] [code]
  46. Fan, J., Wammes, J., Gunn, J., Yamins, D., Norman, K., and Turk-Browne, N. (2020). Relating visual production and recognition of objects in human visual cortex. Journal of Neuroscience. [pdf] [code]
  47. Fan, J., Hawkins, R., Wu, M., and Goodman, N. (2019). Pragmatic inference and visual abstraction enable contextual flexibility in visual communication. Computational Brain and Behavior. [pdf] [code]
  48. Achlioptas, P., Fan, J., Hawkins, R., Guibas, L., and Goodman, N. (2019). ShapeGlot: Learning Language for Shape Differentiation. International Conference on Computer Vision. [pdf]
  49. Hawkins, R., Sano, M., Goodman, N., and Fan, J. (2019). Disentangling contributions of visual information and interaction history in the formation of graphical conventions. Proceedings of the 41st Annual Meeting of the Cognitive Science Society. [pdf] [code]
  50. Mukherjee, K., Hawkins, R., and Fan, J. (2019). Conveying semantic part information in drawings. Proceedings of the 41st Annual Meeting of the Cognitive Science Society. [pdf] [code]
  51. Long, B., Fan, J., Chai, R., and Frank, M. (2019). Developmental changes in the ability to draw distinctive features of object categories. Proceedings of the 41st Annual Meeting of the Cognitive Science Society. [pdf] [code]
  52. Fan, J., Dinculescu, M., and Ha, D. (2019). Collabdraw: an environment for collaborative sketching with an artificial agent. Proceedings of the 2019 ACM SIGCHI Conference on Creativity and Cognition. [pdf]
  53. Fan, J., Yamins, D., and Turk-Browne, N. (2018). Common object representations for visual production and recognition. Cognitive Science. [pdf] [code]
  54. Long, B., Fan, J., and Frank, M. (2018). Drawings as a window into developmental changes in object representations. Proceedings of the 40th Annual Meeting of the Cognitive Science Society. [pdf] [code]
  55. Cullen, S., Fan, J., Brugge, E., and Elga, A. (2018). Improving analytical reasoning and argument understanding: A quasi-experimental field study of argument visualization. npj: Science of Learning. [pdf]
  56. Fan, J., Turk-Browne, N., and Taylor, J. (2016). Error-driven learning in statistical summary perception. Journal of Experimental Psychology: Human Perception and Performance. [pdf]
  57. Fan, J., Hutchinson, J.B., and Turk-Browne, N. (2016). When past is present: Substitutions of long-term memory for sensory evidence in perceptual judgments. Journal of Vision. [pdf]
  58. Fan, J., and Turk-Browne, N. (2016). Incidental biasing of attention from visual long-term memory. Journal of Experimental Psychology: Learning, Memory, and Cognition. [pdf]
  59. Fan, J., Yamins, D., and Turk-Browne, N. (2015). Common object representations for visual recognition and production. In Proceedings of the 37th Annual Conference of the Cognitive Science Society. [pdf]
  60. Fan, J. (2015). Drawing to learn: How producing graphical representations enhances scientific thinking. Translational Issues in Psychological Science. [pdf]
  61. Fan, J., and Suchow, J. (2014). The crowd is self-aware. Behavioral and Brain Sciences. [pdf]
  62. Fan, J., and Turk-Browne, N. (2013). Internal attention to features in visual short-term memory guides object learning. Cognition. [pdf]
  63. Fan, J. (2013). Can ideas about food inspire real social change? The case of Peruvian gastronomy. Gastronomica: The Journal of Food and Culture. [pdf]
  64. Strange, B., Kroes, M., Fan, J., and Dolan, R. (2010). Emotion causes targeted forgetting of established memories. Frontiers in Behavioral Neuroscience. [pdf]
  65. Sharot, T., Shiner, T., Brown, A., Fan, J., and Dolan, R. (2009). Dopamine enhances expectation of pleasure in humans. Current Biology. [pdf]

image