Hello, and welcome to my website!

I am Po-Sen. I am a staff research scientist at Google DeepMind. Before DeepMind, I worked at Microsoft Research and Clarifai. I received my PhD from University of Illinois at Urbana-Champaign (UIUC), advised by Prof. Mark Hasegawa-Johnson. I received my B.S. degree from National Taiwan University.


Contacts

Email: first_name last_name AT company_name DOT com

Selected Publications (Google Scholar)

  1. Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, Thomas Hubert, Peter Choy, Cyprien de Masson d’Autume, Igor Babuschkin, Xinyun Chen, Po-Sen Huang, Johannes Welbl, Sven Gowal, Alexey Cherepanov, James Molloy, Daniel J Mankowitz, Esme Sutherland Robson, Pushmeet Kohli, Nando de Freitas, Koray Kavukcuoglu, Oriol Vinyals
    Competition-level code generation with AlphaCode
    Science, 2022 (PDF, Blog)
  2. Amelia Glaese, Nat McAleese, Maja Trębacz, John Aslanides, Vlad Firoiu, Timo Ewalds, Maribeth Rauh, Laura Weidinger, Martin Chadwick, Phoebe Thacker, Lucy Campbell-Gillingham, Jonathan Uesato, Po-Sen Huang, Ramona Comanescu, Fan Yang, Abigail See, Sumanth Dathathri, Rory Greig, Charlie Chen, Doug Fritz, Jaume Sanchez Elias, Richard Green, Soňa Mokrá, Nicholas Fernando, Boxi Wu, Rachel Foley, Susannah Young, Iason Gabriel, William Isaac, John Mellor, Demis Hassabis, Koray Kavukcuoglu, Lisa Anne Hendricks, Geoffrey Irving
    Improving alignment of dialogue agents via targeted human judgements
    Arxiv, 2022 (PDF, Blog)
  3. Laura Weidinger, Jonathan Uesato, Maribeth Rauh, Conor Griffin, Po-Sen Huang, John Mellor, Amelia Glaese, Myra Cheng, Borja Balle, Atoosa Kasirzadeh, Courtney Biles, Sasha Brown, Zac Kenton, Will Hawkins, Tom Stepleton, Abeba Birhane, Lisa Anne Hendricks, Laura Rimell, William Isaac, Julia Haas, Sean Legassick, Geoffrey Irving, Iason Gabriel
    Taxonomy of Risks posed by Language Models
    FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency (PDF, Blog)
  4. Maribeth Rauh, John Mellor, Jonathan Uesato, Po-Sen Huang, Johannes Welbl, Laura Weidinger, Sumanth Dathathri, Amelia Glaese, Geoffrey Irving, Iason Gabriel, William Isaac, Lisa Anne Hendricks
    Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Models
    NeurIPS, Datasets and Benchmarks Track, 2022 (PDF)
  5. Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew Johnson, Blake Hechtman, Laura Weidinger, Iason Gabriel, William Isaac, Ed Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving
    Scaling Language Models: Methods, Analysis & Insights from Training Gopher
    Arxiv, 2021 (PDF, Blog)
  6. Johannes Welbl*, Amelia Glaese*, Jonathan Uesato*, Sumanth Dathathri*, John Mellor*, Lisa Anne Hendricks, Kirsty Anderson, Pushmeet Kohli, Ben Coppin, Po-Sen Huang* (*Equal contribution)
    Challenges in Detoxifying Language Models
    Findings of EMNLP, 2021 (PDF, Blog)
  7. Lei Yu*, Laurent Sartran*, Po-Sen Huang*, Wojciech Stokowiec*, Domenic Donato*, Srivatsan Srinivasan*, Alek Andreev*, Wang Ling*, Sona Mokra, Agustin Dal Lago, Yotam Doron, Susannah Young, Phil Blunsom, Chris Dyer* (*Equal contribution)
    The DeepMind Chinese-English Document Translation System at WMT2020
    Proceedings of the Fifth Conference on Machine Translation, 2020 (PDF)
  8. Po-Sen Huang*, Huan Zhang*, Ray Jiang, Robert Stanforth, Johannes Welbl, Jack Rae, Vishal Maini, Dani Yogatama, Pushmeet Kohli (*Equal contribution)
    Reducing Sentiment Bias in Language Models via Counterfactual Evaluation
    Findings of EMNLP, 2020 (PDF)
  9. Po-Sen Huang, Robert Stanforth, Johannes Welbl, Chris Dyer, Dani Yogatama, Sven Gowal, Krishnamurthy Dvijotham, Pushmeet Kohli
    Achieving Verified Robustness to Symbol Substitutions via Interval Bound Propagation
    EMNLP, 2019 (PDF, Code)
  10. Jonathan Uesato*, Jean-Baptiste Alayrac*, Po-Sen Huang*, Robert Stanforth, Alhussein Fawzi, Pushmeet Kohli (*Equal contribution)
    Are Labels Required for Improving Adversarial Robustness?
    Advances in Neural Information Processing Systems (NeurIPS), 2019 (PDF, Code)
  11. Po-Sen Huang, Chong Wang, Sitao Huang, Dengyong Zhou, Li Deng
    Towards Neural Phrase-based Machine Translation
    International Conference on Learning Representations (ICLR), 2018 (PDF, Code)
  12. Yelong Shen, Po-Sen Huang, Jianfeng Gao, Weizhu Chen
    ReasoNet: Learning to stop reading in machine comprehension
    Proc. of the 23rd SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2017 (PDF)
  13. Po-Sen Huang, Minje Kim, Mark Hasegawa-Johnson, Paris Smaragdis
    Joint Optimization of Masks and Deep Recurrent Neural Networks for Monaural Source Separation
    IEEE/ACM Transactions on Audio, Speech, and Language Processing, Dec. 2015 (PDF, Bibtex, Code)
    [2020 IEEE SPS Best Paper Award]
  14. Po-Sen Huang, Haim Avron, Tara Sainath, Vikas Sindhwani, Bhuvana Ramabhadran
    Kernel Methods match Deep Neural Networks on TIMIT
    Proc. of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2014. (PDF, Bibtex, Code) [IBM Research Spoken Language Processing Student Grant]
  15. Po-Sen Huang, Minje Kim, Mark Hasegawa-Johnson, Paris Smaragdis
    Deep Learning for Monaural Speech Separation
    Proc. of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2014. (PDF, Slides, Bibtex, Code) [Starkey Signal Processing Research Student Grant]
  16. Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, Larry Heck
    Learning Deep Structured Semantic Models for Web Search using Clickthrough Data
    Proc. of the ACM International Conference on Information and Knowledge Management (CIKM), 2013. (PDF, Bibtex, Code)

Software

  1. Are Labels Required for Improving Adversarial Robustness?
    2.
  1. Achieving Verified Robustness to Symbol Substitutions via Interval Bound Propagation
    2.
  1. Natural Language to Structured Query Generation via Meta-Learning
    2.
  1. Towards Neural Phrase-based Machine Translation (NPMT)
    2.
  1. Singing-Voice Separation From Monaural Recordings Using Robust Principal Component Analysis
    2.
  1. Deep Learning for Monaural Source Separation
    2.