No photo of Hao Peng

View Scopus Profile

Hao Peng

  • 22 Conference contribution
  • 9 Paper
  • 3 Conference article
  • 2 Article

Search results

  • 2024

    ActionIE: Action Extraction from Scientific Literature with Programming Languages

    Zhong, X., Du, Y., Ouyang, S., Zhong, M., Luo, T., Ho, Q., Peng, H., Ji, H. & Han, J., 2024, Long Papers. Ku, L.-W., Martins, A. F. T. & Srikumar, V. (eds.). Association for Computational Linguistics (ACL), p. 12656-12671 16 p. (Proceedings of the Annual Meeting of the Association for Computational Linguistics; vol. 1).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • CRAFT: CUSTOMIZING LLMS BY CREATING AND RETRIEVING FROM SPECIALIZED TOOLSETS

    Yuan, L., Chen, Y., Wang, X., Fung, Y. R., Peng, H. & Ji, H., 2024.

    Research output: Contribution to conference › Paper › peer-review

  • Data Engineering for Scaling Language Models to 128K Context

    Fu, Y., Panda, R., Niu, X., Yue, X., Hajishirzi, H., Kim, Y. & Peng, H., 2024, In: Proceedings of Machine Learning Research. 235, p. 14125-14134 10 p.

    Research output: Contribution to journal › Conference article › peer-review

  • Executable Code Actions Elicit Better LLM Agents

    Wang, X., Chen, Y., Yuan, L., Zhang, Y., Li, Y., Peng, H. & Ji, H., 2024, In: Proceedings of Machine Learning Research. 235, p. 50208-50232 25 p.

    Research output: Contribution to journal › Conference article › peer-review

  • Language Models Hallucinate, but May Excel at Fact Verification

    Guan, J., Dodge, J., Wadden, D., Huang, M. & Peng, H., 2024, Long Papers. Duh, K., Gomez, H. & Bethard, S. (eds.). Association for Computational Linguistics (ACL), p. 1090-1111 22 p. (Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL 2024; vol. 1).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • LETI: Learning to Generate from Textual Interactions

    Wang, X., Peng, H., Jabbarvand, R. & Ji, H., 2024, Findings of the Association for Computational Linguistics: NAACL 2024 - Findings. Duh, K., Gomez, H. & Bethard, S. (eds.). Association for Computational Linguistics (ACL), p. 223-239 17 p. (Findings of the Association for Computational Linguistics: NAACL 2024 - Findings).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models

    Han, C., Wang, Q., Peng, H., Xiong, W., Chen, Y., Ji, H. & Wang, S., 2024, Long Papers. Duh, K., Gomez, H. & Bethard, S. (eds.). Association for Computational Linguistics (ACL), p. 3991-4008 18 p. (Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL 2024; vol. 1).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • MINT: EVALUATING LLMS IN MULTI-TURN INTERACTION WITH TOOLS AND LANGUAGE FEEDBACK

    Wang, X., Wang, Z., Liu, J., Chen, Y., Yuan, L., Peng, H. & Ji, H., 2024.

    Research output: Contribution to conference › Paper › peer-review

  • TRAM: BRIDGING TRUST REGIONS AND SHARPNESS AWARE MINIMIZATION

    Sherborne, T., Saphra, N., Dasigi, P. & Peng, H., 2024.

    Research output: Contribution to conference › Paper › peer-review

  • 2023

    COMPLEXITY-BASED PROMPTING FOR MULTI-STEP REASONING

    Fu, Y., Peng, H., Sabharwal, A., Clark, P. & Khot, T., 2023.

    Research output: Contribution to conference › Paper › peer-review

  • Specializing Smaller Language Models towards Multi-Step Reasoning

    Fu, Y., Peng, H., Ou, L., Sabharwal, A. & Khot, T., 2023, In: Proceedings of Machine Learning Research. 202, p. 10421-10430 10 p.

    Research output: Contribution to journal › Conference article › peer-review

  • Transparency Helps Reveal When Language Models Learn Meaning

    Wu, Z., Merrill, W., Peng, H., Beltagy, I. & Smith, N. A., Jun 20 2023, In: Transactions of the Association for Computational Linguistics. 11, p. 617-634

    Research output: Contribution to journal › Article › peer-review

    Open Access
  • 2022

    ABC: Attention with Bounded-Memory Control

    Peng, H., Kasai, J., Pappas, N., Yogatama, D., Wu, Z., Kong, L., Schwartz, R. & Smith, N. A., 2022, ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). Muresan, S., Nakov, P. & Villavicencio, A. (eds.). Association for Computational Linguistics (ACL), p. 7469-7483 15 p. (Proceedings of the Annual Meeting of the Association for Computational Linguistics; vol. 1).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers

    Hassid, M., Peng, H., Rotem, D., Kasai, J., Montero, I., Smith, N. A. & Schwartz, R., 2022, p. 1403-1416. 14 p.

    Research output: Contribution to conference › Paper › peer-review

  • Modeling Context With Linear Attention for Scalable Document-Level Translation

    Wu, Z., Peng, H., Pappas, N. & Smith, N. A., 2022, p. 6960-6968. 9 p.

    Research output: Contribution to conference › Paper › peer-review

  • Tailor: Generating and Perturbing Text with Semantic Controls

    Ross, A., Wu, T., Peng, H., Peters, M. E. & Gardner, M., 2022, ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). Muresan, S., Nakov, P. & Villavicencio, A. (eds.). Association for Computational Linguistics (ACL), p. 3194-3213 20 p. (Proceedings of the Annual Meeting of the Association for Computational Linguistics; vol. 1).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • Twist Decoding: Diverse Generators Guide Each Other

    Kasai, J., Sakaguchi, K., Le Bras, R., Peng, H., Lu, X., Radev, D., Choi, Y. & Smith, N. A., 2022, p. 4909-4923. 15 p.

    Research output: Contribution to conference › Paper › peer-review

  • 2021

    Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation

    Kasai, J., Pappas, N., Peng, H., Cross, J. & Smith, N. A., 2021.

    Research output: Contribution to conference › Paper › peer-review

  • Finetuning Pretrained Transformers into RNNs

    Kasai, J., Peng, H., Zhang, Y., Yogatama, D., Ilharco, G., Pappas, N., Mao, Y., Chen, W. & Smith, N. A., 2021, EMNLP 2021 - 2021 Conference on Empirical Methods in Natural Language Processing, Proceedings. Association for Computational Linguistics (ACL), p. 10630-10643 14 p. (EMNLP 2021 - 2021 Conference on Empirical Methods in Natural Language Processing, Proceedings).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • Infusing finetuning with semantic dependencies

    Wu, Z., Peng, H. & Smith, N. A., Feb 1 2021, In: Transactions of the Association for Computational Linguistics. 9, p. 226-242 17 p.

    Research output: Contribution to journal › Article › peer-review

    Open Access

  • Random Feature Attention

    Peng, H., Pappas, N., Yogatama, D., Schwartz, R., Smith, N. A. & Kong, L., 2021.

    Research output: Contribution to conference › Paper › peer-review

  • 2020

    A mixture of h - 1 heads is better than h heads

    Peng, H., Schwartz, R., Li, D. & Smith, N. A., 2020, ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. Association for Computational Linguistics (ACL), p. 6566-6577 12 p. (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • 2019

    PaLM: A hybrid parser and language model

    Peng, H., Schwartz, R. & Smith, N. A., 2019, EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Conference. Association for Computational Linguistics, p. 3644-3651 8 p. (EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Conference).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • RNN architecture learning with sparse regularization

    Dodge, J., Schwartz, R., Peng, H. & Smith, N. A., 2019, EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Conference. Association for Computational Linguistics, p. 1179-1184 6 p. (EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Conference).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • Text generation with exemplar-based adaptive decoding

    Peng, H., Parikh, A. P., Faruqui, M., Dhingra, B. & Das, D., 2019, Long and Short Papers. Association for Computational Linguistics (ACL), p. 2555-2565 11 p. (NAACL HLT 2019 - 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceedings of the Conference; vol. 1).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • 2018

    Backpropagating through Structured Argmax using a SPIGOT

    Peng, H., Thomson, S. & Smith, N. A., 2018, ACL 2018 - 56th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). Association for Computational Linguistics (ACL), p. 1863-1873 11 p. (ACL 2018 - 56th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers); vol. 1).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

    Open Access

  • Learning joint semantic parsers from disjoint data

    Peng, H., Thomson, S., Swayamdipta, S. & Smith, N. A., 2018, Long Papers. Association for Computational Linguistics (ACL), p. 1492-1502 11 p. (NAACL HLT 2018 - 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceedings of the Conference; vol. 1).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • Rational recurrences

    Peng, H., Schwartz, R., Thomson, S. & Smith, N. A., 2018, Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP 2018. Riloff, E., Chiang, D., Hockenmaier, J. & Tsujii, J. (eds.). Association for Computational Linguistics, p. 1203-1214 12 p. (Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP 2018).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • "You are no Jack Kennedy": On Media Selection of Highlights from Presidential Debates

    Tan, C., Peng, H. & Smith, N. A., Apr 10 2018, The Web Conference 2018 - Proceedings of the World Wide Web Conference, WWW 2018. Association for Computing Machinery, p. 945-954 10 p. (The Web Conference 2018 - Proceedings of the World Wide Web Conference, WWW 2018).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

    Open Access
  • 2017

    Deep multitask learning for semantic dependency parsing

    Peng, H., Thomson, S. & Smith, N. A., 2017, ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers). Association for Computational Linguistics (ACL), p. 2037-2048 12 p. (ACL 2017 - 55th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (Long Papers); vol. 1).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

    Open Access
  • 2016

    A convolutional attention network for extreme summarization of source code

    Allamanis, M., Peng, H. & Sutton, C., 2016, 33rd International Conference on Machine Learning, ICML 2016. Weinberger, K. Q. & Balcan, M. F. (eds.). International Machine Learning Society (IMLS), p. 3043-3052 10 p. (33rd International Conference on Machine Learning, ICML 2016; vol. 5).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

  • News citation recommendation with implicit and explicit semantics

    Peng, H., Liu, J. & Lin, C. Y., 2016, 54th Annual Meeting of the Association for Computational Linguistics, ACL 2016 - Long Papers. Association for Computational Linguistics (ACL), p. 388-398 11 p. (54th Annual Meeting of the Association for Computational Linguistics, ACL 2016 - Long Papers; vol. 1).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

    Open Access
  • 2015

    A comparative study on regularization strategies for embedding-based neural networks

    Peng, H., Mou, L., Li, G., Chen, Y., Lu, Y. & Jin, Z., 2015, Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (ACL), p. 2106-2111 6 p. (Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

    Open Access

  • Building program vector representations for deep learning

    Peng, H., Mou, L., Li, G., Liu, Y., Zhang, L. & Jin, Z., 2015, Knowledge Science, Engineering and Management - 8th International Conference, KSEM 2015, Proceedings. Zhang, Z., Zhang, S., Zhang, Z., Wirsing, M., Wirsing, M., Wirsing, M., Zhang, Z., Zhang, S. & Zhang, S. (eds.). Springer, p. 547-553 7 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 9403).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

    Open Access

  • Classifying relations via long short term memory networks along shortest dependency paths

    Xu, Y., Mou, L., Li, G., Chen, Y., Peng, H. & Jin, Z., 2015, Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (ACL), p. 1785-1794 10 p. (Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

    Open Access

  • Discriminative neural sentence modeling by tree-based convolution

    Mou, L., Peng, H., Li, G., Xu, Y., Zhang, L. & Jin, Z., 2015, Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics (ACL), p. 2315-2325 11 p. (Conference Proceedings - EMNLP 2015: Conference on Empirical Methods in Natural Language Processing).

    Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

    Open Access