Neural Linguistic Steganography

Neural Linguistic Steganography

Zachary M. Ziegler*, Yuntian Deng*, Alexander M. Rush

* Zachary M. Ziegler and Yuntian Deng contributed equally.

First arXiv submission: · EMNLP-IJCNLP 2019

Published version: November 2019. The publication and preprint records below retain their own dates and identifiers.

Combines arithmetic coding with large pretrained language models to encode secret information into generated text while closely matching the model's distribution. GPT-2 experiments evaluate information capacity, statistical divergence, and human judgments of contextual continuations, and demonstrate encoding natural-language messages into unrelated cover text.

Relationship to Neural Linguistic Steganography

The original paper associated with this research site and its STEGASURAS implementation. The published paper links steganography.live and the official repository.

Scope and limitations

The statistical experiments measure divergence from the language model, not an inaccessible true human-language distribution. Truncation and temperature choices create a practical trade-off between human plausibility and distribution matching.

Cite this paper

Published version

Zachary M. Ziegler, Yuntian Deng, Alexander M. Rush. Neural Linguistic Steganography. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019

Published version BibTeX · Published version CSL-JSON

Show BibTeX
@inproceedings{neural-linguistic-steganography-publication,
  title = {{Neural Linguistic Steganography}},
  author = {Ziegler, Zachary M. and Deng, Yuntian and Rush, Alexander M.},
  year = {2019},
  booktitle = {Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)},
  doi = {10.18653/v1/D19-1115},
  pages = {1210--1215},
  publisher = {Association for Computational Linguistics},
  url = {https://aclanthology.org/D19-1115/}
}

arXiv preprint

Zachary M. Ziegler, Yuntian Deng, Alexander M. Rush. Neural Linguistic Steganography. arXiv:1909.01496. First submission: September 3, 2019.

This citation records the first arXiv version and its original title. The version-specific link distinguishes it from later revisions; cite the version supporting your claim.

arXiv preprint BibTeX · arXiv preprint CSL-JSON

Show BibTeX
@misc{neural-linguistic-steganography-preprint,
  title = {{Neural Linguistic Steganography}},
  author = {Ziegler, Zachary M. and Deng, Yuntian and Rush, Alexander M.},
  year = {2019},
  publisher = {arXiv},
  eprint = {1909.01496v1},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1909.01496v1}
}

Primary sources

Read or reuse this entry

JSON record · Markdown · Find in the full list

These notes are an editorial reading aid. Consult the primary sources for the authors’ claims, assumptions, and experiments.