If anyone is looking for an example of a plugin that does some extensive code generation https://github.com/facebookresearch/optimizer-plugins is now open source.