Shopify's engineering introduced gisting, a novel technique for compressing long LLM prompts into a smaller set of learned "gist" tokens, improving throughput and reducing inference cost.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results