Efficient Scene-Text Refinement via Pixel-Space Grouped Image Generation
Abstract
PixText refines local text in generated images via grouped pixel-space generation with MeanFlow, improving glyph accuracy while preserving backgrounds and reducing inference cost.
Generated images often have coherent layouts and visual content, yet local errors in small text and complex characters still limit their readability and practical use. Scene-text refinement requires accuracy, preservation, and efficiency. Existing methods based on variational autoencoders (VAEs) can lose fine strokes during reconstruction, while full-image editing can shift background colors. In this work, we introduce PixText, a model that formulates local text refinement as grouped image generation in pixel space. Conditioned on the original image, PixText generates only the target regions, preserves unedited content, and uses MeanFlow for four-step generation. We further introduce Text Refinement Bench to evaluate text correction and image preservation in generated images. On this benchmark, PixText achieves 83.06% glyph pass and 94.66% exact target-character OCR accuracy, versus 36.77% and 52.31% for the strongest baseline. Its four-step MeanFlow variant retains an 81.84% pass rate with less than one GPU-second of amortized generation cost per image.
Community
🚀 Great image, garbled text? Meet PixText, our approach to precise and efficient scene-text refinement. By generating only the target regions directly in pixel space, PixText corrects small text and complex characters while preserving the surrounding image. On our new Text Refinement Bench, it achieves 94.66% exact target-character OCR accuracy, compared with 52.31% for the strongest baseline. For fast inference, our four-step MeanFlow variant retains an 81.84% glyph pass rate at less than one GPU-second per image in amortized generation cost. We’re excited to share this step toward making generated images more readable and usable—feedback is welcome! 🤗
Get this paper in your agent:
hf papers read 2610.18284 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper