Academic Journal
Enhanced Facial Realism in Personalized Diffusion Models: A Memory-Optimized DreamBooth Implementation for Consumer Hardware.
| Τίτλος: | Enhanced Facial Realism in Personalized Diffusion Models: A Memory-Optimized DreamBooth Implementation for Consumer Hardware. |
|---|---|
| Συγγραφείς: | Gupta, Sandeep1 (AUTHOR), Ray, Kanad2,3 (AUTHOR) kray@jpr.amity.edu, Kaiser, Shamim3,4 (AUTHOR), Hossain, Sazzad4,5 (AUTHOR), Faubert, Jocelyn5,6 (AUTHOR) |
| Πηγή: | Algorithms. Apr2026, Vol. 19 Issue 4, p257. 20p. |
| Θεματικοί όροι: | *Computer memory management, *Hardware, *Total quality management, *Probabilistic generative models |
| Περίληψη: | Despite significant progress in general-purpose diffusion-based models capable of producing high-quality media, this approach is still too difficult to implement on consumer/gamer hardware. We present here a memory-optimized DreamBooth framework designed for consumer-grade GPUs with 16 GB of VRAM, that allows for end-to-end image personalization and addresses some of the limitations of existing solutions. Our system reduces peak GPU memory from 22 GB (baseline DreamBooth) to 14.2 GB through novel hierarchical memory management, including attention slicing, Variational Autoencoder (VAE) tiling, gradient accumulation, and gradient checkpointing integrated within the Hugging Face Accelerate ecosystem. The framework further incorporates state-of-the-art techniques for preserving facial features and a comprehensive automated quality management system. The result is a complete end-to-end pipeline achieving a peak memory of 14.2 GB, with quantitative performance (LPIPS: 0.139, SSIM: 0.879, identity: 0.852, and FID: 23.1) competitive with methods requiring significantly more hardware resources. [ABSTRACT FROM AUTHOR] |
| Βάση Δεδομένων: | Academic Search Index |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://resolver.ebsco.com/c/fiv2js/result?sid=EBSCO:asx&genre=article&issn=19994893&ISBN=&volume=19&issue=4&date=20260401&spage=257&pages=257-276&title=Algorithms&atitle=Enhanced%20Facial%20Realism%20in%20Personalized%20Diffusion%20Models%3A%20A%20Memory-Optimized%20DreamBooth%20Implementation%20for%20Consumer%20Hardware.&aulast=Gupta%2C%20Sandeep&id=DOI:10.3390/a19040257 Name: Full Text Finder (for New FTF UI) (ns324271) Category: fullText Text: Full Text Finder MouseOverText: Full Text Finder |
|---|---|
| Header | DbId: asx DbLabel: Academic Search Index An: 193433733 RelevancyScore: 1411 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 1411.07458496094 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Enhanced Facial Realism in Personalized Diffusion Models: A Memory-Optimized DreamBooth Implementation for Consumer Hardware. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Gupta%2C+Sandeep%22">Gupta, Sandeep</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Ray%2C+Kanad%22">Ray, Kanad</searchLink><relatesTo>2,3</relatesTo> (AUTHOR)<i> kray@jpr.amity.edu</i><br /><searchLink fieldCode="AR" term="%22Kaiser%2C+Shamim%22">Kaiser, Shamim</searchLink><relatesTo>3,4</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Hossain%2C+Sazzad%22">Hossain, Sazzad</searchLink><relatesTo>4,5</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Faubert%2C+Jocelyn%22">Faubert, Jocelyn</searchLink><relatesTo>5,6</relatesTo> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Algorithms%22">Algorithms</searchLink>. Apr2026, Vol. 19 Issue 4, p257. 20p. – Name: Subject Label: Subject Terms Group: Su Data: *<searchLink fieldCode="DE" term="%22Computer+memory+management%22">Computer memory management</searchLink><br />*<searchLink fieldCode="DE" term="%22Hardware%22">Hardware</searchLink><br />*<searchLink fieldCode="DE" term="%22Total+quality+management%22">Total quality management</searchLink><br />*<searchLink fieldCode="DE" term="%22Probabilistic+generative+models%22">Probabilistic generative models</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Despite significant progress in general-purpose diffusion-based models capable of producing high-quality media, this approach is still too difficult to implement on consumer/gamer hardware. We present here a memory-optimized DreamBooth framework designed for consumer-grade GPUs with 16 GB of VRAM, that allows for end-to-end image personalization and addresses some of the limitations of existing solutions. Our system reduces peak GPU memory from 22 GB (baseline DreamBooth) to 14.2 GB through novel hierarchical memory management, including attention slicing, Variational Autoencoder (VAE) tiling, gradient accumulation, and gradient checkpointing integrated within the Hugging Face Accelerate ecosystem. The framework further incorporates state-of-the-art techniques for preserving facial features and a comprehensive automated quality management system. The result is a complete end-to-end pipeline achieving a peak memory of 14.2 GB, with quantitative performance (LPIPS: 0.139, SSIM: 0.879, identity: 0.852, and FID: 23.1) competitive with methods requiring significantly more hardware resources. [ABSTRACT FROM AUTHOR] |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=asx&AN=193433733 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.3390/a19040257 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 20 StartPage: 257 Subjects: – SubjectFull: Computer memory management Type: general – SubjectFull: Hardware Type: general – SubjectFull: Total quality management Type: general – SubjectFull: Probabilistic generative models Type: general Titles: – TitleFull: Enhanced Facial Realism in Personalized Diffusion Models: A Memory-Optimized DreamBooth Implementation for Consumer Hardware. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Gupta, Sandeep – PersonEntity: Name: NameFull: Ray, Kanad – PersonEntity: Name: NameFull: Kaiser, Shamim – PersonEntity: Name: NameFull: Hossain, Sazzad – PersonEntity: Name: NameFull: Faubert, Jocelyn IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 04 Text: Apr2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 19994893 Numbering: – Type: volume Value: 19 – Type: issue Value: 4 Titles: – TitleFull: Algorithms Type: main |
| ResultId | 1 |