Academic Journal
Image manipulation using convolutional neural network
| Title: | Image manipulation using convolutional neural network |
|---|---|
| Contributors: | Gao, Hongyun (author.), Jia, Jiaya (thesis advisor.), Chinese University of Hong Kong Graduate School. Division of Computer Science and Engineering. (degree granting institution.) |
| Publication Year: | 2019 |
| Collection: | The Chinese University of Hong Kong: CUHK Digital Repository / 香港中文大學數碼典藏 |
| Subject Terms: | Image processing--Data processing, Image reconstruction, Neural networks (Computer science), TA1637 .G38 2019eb |
| Description: | M.Phil. ; A variety of low-level vision tasks are ill-posed, since multiple output images correspond to the same input image. These ill-posed tasks include super-resolution, denoising, deblurring, matting, inpainting etc. Previous methods usually require assumptions or priors to solve these ill-posed problems. When the assumptions does not hold, the algorithm performance often degenerates much. For example, uniform motion deblurring algorithms cannot generalize well to dynamic scenes due to the uniform blur kernel assumption is no longer satisfied. However, with the recent progress in convolutional neural networks (CNNs), these ill-posed problems benefit much from effective network structures and large volumes of paired training data. In this thesis, we aim at solving two low-level vision problems, i.e., dynamic scene deblurring and portrait image matting, by introducing new network structures and building new training and evaluation dataset for respective tasks. ; In the first part, we analyze parameter strategies for the deblurring networks i.e., parameter independence scheme in [36] and the parameter sharing scheme in [55], and propose a new selective sharing scheme with independent and shared modules. Inside the subnetwork in each scale, we propose a new nested skip connection structure for the nonlinear transformation modules to replace stacked convolution layers or residual blocks. Besides, we build a new large dataset of blurred/sharp image pairs towards better restoration quality. Comprehensive experimental results show that the parameter selective sharing scheme, nested skip connection structure, and the new dataset all significantly improve performance to set a new state-of-the-art in dynamic scene deblurring. ; In the second part, we propose an automatic portrait image matting system. This method does not need any user interaction, which was however essential in most previous approaches. In order to accomplish this goal, a new end-to-end CNN based framework is proposed to take the input of a portrait ... |
| Document Type: | text |
| File Description: | electronic resource; remote; 1 online resource (x, 55 leaves) : illustrations (chiefly color); computer; online resource |
| Language: | English Chinese |
| Relation: | cuhk:2327378; local: ETD920201012; local: 991039842701503407 |
| Availability: | https://julac.hosted.exlibrisgroup.com/primo-explore/search?query=addsrcrid,exact,991039842701503407,AND&tab=default_tab&search_scope=All&vid=CUHK&mode=advanced&lang=en_US https://repository.lib.cuhk.edu.hk/en/item/cuhk-2327378 |
| Rights: | Use of this resource is governed by the terms and conditions of the Creative Commons "Attribution-NonCommercial-NoDerivatives 4.0 International" License (http://creativecommons.org/licenses/by-nc-nd/4.0/) |
| Accession Number: | edsbas.FDA7EE8E |
| Database: | BASE |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://julac.hosted.exlibrisgroup.com/primo-explore/search?query=addsrcrid,exact,991039842701503407,AND&tab=default_tab&search_scope=All&vid=CUHK&mode=advanced&lang=en_US# Name: EDS - BASE (ns324271) Category: fullText Text: View record from BASE |
|---|---|
| Header | DbId: edsbas DbLabel: BASE An: edsbas.FDA7EE8E RelevancyScore: 883 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 883.215454101563 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Image manipulation using convolutional neural network – Name: Author Label: Contributors Group: Au Data: Gao, Hongyun (author.)<br />Jia, Jiaya (thesis advisor.)<br />Chinese University of Hong Kong Graduate School. Division of Computer Science and Engineering. (degree granting institution.) – Name: DatePubCY Label: Publication Year Group: Date Data: 2019 – Name: Subset Label: Collection Group: HoldingsInfo Data: The Chinese University of Hong Kong: CUHK Digital Repository / 香港中文大學數碼典藏 – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Image+processing--Data+processing%22">Image processing--Data processing</searchLink><br /><searchLink fieldCode="DE" term="%22Image+reconstruction%22">Image reconstruction</searchLink><br /><searchLink fieldCode="DE" term="%22Neural+networks+%28Computer+science%29%22">Neural networks (Computer science)</searchLink><br /><searchLink fieldCode="DE" term="%22TA1637+%2EG38+2019eb%22">TA1637 .G38 2019eb</searchLink> – Name: Abstract Label: Description Group: Ab Data: M.Phil. ; A variety of low-level vision tasks are ill-posed, since multiple output images correspond to the same input image. These ill-posed tasks include super-resolution, denoising, deblurring, matting, inpainting etc. Previous methods usually require assumptions or priors to solve these ill-posed problems. When the assumptions does not hold, the algorithm performance often degenerates much. For example, uniform motion deblurring algorithms cannot generalize well to dynamic scenes due to the uniform blur kernel assumption is no longer satisfied. However, with the recent progress in convolutional neural networks (CNNs), these ill-posed problems benefit much from effective network structures and large volumes of paired training data. In this thesis, we aim at solving two low-level vision problems, i.e., dynamic scene deblurring and portrait image matting, by introducing new network structures and building new training and evaluation dataset for respective tasks. ; In the first part, we analyze parameter strategies for the deblurring networks i.e., parameter independence scheme in [36] and the parameter sharing scheme in [55], and propose a new selective sharing scheme with independent and shared modules. Inside the subnetwork in each scale, we propose a new nested skip connection structure for the nonlinear transformation modules to replace stacked convolution layers or residual blocks. Besides, we build a new large dataset of blurred/sharp image pairs towards better restoration quality. Comprehensive experimental results show that the parameter selective sharing scheme, nested skip connection structure, and the new dataset all significantly improve performance to set a new state-of-the-art in dynamic scene deblurring. ; In the second part, we propose an automatic portrait image matting system. This method does not need any user interaction, which was however essential in most previous approaches. In order to accomplish this goal, a new end-to-end CNN based framework is proposed to take the input of a portrait ... – Name: TypeDocument Label: Document Type Group: TypDoc Data: text – Name: Format Label: File Description Group: SrcInfo Data: electronic resource; remote; 1 online resource (x, 55 leaves) : illustrations (chiefly color); computer; online resource – Name: Language Label: Language Group: Lang Data: English<br />Chinese – Name: NoteTitleSource Label: Relation Group: SrcInfo Data: cuhk:2327378; local: ETD920201012; local: 991039842701503407 – Name: URL Label: Availability Group: URL Data: https://julac.hosted.exlibrisgroup.com/primo-explore/search?query=addsrcrid,exact,991039842701503407,AND&tab=default_tab&search_scope=All&vid=CUHK&mode=advanced&lang=en_US<br />https://repository.lib.cuhk.edu.hk/en/item/cuhk-2327378 – Name: Copyright Label: Rights Group: Cpyrght Data: Use of this resource is governed by the terms and conditions of the Creative Commons "Attribution-NonCommercial-NoDerivatives 4.0 International" License (http://creativecommons.org/licenses/by-nc-nd/4.0/) – Name: AN Label: Accession Number Group: ID Data: edsbas.FDA7EE8E |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.FDA7EE8E |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English – Text: Chinese Subjects: – SubjectFull: Image processing--Data processing Type: general – SubjectFull: Image reconstruction Type: general – SubjectFull: Neural networks (Computer science) Type: general – SubjectFull: TA1637 .G38 2019eb Type: general Titles: – TitleFull: Image manipulation using convolutional neural network Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Gao, Hongyun (author.) – PersonEntity: Name: NameFull: Jia, Jiaya (thesis advisor.) – PersonEntity: Name: NameFull: Chinese University of Hong Kong Graduate School. Division of Computer Science and Engineering. (degree granting institution.) IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2019 Identifiers: – Type: issn-locals Value: edsbas – Type: issn-locals Value: edsbas.oa |
| ResultId | 1 |