Optimize image, reduce docker image size by 11GB #13

thomasnordquist · 2017-03-14T12:24:16Z

The changes only consist of structural changes,
the build environment itself has not been altered.

What has been achieved by the changes:

much faster build time from 33min to 5.5min (600% faster) (build-time depends on network and IO perfomance)
reduces image size from 16.1GB to 5.14GB (>300% smaller)
reduces image layers from 52 to 36

Clear /var/lib/apt/lists/ in the same layer apt-get update was invoked:
https://docs.docker.com/engine/userguide/eng-image/dockerfile_best-practices/#run

Optimize for image size:
https://blog.replicated.com/engineering/refactoring-a-dockerfile-for-image-size/

This will greatly reduce the final docker image size. (by 678 MB)

This will greatly reduce the final docker image size. (by 2.61GB)

apt-get update is called a few lines below. This layer won't save any disk space

There are no more packages left, they were cleaned in the layers, they have been downloaded in

The previous usage of `chown` and `chmod` lead to two layers which modified all downloaded files, each layer adding 3.6GB to the docker image. (Total of 7.2 GB) Build time is now much shorter, since the files won't be copied to a new layer. Also: - Move user creation to top - Move environmentals to top

CLAassistant · 2017-03-14T12:25:17Z

All committers have signed the CLA.

thomasnordquist · 2017-03-14T12:49:22Z

travis failed since docker was run with --quiet=true.
It also ran much longer then expected. (Slow CI server ?)

travis_time:start:230c3218
�[0K$ docker build --quiet=true -t uber/android-build-environment .


No output has been received in the last 10m0s, this potentially indicates a stalled build or something wrong with the build itself.
Check the details on how to adjust your build configuration on: https://docs.travis-ci.com/user/common-build-problems/#Build-times-out-because-no-output-was-received

The build has been terminated

alrosot

Tested on a separate branch

ottob · 2017-08-18T14:07:18Z

This seems like an great improvement. Any chance this will be merged?

thomasnordquist added 6 commits March 14, 2017 11:46

Remove SDK archive in the same layer it was downloaded

9ff17ed

This will greatly reduce the final docker image size. (by 678 MB)

Remove NDK archive in the same layer it was downloaded

d8f5394

This will greatly reduce the final docker image size. (by 2.61GB)

Remove redundant layer

376b40f

apt-get update is called a few lines below. This layer won't save any disk space

Remove apt cache & lists int the same layer they were created

335a2f1

Remove a redundant layer

c25c61c

There are no more packages left, they were cleaned in the layers, they have been downloaded in

alrosot added a commit to alrosot/android-build-environment that referenced this pull request Apr 9, 2017

https://github.com/uber-common/android-build-environment/pull/13

f6b4d11

alrosot approved these changes Apr 10, 2017

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Optimize image, reduce docker image size by 11GB #13

Optimize image, reduce docker image size by 11GB #13

thomasnordquist commented Mar 14, 2017 •

edited

Loading

CLAassistant commented Mar 14, 2017 •

edited

Loading

thomasnordquist commented Mar 14, 2017

alrosot left a comment

ottob commented Aug 18, 2017

Optimize image, reduce docker image size by 11GB #13

Are you sure you want to change the base?

Optimize image, reduce docker image size by 11GB #13

Conversation

thomasnordquist commented Mar 14, 2017 • edited Loading

CLAassistant commented Mar 14, 2017 • edited Loading

thomasnordquist commented Mar 14, 2017

alrosot left a comment

Choose a reason for hiding this comment

ottob commented Aug 18, 2017

thomasnordquist commented Mar 14, 2017 •

edited

Loading

CLAassistant commented Mar 14, 2017 •

edited

Loading