Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create publish-docker.yml #11632

Merged
merged 12 commits into from
Nov 29, 2024
Merged

Create publish-docker.yml #11632

merged 12 commits into from
Nov 29, 2024

Conversation

sungwy
Copy link
Contributor

@sungwy sungwy commented Nov 22, 2024

@sungwy sungwy marked this pull request as draft November 22, 2024 15:13
@github-actions github-actions bot added the INFRA label Nov 22, 2024
@ajantha-bhat
Copy link
Member

I was waiting for the account creation. But thanks for working on it.

@kevinjqliu
Copy link
Contributor

kevinjqliu commented Nov 22, 2024

in addition to pushing the latest, it would be great to publish images tagged with specific releases (1.7/1.8/etc)
also, I found the GitHub action that generates the hive docker image (https://hub.docker.com/r/apache/hive)
https://github.com/apache/hive/blob/afe05b968026dfdda631de1e2b090665f0820ef3/.github/workflows/docker-GA-images.yml#L63

@sungwy
Copy link
Contributor Author

sungwy commented Nov 22, 2024

I was waiting for the account creation. But thanks for working on it.

I think many of us are eager to get the docker image in the hub to improve our integration tests in the sub project repositories. Thank you for doing the hard work @ajantha-bhat !

@sungwy
Copy link
Contributor Author

sungwy commented Nov 25, 2024

in addition to pushing the latest, it would be great to publish images tagged with specific releases (1.7/1.8/etc) also, I found the GitHub action that generates the hive docker image (https://hub.docker.com/r/apache/hive) https://github.com/apache/hive/blob/afe05b968026dfdda631de1e2b090665f0820ef3/.github/workflows/docker-GA-images.yml#L63

Thanks for the suggestion @kevinjqliu - I've added a new trigger for tag push events to publish the docker images with the version tag

Copy link
Contributor

@Fokko Fokko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ran it on my fork, and it looks good: https://github.com/Fokko/iceberg/actions/runs/12007773313

image

run: |
docker login -u ${{ secrets.DOCKERHUB_USER }} -p ${{ secrets.DOCKERHUB_TOKEN }}
- name: Build Docker Image
run: docker build -t apache/iceberg-rest-adapter -f docker/iceberg-rest-adapter-image/Dockerfile .
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What about using apache/iceberg-rest-fixture ? If we have a consensus, I can rename apache/iceberg.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am ok with the name iceberg-rest-fixture, it is a good name 👍

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds good @jbonofre and @ajantha-bhat - I'm good with this new name suggestion as well

@ajantha-bhat
Copy link
Member

ajantha-bhat commented Nov 28, 2024

#11283 got merged. We can move forward with this once @jbonofre share us the docker hub repo details.

@sungwy sungwy marked this pull request as ready for review November 28, 2024 20:48
@sungwy
Copy link
Contributor Author

sungwy commented Nov 28, 2024

@Fokko @ajantha-bhat and @jbonofre - thank you all for the reviews on the PR!

I've verified the publication using both the tag triggered and workflow_dispatch triggered workflows, which yield image with the tagged version, and latest tags respectively.

image

As @jbonofre has already added the dockerhub secrets to the repository, I think we should be good to test the publication through gh actions once we merge this PR

@Fokko
Copy link
Contributor

Fokko commented Nov 29, 2024

@sungwy Thanks for raising this and the thorough testing. I also did some tests against my personal Dockerhub, so let's push this forward.

@Fokko Fokko merged commit 7c7b4ba into apache:main Nov 29, 2024
49 checks passed
@sungwy sungwy deleted the publish-to-dockerhub branch November 29, 2024 13:49
@kevinjqliu
Copy link
Contributor

@sungwy
Copy link
Contributor Author

sungwy commented Nov 29, 2024

Hi @kevinjqliu - I think it's because the DOCKERHUB_USER is a different value than apache. I naively assumed that they'd be the same in this PR.

I see the following image on dockerhub that was published around the time of the job run: https://hub.docker.com/r/asfjenkins/iceberg-rest-fixture

I think @ajantha-bhat is already working on a fix: #11676

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants