See progress & outcome of actions in portainer (such as pulling images)

[tripplet]

Is your feature request related to a problem? Please describe.
Currently, there is no way to see the progress of asynchronous tasks in Portainer, in the case of pulling or uploading images this can take a long time. If you browse off to another view you can miss the error messages quite easily.

Describe the solution you'd like
A way to view an overview of asynchronous tasks and their outcomes, such as a dashboard that could pop up from the bottom of the browser window with the click of a button or arrow. This should be accessible from any view in Portainer for convenience.

Additional context:

Previous issue description:

Hi, I'm currently using portainer on my raspberry pi and pulling (and extracting) images can take some time over a slow connection.
In my case >5 minutes. I avoid doing this over portainer as there is no way to see whats happening.
So for this task I have to go back to the shell and pull images via the 'docker pull ...' command.

It would be nice if the progress of the currently running pulls would be visible somewhere, after switching the page, the small spinning gear is in my opinion only feasible for fast actions.

Thanks
Tobi

[deviantony]

I agree with that and I've always thought about adding this. IMO it should go further than just see the progress of pulling images, but being able to see the status of asynchronous tasks in Portainer (pulling an image, starting a container...)

[Fmstrat]

Yea, kinda sad when the best way to monitor an async task, or to find out why an error is occurring in authentication is to sudo strace -s 4096 -f -p $(ps -ef | grep /portainer |grep -v grep |awk '{print $2}')

This is a great app, but visibility into what is happening under the hood, even logging, is lacking.

[xAt0mZ]

Research

Found this topic. It contains some examples of docker sdk usage, with code in Go, Python or using curl.
The following example can be usefull on how to achieve what we want for image pulling real time progress tracking.

@deviantony
Regarding this need: being able to see the status of asynchronous tasks in Portainer , some of the actions give data in real time (for example pulling images), but some don't (starting a container).
We may need to list all the actions that we want to track in real time, and see if the docker api allows us to do so for every action.

[deviantony]

We're only gonna tackle the pullImage operation stream with this issue.

You shared an example on how to use the SDK to pull an image, Portainer is interacting with the Docker API directly (via https://docs.docker.com/engine/api/v1.39/#operation/ImageCreate which is super undocumented).

This API endpoint actually streams a response and I wonder if we can handle it in the frontend or if we need to add an evolution on the backend to support this.

Here is an interesting link about this API endpoint: https://stackoverflow.com/a/54559180/1127536

I did some research on this in the past and that was quite tricky/not possible to do (investigating things such as http://oboejs.com/).

[ghost]

Re-purposing this issue to cover the overview and monitoring of async tasks in Portainer

[darrepac]

Hi

No news on this topic?
My use case:
I am deploying a stack and... I see nothing except "deployment in progress".. what it is doing? if it is downloading images, which ones, at what speed, which ETA... sounds basic needs

[mariyam-portainer]

Hey, we don't currently have this in our roadmap, so there is no ETA on this at the moment unfortunately.

[Openuser87]

Hi,
would like to have this too. Any way to upvote this feature?..

[Luk164]

As a temporary solution, we could add a small console output window below the button and just show the basic console output of docker right? It is not really elegant but it would show us all the required information and should not be too hard to implement.

[darrepac]

As a temporary solution, we could add a small console output window below the button and just show the basic console output of docker right? It is not really elegant but it would show us all the required information and should not be too hard to implement.

Implemented??

[Luk164]

Implemented??

I do not think so.

[Tzeny]

Implemented?

[mpaw]

Still no way to see progress?

[elkinjosetm]

Any update on this?

[Luk164]

Any update on this?

6 years and this highly requested feature is still nowhere to be seen with minimal feedback from the developers. At this point unless somebody implements it and creates a PR I do not think we are going to live to see this feature added.

[Toukassay]

New user from 30mn ago an totally agree ;)

[lostkira]

progress bar, a feature so basic that it took 6 years and still hasn’t been implemented :(

[Nick-Portainer]

Thanks for bumping this, I will raise this internally for discussion

INTERNAL: PCT-245

[PolGZ]

Thanks for bumping this, I will raise this internally for discussion

INTERNAL: PCT-245

I've also started with Portainer a few weeks ago. I was going to update my NC server from the :26 image to the 27, I clicked update the stack and for minutes I was just there seeing the deployment in progress... grey-bluish "button" going on and on... and this is why I end here. I was for sure thinking something went wrong. That is why I googled "portainer deployment in progress".

It definitely needs some sort of feedback to the user, otherwise is just wait and wonder... and after a few minutes you "loose faith" and start to think that there is a problem. Not reassuring at all!

Thanks guys for looking into it!

[JojjeE]

+1 on this. New user of Portainer on a Raspberry Pi 4, soon a Proxmox machine as well. I'm really liking it but the sheer lack of feedback in deploying my stack or pulling a new image is kind of wack. I'm just in the dark when I press the button and wait.

[NostalgicGnome]

I would love to see this implemented too!

[zhaojing1987]

I am using the stacks/create/standalone/repository API, but I also have similar doubts. When the image is large and the network speed is slow, I want to implement a process of canceling installation. Is there any solution? Or as everyone said, provide a progress bar?

[nyrixx]

[jayge91]

is it still going? lol....

[nyrixx]

it is with 100% certainty that it is endlessly spinning somewhere.....for someone.....for all time.

[jayge91]

I've been testing on ODROID C2 and it's an absolute ETERNITY starting a stack with homeassistant (26+GB), not to mention the other services on the same stack....

[nyrixx]

i run into it pretty frequently just setting up individual containers/images, not even stacks. This is with a docker VM with 12 host cores from an epyc 7642 64gb of ram and all u.2 nvme storage. I usually take it as a portainer mandated break cause im afraid to navigate away from the page.

[jayge91]

I'm blown away that this hasn't made it further. It's like waiting an eternity watching that blue box with the spinning wheel.
I saw another post about a code window just scrolling the output of docker compose pull and I think that would be a great move.

[napalmz]

This is why a usually pre-pull using shell commands before deploy stacks.
I also found a "massive pull" script that checks for images and updates them, which I launch by hand every few days.

[mvelbaum]

In my case it also errors out when pulling takes a long time.

[jayge91]

@napalmz , @mvelbaum , I totally agree. I'm using docker compose pull so I can actually tell what's going on. If I knew anything about how the button worked, I'd try making something to put an ugly code window. That'd be WAY better than a spinning wheel IMO.

[ExNought]

When deploying "bigger" stacks this is very tedious. So seeing this is an issue since 2017 I don't understand why this has not been remediated in any way. Even a simple update like "fetching images 1/X" would be better than the current state...

[jearton]

Can it show the real-time speed of docker pull?

[mpaw]

@Nick-Portainer Any updates on this? Literally anything would be better than what we have now. Is there a log file I can tail after I click the button that will show progress?

[mpaw]

@Nick-Portainer Any updates on this? Literally anything would be better than what we have now. Is there a log file I can tail after I click the button that will show progress?

@Nick-Portainer Can you please respond. Any response is better than just ignoring the community.

[Nick-Portainer]

@mpaw Not ignoring, as stated above when I have updates I will post here :)

[SashaGoncharov19]

push

[Alxspb]

push
Strange to have no idea about 10GB image downloading progress in 2024 year, while in docker this progress is trackable

[pebes]

It would be a dream if raw output, similar to docker-compose up in the CLI, was available when deploying a stack. I would stick with the CLI for the time being until proper status output is implemented in Portainer. However, with the way Portainer names folders and how containers created via the CLI show up with limited rights in Portainer, this is also not really an option here which renders me unable to operate.

[NikMAX2077]

Guys, are you serious?! This is a really necessary feature. I can't see any download progress, warnings or errors from the Docker output. In the end I'm forced to use Docker compose CLI to create the stack, which makes Portainer useless for me. I am shocked that after 7 years of discussion there has been no progress on this issue!

[Termuellinator]

I would really appreciate some form of progress indication, too. For my usecase mainly in regards to pulling images.
Sitting there and having absolutely no clue what's going on whatsoever isn't ideal for sure ;)

Doesn't have to be too fancy imho - just something to let you at least roughly gauge how long it might take would be really nice.

[cretinon]

Any news ?

This is a feature i'd like to have too

[Luk164]

Any news ?

This is a feature i'd like to have too

I would not hold my breath, seems like the devs completely abandoned this feature and only keep this ticket open to prevent backlash. Unless someone volunteers a PR, we are not getting this, I would love to be proven wrong