The future of this project/Wishlist #40
Comments
|
Hi, Not sure it's doable/feasible as I'm not completely familar with k8s yet:
My 2 first cents for this project for 2016 ;-) |
|
Haha, your typo of The UI is probably coming soon Monitoring, I will investigate if the Heapster addon is worth running on Pis, I think it's quite resource-heavy. |
|
Oops! Yes, I mean For the monitoring, there is indeed the resource issue you mention. |
|
@nsteinmetz Check out |
|
Regarding the monitoring, my PR (kubernetes/dashboard#232) to the dashboard might be a good option since it just uses the cAdvisor instance already running on each node to poll usage metrics. Just sayin... |
|
Works fine for me if you rebase your PR to the released |
|
FYI, there's an official ARM Soon, I think kubernetes/kubernetes#19769 will be merged, and then we'll get official binaries and some images for every release >= 1.2.0-alpha.7 So although there hasn't been so much commits on this project lately, ARM support is moving fast forward 👍 RancherOS has announced they are working on ARM support: rancher/os#735 |
|
Just FYI. What we are working on at Rancher is first RancherOS, then Rancher (our full container platform), and finally k8s. In the end we want Rancher running Kubernetes on RancherOS on ARM (specifically ARM64 servers, but rpis will work too). We expect this to take at least another 2-3 months. But I'm watching this project closely. |
|
@ibuildthecloud Directly when we have RancherOS support for ARM, we'll be able to run Kubernetes on ARM and ARM64: kubernetes/kubernetes#19769 (I hope we're gonna merge this before BTW, I made a PR some time ago to enhance Kubernetes setup on RancherOS: kubernetes/kubernetes#19109 and kubernetes/kubernetes#19193. It was so frustrating to not be able to download |
|
Well, And things have evolved on the mainline side too. We will probably have On the RancherOS is running on my Pi 2, and I'll work with @ibuildthecloud to get things working OOTB I'll start working on
But a non-technical thing would be to include some kind of catalog with prebuilt apps that are ready-to-run. E.g. only type Right now I have two apps running on my local cluster, |
|
Thumbs up @lucas . One question : Could the app catalog have a gui fronted
|
|
Great Job Lucas! I’ve tried the new dashboard with heapster (larmog/heapster-armhf image) but something is broken in cadvisor and docker subcontainers. I found some issue reports from people running debian (on x86_64) with the same problem. I guess we have to wait for 1.2 release. Have you had a look at https://helm.sh/ package manager for Kubernetes? I’m running Gogs, Drone and mysql on a 6 node mixed Pi cluster using NFS volumes. I’m not happy with the NFS setup so I will try to add some nodes and setup glusterfs. I really would like to try out RancherOS if I can find the time. I’ll try to help if there’s anything I can do. I’m more of a dev guy than ops, but I’m learning :) /Regards
|
|
@lavvy No it won't have an UI. It's just some @larmog Yeah, the delay between Yeah, I've heard/read about helm, but haven't used it. It's an interesting project (but only for x86_64 😄) I have also thought about RancherOS was a lot of hacking, and had so many rough edges that I'm waiting for rancher/os#760 before I really start to think about it for this project. I've read your blog posts, and they're very nice. Haven't tried |
|
+1 billion for glusterfs in this project @lucas :)
|
|
Hi, @lavvy I'm now running |
|
Wow, real good. I wish @lucas can support this upstream. It appears so
|
|
@larmog Thanks for your work again! I read your post yesterday, and it was amazing! I'm gonna investigate it more, but now I have a rough idea what it looks like thanks to your work.
I'm gonna do this when upstream supports it. There are known issues for the time being. However, all this takes time. Now I'm busy with many things, building @lavvy Please ping me with @luxas. @lucas is a completely other person which I don't know, and he probably don't want to get these conversations to his email. |
|
Thanks @luxas, much appreciated :) |
|
Oh am sorry, thanks for hint. Noted
|
|
@luxas is there a reason why the flannel config uses |
|
No there isn't a specific reason, it was just the default. |
|
Sorry @luxas my fault, I was too quick when I said that I got it working. |
|
Progress! Now I've got Kubernetes I'm using |
@larmog (and others) Please test this: $ docker run -d --net=host kubernetesonarm/etcd
$ docker run \
--volume=/sys:/sys:ro \
--volume=/var/lib/docker/:/var/lib/docker:rw \
--volume=/var/lib/kubelet/:/var/lib/kubelet:shared \
--volume=/var/run:/var/run:rw \
--net=host \
--pid=host \
--privileged=true \
-d \
kubernetesonarm/hyperkube \
/hyperkube kubelet \
--pod_infra_container_image=kubernetesonarm/pause \
--hostname-override="127.0.0.1" \
--address="0.0.0.0" \
--api-servers=http://localhost:8080 \
--config=/etc/kubernetes/manifests-multi \
--cluster-dns=10.0.0.10 \
--cluster-domain=cluster.local \
--allow-privileged=true --v=2This spins up a single node cluster (do Test mounting a secret inside a pod, using |
|
Yeah, now it works! Got native kubelet support with: aefa2bc |
|
@luxas great, I had problem mounting secrets with your first suggested solution. I'll test if: makes a change |
|
I ran some tests and it looks great. Seems that a bunch of errors from when unmounting and removing pods is gone. I saw that it's still the 0.6.2 image, so I'll restart all nodes in "native" mode. I'll even try to enable heapster in dashboard and see how it looks. Awesome job @luxas :D |
|
Yes, I haven't published newer images to Docker Hub than |
|
Hey all, joining the party late. Can we start documenting each thing that needs to get done as a separate issue? I'd love to help with implementation and testing. I'm planning on getting this running on odroid c2's personally, also have rasp pi 2's for testing. |
|
And there we go! v0.7.0 released. See the release notes |
|
Congrats to a great job @luxas. I'll be back with PR for elk. PS. the C2 with |
|
Hi, Congrats for the V0.7 to @luxas and all other participants ; I was less active last weeks/months but with all these new stuff, I need to free some time to test and use it. I may even buy some new cards to replace my RPI1s :-P |
|
@larmog I had to make relatively few changes to https://github.com/sterburg/kubernetes-glusterfs-server to get it working on arm. It works pretty well, but it's annoying that kubernetes-gluster requires the fuse kmod on the host and the glusterfs-fuse driver in the hyperkube container to mount volumes. I found that it was difficult to get working with the registry without moving the registry out of the kube-system namespace(might be a good idea anyways) because the kubernetes volume plugin only allows searching for endpoints in the client pod's namespace. It also, imo, should have replicas set to nodes/2 by default... Also I need to get emmc cards...all of mine are sd and all of these reinstalls are killing me slowly. |
|
@luxas I have got |
|
@nsteinmetz I'm glad that you're back in business :) Many things has happened since
That's a very long list, and the long term goal for this project is to merge things with mainline, and a huge step has been taken these two weeks since I released Feel free to test these images out! From a Google Kubernetes perspective, they are expermiental (no commercial support of course), but they work thanks to my PRs. For more information and links, see kubernetes/kubernetes#17981 @larmog I want the images to be in @DorianGray The official The thing that |
|
@luxas I agree that building all on your own and don't be dependent is the way to go. But that means more work ;). I'll create a PR as soon as I have something working. I got tired of handling all nodes manually and started using @luxas and @DorianGray: a simpler way of handling storage is of course |
Then you should watch as progress is being made in https://github.com/kubernetes/kube-deploy
We should take a look at it at least. How fast is |
|
Hi, I'm willing to help if it is something for this project. If not, those who want's can take a look at @kodbasen. There is probably room for a lot of improvements ;) |
|
Hi everyone! With this release, everything is cross-compiled Now, kubernetes-on-arm is based on Feel free to ask things about it! BTW; I've been maintaining mainline Kubernetes since April, so now I'm improving Kubernetes directly on the first hand, then porting things on arm. In v1.4 focus lies on easy cluster deployment, and I'm working a lot on it. I'm planning to make a follow up v0.8.5 (or v0.9.0) with additional features and hopefully some performance improvements also later on. Thanks for following this project! |
I want this to be a kind of tracking issue for things the community (you) want from this project.
Note: I do not promise to make all features one may wish for/propose, but I would like to know what you think.
Also, feel free to comment here if you are using this project and it is working, that will probably give more fuel to this project :)
I'm working on merging this functionality into mainline Kubernetes, and for that feedback would be greatly appreciated, so the Kubernetes guys know which features count.
Here is the ARM tracking issue: kubernetes/kubernetes#17981
The text was updated successfully, but these errors were encountered: