support arm64 vm sku

[andyzhangx]

/kind feature

Describe the solution you'd like
[A clear and concise description of what you want to happen.]
Currently when I create an arm64 vm sku node pool, e.g. Standard_D2pls_v5, it would fail

https://prow.k8s.io/view/gs/kubernetes-ci-logs/pr-logs/pull/kubernetes-sigs_blob-csi-driver/1634/pull-blob-csi-driver-e2e-arm64/1845733738135162880

xl5q6 (service: virtualmachine): PUT https://management.azure.com/subscriptions/46678f10-4bbb-447e-98e8-d2829589f2d8/resourceGroups/capz-2zff9l/providers/Microsoft.Compute/virtualMachines/capz-2zff9l-md-0-54tsq-xl5q6
  --------------------------------------------------------------------------------
  RESPONSE 400: 400 Bad Request
  ERROR CODE: BadRequest
  --------------------------------------------------------------------------------
  {
    "error": {
      "code": "BadRequest",
      "message": "The selected VM size 'Standard_D2pls_v5' cannot boot Hypervisor Generation '1'. If this was a Create operation please check that the Hypervisor Generation of the Image matches the Hypervisor Generation of the selected VM Size. If this was an Update operation please select a Hypervisor Generation '1' VM Size. For more information, see https://aka.ms/azuregen2vm"
    }
  }

Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]

Environment:

• cluster-api-provider-azure version:
• Kubernetes version: (use kubectl version):
• OS (e.g. from /etc/os-release):

[andyzhangx]

cc @mboersma @jackfrancis

[andyzhangx]

how can I create a hyper v2 node pool in capz? current error is The selected VM size 'Standard_D2pls_v5' cannot boot Hypervisor Generation '1'

https://storage.googleapis.com/kubernetes-ci-logs/pr-logs/pull/kubernetes-sigs_blob-csi-driver/1634/pull-blob-csi-driver-e2e-arm64/1845733738135162880/artifacts/clusters/bootstrap/controllers/capz-controller-manager/capz-controller-manager-856c6d4446-g97zc/manager.log

[MartinForReal]

kubernetes-sigs/blob-csi-driver#1635

[MartinForReal]

#1003

[MartinForReal]

cluster-api-provider-azure/templates/test/ci/cluster-template-prow-ci-version.yaml

Line 243 in 76a735b

sku: ubuntu-2204-gen1

[andyzhangx]

how can I set gen2 in test-infra config?

[mboersma]

See also kubernetes-sigs/image-builder#936

how can I set gen2 in test-infra config?

We haven't published gen2 images (or arm64 images) to the Marketplace, so you'd have to build and host the right images somewhere.

Note that CAPZ is transitioning to a community gallery and won't be updating the Marketplace images from here on out. See #5167.

[andyzhangx]

@mboersma then what about Azure Linux node, does capz supports today?

[mboersma]

We have built Azure Linux 2 images, and I tried to make them the default in #4832, but I ran into a problem that I failed to figure out. (Help is welcome!)

I intend to build Azure Linux 3 images for the community gallery when #5167 merges, but I don't know if they will pass tests until we figure out what isn't working.

[andyzhangx]

We have built Azure Linux 2 images, and I tried to make them the default in #4832, but I ran into a problem that I failed to figure out. (Help is welcome!)

I intend to build Azure Linux 3 images for the community gallery when #5167 merges, but I don't know if they will pass tests until we figure out what isn't working.

@mboersma I think if you could provide a parameter for Azure Linux 2 image in test-infra, that would be great, it's not necessary to set as default since the default setting change may break external users.